Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Year in Review
  • Published:

Clinical practice in 2023

Large language models: rheumatologists’ newest colleagues?

In 2023, large language models demonstrated potential for use in rheumatology to accurately suggest diagnoses and provide empathetic patient education. However, the propensity of this technology to generate misleading information continues to pose risks. Balancing innovation with physician guidance is essential.

Key advances

  • Large language models (LLMs) have demonstrated diagnostic potential for rheumatic diseases, in some situations even outperforming diagnosis by rheumatologists5.

  • ChatGPT and other LLMs can potentially contribute to patient education by providing detailed and empathetic responses to their queries, thereby enhancing patient understanding, fostering trust and promoting treatment adherence6.

  • Caution should be displayed in the use of LLMs, as they have displayed a propensity for generating ‘hallucinated’ or misleading information about anchor medications such as methotrexate7.

This is a preview of subscription content, access via your institution

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

References

  1. Hügle, T. The wide range of opportunities for large language models such as ChatGPT in rheumatology. RMD Open 9, e003105 (2023).

    Article  PubMed  PubMed Central  Google Scholar 

  2. Venerito, V., Bilgin, E., Iannone, F. & Kiraz, S. AI am a rheumatologist: a practical primer to large language models for rheumatologists. Rheumatology 62, 3256–3260 (2023).

    Article  PubMed  PubMed Central  Google Scholar 

  3. Vaswani, A. et al. Attention is all you need. Preprint at https://arXiv.org/abs/1706.03762v1 (2017).

  4. Venerito, V., Puttaswamy, D., Iannone, F. & Gupta, L. Large language models and rheumatology: a comparative evaluation. Lancet Rheumatol. 5, e574–e578 (2023).

    Article  CAS  PubMed  Google Scholar 

  5. Krusche, M., Callhoff, J., Knitza, J. & Ruffer, N. Diagnostic accuracy of a large language model in rheumatology: comparison of physician and ChatGPT-4. Rheumatol. Int. https://doi.org/10.1007/s00296-023-05464-6 (2023).

    Article  PubMed  PubMed Central  Google Scholar 

  6. Ayers, J. W. et al. Comparing physician and artificial intelligence chatbot responses to patient questions posted to a public social media forum. JAMA Intern. Med. 183, 589–596 (2023).

    Article  PubMed  Google Scholar 

  7. Coskun, B. N., Yagiz, B., Ocakoglu, G., Dalkilic, E. & Pehlivan, Y. Assessing the accuracy and completeness of artificial intelligence language models in providing information on methotrexate use. Rheumatol. Int. https://doi.org/10.1007/s00296-023-05473-5 (2023).

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Latika Gupta.

Ethics declarations

Competing interests

Authors declare no competing interests.

Additional information

Related links

Bard: https://bard.google.com/

ChatGPT: https://chat.openai.com

Claude: https://claude.ai/chats

Llama: https://ai.meta.com/llama/

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Venerito, V., Gupta, L. Large language models: rheumatologists’ newest colleagues?. Nat Rev Rheumatol 20, 75–76 (2024). https://doi.org/10.1038/s41584-023-01070-9

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41584-023-01070-9

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing