Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Comment
  • Published:

Large language model AI chatbots require approval as medical devices

Nature Medicine volume 29, pages 2396–2398 (2023)Cite this article

Subjects

Chatbots powered by artificial intelligence used in patient care are regulated as medical devices, but their unreliability precludes approval as such.

This is a preview of subscription content, access via your institution

Relevant articles

Open Access articles citing this article.

Access options

Buy this article

  • Purchase on Springer Link
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

References

  1. Singhal, K. et al. Preprint at https://doi.org/10.48550/arXiv.2212.13138 (2022).

  2. Roose, K. New York Times https://go.nature.com/3X7xXku (5 December 2022).

  3. Lee, P. et al. N. Engl. J. Med. 388, 1233–1239 (2023).

    Article  PubMed  Google Scholar 

  4. Korngiebel, D. M. et al. NPJ Digit. Med. 4, 93 (2021).

    Article  PubMed  PubMed Central  Google Scholar 

  5. Wolfram, S. Stephen Wolfram Writings https://go.nature.com/3qP9hBi (14 February 2023).

  6. Stokel-Walker, C. et al. Nature 614, 214–216 (2023).

    Article  CAS  PubMed  Google Scholar 

  7. Riel, N. V. et al. BJGP Open 1, bjgpopen17X100833 (2017).

    Article  PubMed  PubMed Central  Google Scholar 

  8. Dorfman, S. PM360 https://go.nature.com/3Jfzbo0 (2019).

  9. European Union. Regulation (EU) 2017/745 of the European Parliament and of the Council (5 April 2017).

  10. US FDA. https://go.nature.com/3NwlVOc (2022).

  11. Stokel-Walker, C. Nature https://doi.org/10.1038/d41586-023-00423-4 (2023).

    Article  PubMed  Google Scholar 

  12. Dawes, R. AINews https://go.nature.com/3p9HRoY (28 October 2020).

  13. Ingram, D. NBC News https://go.nature.com/43ZEGip (14 January 2023).

  14. Yang, X. et al. NPJ Digit. Med. 5, 194 (2022).

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

This work was supported by the German Federal Ministry of Education and Research (Bundesministerium für Bildung und Forschung, BMBF) through the European Union-financed NextGenerationEU program under grant number 16KISA100K, project PATH (Personal Mastery of Health and Wellness Data).

Author information

Authors and Affiliations

  1. Else Kröner Fresenius Center for Digital Health, Technische Universität Dresden, Dresden, Germany

    Stephen Gilbert

  2. Hardian Health, Haywards Heath, UK

    Hugh Harvey

  3. School of Medicine, Trinity College, University of Dublin, Dublin, Ireland

    Tom Melvin

  4. Axon Lawyers, Amsterdam, The Netherlands

    Erik Vollebregt

  5. Wicks Digital Health, Advantage House, Stowe Court, Lichfield, UK

    Paul Wicks

Authors
  1. Stephen Gilbert
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Hugh Harvey
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Tom Melvin
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Erik Vollebregt
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Paul Wicks
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stephen Gilbert.

Ethics declarations

Competing interests

S.G. has or has had consulting relationships with Una Health GmbH, Lindus Health Ltd, Flo Health Ltd, Thymia Ltd and Ada Health GmbH; and holds share options in Ada Health GmbH. E.V. is a partner of Axon Lawyers. H.H. is owner and managing director of Hardian Ltd. T.M. is an unpaid advisory board member of Pumpinheart Ltd; was previously a senior medical officer in medical devices at the Health Products Regulatory Authority, Ireland; and was previously co-chair of the Clinical Investigation and Evaluation Working Group of the European Commission. P.W. is employed by Wicks Digital Health Ltd, which has received funding from Ada Health, AstraZeneca, Biogen, Bold Health, Camoni, Compass Pathways, Corevitas, EIT, Endava, Happify, HealthUnlocked, Inbeeo, Kheiron Medical, Lindus Health, MedRhythms, PatientsLikeMe, Sano Genetics, Self Care Catalysts, The Learning Corp, The Wellcome Trust, THREAD Research, United Genomics, VeraSci and Woebot. P.W. and spouse are shareholders of WDH Investments Ltd, which owns stock in BlueSkeye AI Ltd, Earswitch Ltd, Sano Genetics Ltd and Una Health GmbH.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gilbert, S., Harvey, H., Melvin, T. et al. Large language model AI chatbots require approval as medical devices. Nat Med 29, 2396–2398 (2023). https://doi.org/10.1038/s41591-023-02412-6

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41591-023-02412-6

This article is cited by

Search

Advanced search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing