Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • Correspondence
  • Published:

PRISMA AI reporting guidelines for systematic reviews and meta-analyses on AI in healthcare

Nature Medicine volume 29, pages 14–15 (2023)Cite this article

Subjects

Systematic reviews and meta-analyses play an essential part in guiding clinical practice at the point of care, as well as in the formulation of clinical practice guidelines and health policy1,2. There are three essential components to an impactful systematic review. First, the design of a study should be based upon a robust research question and search strategy. Second, minimization of bias should be enhanced by using quality-assessment tools and study-design-specific eligibility criteria. Third, reporting of results should be conducted transparently through adherence to expert-derived reporting items. Thousands of systematic reviews, including meta-analyses, are produced annually, with an increasing proportion reporting on artificial intelligence (AI) interventions in health care. With this rapid expansion, there is a need for reporting guidelines tailored to AI3,4,5,6,7 that will support high-quality, reproducible, and clinically relevant systematic reviews.

AI is being integrated rapidly into society and in medicine. A literature search of studies referencing AI in health care over the past 20 years returned more than 70,000 published articles. Given that interest in AI is reaching an all-time high, there arise new concerns regarding the quality of these studies, including a lack of: clear explainability of how AI algorithms function; strong evidence of effectiveness in clinical settings; and standardized reporting within primary studies. Efforts have been made to improve understanding of this technology to allow for critical appraisal of AI interventions and to reduce inconsistencies in how studies are structured, as well as reporting of data, methods and results3,5,7. As systematic reviews on AI interventions increase, so does the importance of the transparency and reproducibility of reported data.

This is a preview of subscription content, access via your institution

Access options

Buy this article

  • Purchase on Springer Link
  • Instant access to full article PDF
Buy now

Prices may be subject to local taxes which are calculated during checkout

References

  1. Page, M. J. et al. Syst. Rev. 10, 89 (2021).

    Article  Google Scholar 

  2. Moher, D. et al. Epidemiology 22, 128 (2011).

    Article  Google Scholar 

  3. Liu, X. et al. Nat. Med. 26, 1364–1374 (2020).

    Article  CAS  Google Scholar 

  4. Mongan, J. et al. Radiol. Artif. Int. 2, e200029 (2020).

    Article  Google Scholar 

  5. Sounderajah, V. et al. Nat. Med. 26, 807–808 (2020).

    Article  CAS  Google Scholar 

  6. Vasey, B. et al. Nat. Med. 28, 924–933 (2022).

    Article  CAS  Google Scholar 

  7. Cruz Rivera, S. et al. Nat. Med. 26, 1351–1363 (2020).

    Article  CAS  Google Scholar 

  8. The CONSORT-AI and SPIRIT-AI Steering Group. Nat. Med. 25, 1467–1468 (2019).

    Article  Google Scholar 

  9. Sounderajah, V. et al. Nat. Med. 27, 1663–1665 (2021).

    Article  CAS  Google Scholar 

  10. Moher, D. et al. PLoS Med. 7, e1000217 (2010).

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. USC Institute of Urology and Catherine and Joseph Aresty Department of Urology, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA

    Giovanni E. Cacciamani, Timothy N. Chu, Daniel I. Sanford, Andre Abreu, Inderbir S. Gill & Andrew J. Hung

  2. AI Center at USC Urology, USC Institute of Urology, University of Southern California, Los Angeles, CA, USA

    Giovanni E. Cacciamani, Timothy N. Chu, Daniel I. Sanford, Andre Abreu, Inderbir S. Gill & Andrew J. Hung

  3. Department of Radiology, University of Southern California, Los Angeles, CA, USA

    Giovanni E. Cacciamani, Timothy N. Chu, Daniel I. Sanford, Andre Abreu, Vinay Duddalwar & Inderbir S. Gill

  4. Center for Image-Guided and Focal Therapy for Prostate Cancer, Institute of Urology and Catherine and Joseph Aresty Department of Urology, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA

    Giovanni E. Cacciamani, Andre Abreu & Inderbir S. Gill

  5. Norris Comprehensive Cancer Center, Institute of Urology, Keck School of Medicine of the University of Southern California, Los Angeles, CA, USA

    Giovanni E. Cacciamani, Andre Abreu, Inderbir S. Gill & Andrew J. Hung

  6. USC Radiomics Laboratory, Keck School of Medicine, Department of Radiology, University of Southern California, Los Angeles, CA, USA

    Vinay Duddalwar

  7. Department of Aerospace and Mechanical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA

    Assad Oberai

  8. Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA

    Assad Oberai

  9. Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA

    C.-C. Jay Kuo

  10. University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK

    Xiaoxuan Liu & Alastair K. Denniston

  11. Institute of Inflammation and Ageing, College of Medical and Dental Sciences, University of Birmingham, Birmingham, UK

    Xiaoxuan Liu & Alastair K. Denniston

  12. Birmingham Health Partners Centre for Regulatory Science and Innovation, University of Birmingham, Birmingham, UK

    Xiaoxuan Liu & Alastair K. Denniston

  13. NIHR Birmingham Biomedical Research Centre, University of Birmingham, Birmingham, UK

    Alastair K. Denniston

  14. Health Data Research, London, UK

    Alastair K. Denniston

  15. Nuffield Department of Surgical Sciences, University of Oxford, Oxford, UK

    Baptiste Vasey & Peter McCulloch

  16. Department of Surgery, Geneva University Hospital, Geneva, Switzerland

    Baptiste Vasey

  17. Kleijnen Systematic Reviews Ltd, Escrick, York, UK

    Robert F. Wolff

  18. Centre for Medical Imaging, University College London, London, UK

    Sue Mallett

  19. Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, CA, USA

    John Mongan

  20. Center for Intelligent Imaging, University of California San Francisco, San Francisco, CA, USA

    John Mongan

  21. Department of Radiology and Institute for Biomedical Informatics, University of Pennsylvania, Philadelphia, PA, USA

    Charles E. Kahn Jr

  22. Institute of Global Health Innovation, Imperial College London, London, UK

    Viknesh Sounderajah & Ara Darzi

  23. Minneapolis VAMC, Urology Section and University of Minnesota, Department of Urology, Minneapolis, MN, USA

    Philipp Dahm

  24. Julius Center for Health Sciences and Primary Care, UMC Utrecht, Utrecht University, Utrecht, The Netherlands

    Karel G. M. Moons

  25. Scripps Research Translational Institute, Scripps Research, La Jolla, CA, USA

    Eric Topol

  26. Centre for Statistics in Medicine, Nuffield Department of Orthopaedics, Rheumatology & Musculoskeletal Sciences, University of Oxford, Oxford, UK

    Gary S. Collins

  27. Centre for Journalology, Clinical Epidemiology Program, Ottawa Hospital Research Institute, Ottawa, Canada

    David Moher

Authors
  1. Giovanni E. Cacciamani
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Timothy N. Chu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Daniel I. Sanford
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Andre Abreu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Vinay Duddalwar
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Assad Oberai
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. C.-C. Jay Kuo
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Xiaoxuan Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Alastair K. Denniston
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Baptiste Vasey
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Peter McCulloch
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Robert F. Wolff
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Sue Mallett
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. John Mongan
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Charles E. Kahn Jr
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Viknesh Sounderajah
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Ara Darzi
    View author publications

    You can also search for this author in PubMed Google Scholar

  18. Philipp Dahm
    View author publications

    You can also search for this author in PubMed Google Scholar

  19. Karel G. M. Moons
    View author publications

    You can also search for this author in PubMed Google Scholar

  20. Eric Topol
    View author publications

    You can also search for this author in PubMed Google Scholar

  21. Gary S. Collins
    View author publications

    You can also search for this author in PubMed Google Scholar

  22. David Moher
    View author publications

    You can also search for this author in PubMed Google Scholar

  23. Inderbir S. Gill
    View author publications

    You can also search for this author in PubMed Google Scholar

  24. Andrew J. Hung
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Giovanni E. Cacciamani.

Ethics declarations

Competing interests

P.D. serves as coordinating editor of Cochrane Urology. G.S.C. is the director of the UK EQUATOR Centre. D.M. is the director of the Canadian EQUATOR Centre. X.L. is an industry fellow (observer) with Hardian Health. A.J.H. is a consultant for Intuitive. I.S.G. is a consultant for STEBA. J.M. is a consultant for Siemens. C.E.K. receives salary support as editor of Radiology: Artificial Intelligence. V.D. is a consultant for Radmetrix Inc. and Westat Inc., and is an advisory board member to Deeptek Inc. A.K.D. is chair of the Health Security initiative at Flagship Pioneering UK Ltd. The other authors declare no competing interests.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Cacciamani, G.E., Chu, T.N., Sanford, D.I. et al. PRISMA AI reporting guidelines for systematic reviews and meta-analyses on AI in healthcare. Nat Med 29, 14–15 (2023). https://doi.org/10.1038/s41591-022-02139-w

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41591-022-02139-w

This article is cited by

Search

Advanced search

Quick links

Nature Briefing: Translational Research

Sign up for the Nature Briefing: Translational Research newsletter — top stories in biotechnology, drug discovery and pharma.

Get what matters in translational research, free to your inbox weekly. Sign up for Nature Briefing: Translational Research