Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist

Here we present the MI-CLAIM checklist, a tool intended to improve transparent reporting of AI algorithms in medicine.

Access options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

Fig. 1

Code availability

A public Github repository (https://github.com/beaunorgeot/MI-CLAIM) has been set up to coincide with the release of this manuscript, which will allow the community to comment on existing sections and suggest additions.

References

  1. 1.

    Schwartz, W. B. N. Engl. J. Med. 283, 1257–1264 (1970).

    CAS  PubMed  Article  Google Scholar 

  2. 2.

    Shortliffe, E. H., Axline, S. G., Buchanan, B. G., Merigan, T. C. & Cohen, S. N. Comput. Biomed. Res. 6, 544–560 (1973).

    CAS  PubMed  Article  Google Scholar 

  3. 3.

    Shortliffe, E. H. et al. Comput. Biomed. Res. 8, 303–320 (1975).

    CAS  PubMed  Article  Google Scholar 

  4. 4.

    Ching, T. et al. J. R. Soc. Interface 15, (2018).

  5. 5.

    Esteva, A. et al. Nat. Med. 25, 24–29 (2019).

    CAS  PubMed  Article  Google Scholar 

  6. 6.

    Zou, J. et al. Nat. Genet. 51, 12–18 (2019).

    CAS  PubMed  Article  Google Scholar 

  7. 7.

    Henry, K. E., Hager, D. N., Pronovost, P. J. & Saria, S. Sci. Transl. Med. 7, 299ra122 (2015).

    PubMed  Article  Google Scholar 

  8. 8.

    Gulshan, V. et al. J. Am. Med. Assoc. 316, 2402–2410 (2016).

    Article  Google Scholar 

  9. 9.

    Norgeot, B. et al. JAMA Netw. Open 2, e190606 (2019).

    PubMed  PubMed Central  Article  Google Scholar 

  10. 10.

    Rajkomar, A. et al. NPJ Digit Med. 1, 18 (2018).

    PubMed  PubMed Central  Article  Google Scholar 

  11. 11.

    Lipton, Z. C. Queue 16, 31–57 (2018).

    Article  Google Scholar 

  12. 12.

    Topol, E.J. Deep Medicine: How Artificial Intelligence Can Make Healthcare Human Again 1st edn. (Basic Books, 2019).

  13. 13.

    Rivera, S. C. et al. Nat. Med. https://doi.org/10.1038/s41591-020-1037-7 (2020).

  14. 14.

    Liu, X. et al. Nat. Med. https://doi.org/10.1038/s41591-020-1034-x (2020).

  15. 15.

    Moher, D. et al. Br. Med. J. 340, c869 (2010).

    Article  Google Scholar 

  16. 16.

    von Elm, E. et al. Ann. Intern. Med. 147, 573–577 (2007).

    Article  Google Scholar 

  17. 17.

    Schwarz, C. G. et al. N. Engl. J. Med. 381, 1684–1686 (2019).

    PubMed  PubMed Central  Article  Google Scholar 

  18. 18.

    Obermeyer, Z., Powers, B., Vogeli, C. & Mullainathan, S. Science 366, 447–453 (2019).

    CAS  PubMed  Article  Google Scholar 

  19. 19.

    Subbaswamy, A. & Saria, S. Biostatistics 21, 345–352 (2020).

    PubMed  Google Scholar 

  20. 20.

    Poplin, R. et al. Nat Biomed Eng. 2, 158–164 (2018).

    PubMed  Article  Google Scholar 

  21. 21.

    Pan, J., McGuinness, K., Sayrol, E., O’Connor, N. & Giro-i-Nieto, X. arXiv https://ui.adsabs.harvard.edu/abs/2016arXiv160300845P (2016).

  22. 22.

    Lundberg, S. & Lee, S.-I. arXiv https://ui.adsabs.harvard.edu/abs/2017arXiv170507874L (2017).

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Atul J. Butte.

Ethics declarations

Competing interests

I.S.K. is on the scientific advisory boards of Pulse Data and Medaware, both companies involved in predictive analytics. S.S. is a founder of, and holds equity in, Bayesian Health. The results of the study discussed in this publication could affect the value of Bayesian Health. This arrangement has been reviewed and approved by Johns Hopkins University in accordance with its conflict-of-interest policies. S.S. is a member of the scientific advisory board for PatientPing. B.K.B.-J. is a cofounder of Salutary, Inc. B.N. is employed by Anthem. A.J.B. is a cofounder of and consultant to Personalis and NuMedii; consultant to Samsung, Mango Tree Corporation and, in the recent past, 10x Genomics, Helix, Pathway Genomics and Verinata (Illumina); has served on paid advisory panels or boards for Geisinger Health, Regenstrief Institute, Gerson Lehman Group, AlphaSights, Covance, Novartis, Genentech, Merck and Roche; is a shareholder in Personalis and NuMedii; is a minor shareholder in Apple, Facebook, Google, Microsoft, 10x Genomics, Amazon, Biogen, Illumina, Snap, Nuna Health, Royalty Pharma, Sanofi, AstraZeneca, Assay Depot, Vet24seven, Regeneron, Moderna and Sutro, many of which use AI and predictive modeling, and several other non-health-related companies and mutual funds; and has received honoraria and travel reimbursement for invited talks from Genentech, Takeda, Varian, Roche, Pfizer, Merck, Lilly, Mars, Siemens, Optum, Abbott, Celgene, AstraZeneca, AbbVie, Johnson & Johnson, Westat and many academic institutions, state or national agencies, medical or disease specific foundations and associations, and health systems. A.J.B. receives royalty payments through Stanford University for several patents and other disclosures licensed to NuMedii and Personalis. A.J.B. has research funded by the NIH, Northrup Grumman (as the prime on an NIH contract), Genentech, Johnson & Johnson, FDA, US Department of Defense, Robert Wood Johnson Foundation, Leon Lowenstein Foundation, Intervalien Foundation, Priscilla Chan and Mark Zuckerberg, Barbara and Gerson Bakar Foundation and, in the recent past, the March of Dimes, Juvenile Diabetes Research Foundation, California Governor’s Office of Planning and Research, California Institute for Regenerative Medicine, L’Oreal and Progenity.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Norgeot, B., Quer, G., Beaulieu-Jones, B.K. et al. Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist. Nat Med 26, 1320–1324 (2020). https://doi.org/10.1038/s41591-020-1041-y

Download citation

Search

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing