Skip to main content

Thank you for visiting You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.


Is AI leading to a reproducibility crisis in science?

Cartoon of a bottle with a label saying "Artificial Intelligence Cures All".

Illustration by Adrià Voltà

Access options

Rent or buy this article

Prices vary by article type



Prices may be subject to local taxes which are calculated during checkout

Nature 624, 22-25 (2023)



  1. Khan, A. I., Shah, J. L. & Bhat, M. M. Comput. Methods Prog. Biomed. 196, 105581 (2020).

    Article  Google Scholar 

  2. Dhar, S. & Shamir, L. Vis. Inform. 5, 92–101 (2021).

    Article  Google Scholar 

  3. Roberts, M et al. Nature Mach. Intell. 3, 199–217 (2021).

    Article  Google Scholar 

  4. Kapoor, S. & Narayanan, A. Patterns 4, 100804 (2023).

    Article  PubMed  Google Scholar 

  5. Oner, M. U., Cheng, Y.-C., Lee, H.K. & Sung, W.-K. Preprint at medRxiv (2020).

  6. Beede, E. et al. in Proc. 2020 CHI Conf. Human Factors Comput. Syst. (2020).

    Article  Google Scholar 

  7. Chawla, N. V., Bowyer, K. W., Hall, L. O. & Kegelmeyer, W. P. J. Artif. Intell. Res. 16, 321–357 (2002).

    Article  Google Scholar 

  8. Traut, N. et al. NeuroImage 255, 119171 (2022).

    Article  PubMed  Google Scholar 

  9. Kapoor, S. et al. Preprint at (2023).

  10. Heil, B. J. et al. Nature Methods 18, 1132–1135 (2021).

    Article  PubMed  Google Scholar 

  11. Artrith, N. et al. Nature Chem. 13, 505–508 (2021).

    Article  PubMed  Google Scholar 

  12. Raff, E. Preprint at (2019).

  13. Pineau, J. et al. J. Mach. Learn. Res. 22, 7459–7478 (2021).

    Google Scholar 

  14. McKinney, S. M. et al. Nature 577, 89–94 (2020).

    Article  PubMed  Google Scholar 

  15. Haibe-Kains, B. et al. Nature 586, E14–E16 (2020).

    Article  PubMed  Google Scholar 

  16. McKinney, S. M. et al. Nature 586, E17–E18 (2020).

    Article  PubMed  Google Scholar 

  17. Varoquaux, G. & Cheplygina, V. npj Digit. Med. 5, 48 (2022).

    Article  PubMed  Google Scholar 

Download references


Latest on:

Nature Careers


Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing


Quick links