Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • NEWS

Could machine learning fuel a reproducibility crisis in science?

‘Data leakage’ threatens the reliability of machine-learning use across disciplines, researchers warn.
  1. Elizabeth Gibney
    View author publications

    You can also search for this author in PubMed  Google Scholar

From biomedicine to political sciences, researchers increasingly use machine learning as a tool to make predictions on the basis of patterns in their data. But the claims in many such studies are likely to be overblown, according to a pair of researchers at Princeton University in New Jersey. They want to sound an alarm about what they call a “brewing reproducibility crisis” in machine-learning-based sciences.

Access options

Rent or buy this article

Prices vary by article type

from$1.95

to$39.95

Learn more

Prices may be subject to local taxes which are calculated during checkout

Nature 608, 250-251 (2022)

doi: https://doi.org/10.1038/d41586-022-02035-w

References

  1. Kapoor, S. & Narayanan, A. Preprint at https://arxiv.org/abs/2207.07048 (2022).

  2. Muchlinski, D., Siroky, D., He, J. & Kocher, M. Political Anal. 24, 87–103 (2016).

    Article  Google Scholar 

  3. Caliskan-Islam, A. et al. In Proc. 24th USENIX Security Symposium 255–270 (USENIX Association, 2015).

  4. Bollen, J., Mao, H. & Zeng, X. J. Comp. Sci. 2, 1–8 (2011).

    Article  Google Scholar 

  5. Liu, X. et al. Lancet Digit. Health 1, e271–e297 (2019).

    Article  PubMed  Google Scholar 

Download references

Subjects

Latest on:

Nature Careers

Jobs

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing

Search

Advanced search

Quick links