Correspondence | Published:

Research data

Silver lining to irreproducibility

Nature volume 532, page 177 (14 April 2016) | Download Citation

There is room for improvement in how science is done and reported, but something can often be learned from irreproducible experiments. The situation may not be as dire as some headlines imply.

It is crucial to include caveats when citing analyses of reproducibility. For example, an often-quoted 2015 survey of factors that could improve the reproducibility of scientific results (see go.nature.com/yxwgmb) noted that there was a low response rate to the questionnaire, a qualifier that is not always mentioned.

It is important to recognize that researchers cannot control for an unknown variable. Take a web tool for identifying unwanted 'passenger mutations' that could confound analyses of transgenic mice (T. Vanden Berghe et al. Immunity 43, 200–209; 2015). This tool arose from reports of mouse phenotypes that, unbeknown to researchers, depended on unintended mutations. This is an example of a useful resource that enhances our understanding of underlying biological phenomena and results from experiments that might otherwise be branded as irreproducible.

It is in this context that scientific societies are pushing to increase experimental rigour and reporting transparency. For instance, guidelines from the Federation of American Societies for Experimental Biology (go.nature.com/zdf89b) aim to help scientists to meet the reproducibility requirements of research funded by the US National Institutes of Health.

Author information

Affiliations

  1. Johns Hopkins University School of Medicine, Baltimore, Maryland, USA.

    • Alyssa Ward
  2. University of California, Riverside, USA.

    • Thomas O. Baldwin
  3. University of Arizona, Tucson, USA.

    • Parker B. Antin

Authors

  1. Search for Alyssa Ward in:

  2. Search for Thomas O. Baldwin in:

  3. Search for Parker B. Antin in:

Corresponding author

Correspondence to Alyssa Ward.

About this article

Publication history

Published

DOI

https://doi.org/10.1038/532177d

Further reading

Comments

By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.

Newsletter Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing