Skip to main content

Thank you for visiting You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Research data

Silver lining to irreproducibility

There is room for improvement in how science is done and reported, but something can often be learned from irreproducible experiments. The situation may not be as dire as some headlines imply.

It is crucial to include caveats when citing analyses of reproducibility. For example, an often-quoted 2015 survey of factors that could improve the reproducibility of scientific results (see noted that there was a low response rate to the questionnaire, a qualifier that is not always mentioned.

It is important to recognize that researchers cannot control for an unknown variable. Take a web tool for identifying unwanted 'passenger mutations' that could confound analyses of transgenic mice (T. Vanden Berghe et al. Immunity 43, 200–209; 2015). This tool arose from reports of mouse phenotypes that, unbeknown to researchers, depended on unintended mutations. This is an example of a useful resource that enhances our understanding of underlying biological phenomena and results from experiments that might otherwise be branded as irreproducible.

It is in this context that scientific societies are pushing to increase experimental rigour and reporting transparency. For instance, guidelines from the Federation of American Societies for Experimental Biology ( aim to help scientists to meet the reproducibility requirements of research funded by the US National Institutes of Health.

Author information



Corresponding author

Correspondence to Alyssa Ward.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Ward, A., Baldwin, T. & Antin, P. Silver lining to irreproducibility. Nature 532, 177 (2016).

Download citation

Further reading


By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate.


Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing