Skip to main content

Thank you for visiting You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Scientific rigor and the art of motorcycle maintenance

The reliability of scientific research is under scrutiny. A recently convened working group proposes cultural adjustments to incentivize better research practices.

This is a preview of subscription content

Access options

Buy article

Get time limited or full article access on ReadCube.


All prices are NET prices.


  1. Johnson, G. New truths that only one can see. New York Times 21 January (2014).

    Google Scholar 

  2. Greenwald, A.G. Psychol. Bull. 82, 1–20 (1975).

    Article  Google Scholar 

  3. Sedlmeier, P. & Gigerenzer, G. Psychol. Bull. 105, 309–316 (1989).

    Article  Google Scholar 

  4. Edwards, A.W. Biol. Rev. Camb. Philos. Soc. 61, 295–312 (1986).

    CAS  Article  Google Scholar 

  5. Martinson, B.C., Anderson, M.S. & de Vries, R. Nature 435, 737–738 (2005).

    CAS  Article  Google Scholar 

  6. Timmer, J. Ars Technica (20 April 2007).

    Google Scholar 

  7. Brunner, D., Balci, F. & Ludvig, E.A. Behav. Processes 89, 187–195 (2012).

    Article  Google Scholar 

  8. Ioannidis, J.P. et al. Nat. Genet. 29, 306–309 (2001).

    CAS  Article  Google Scholar 

  9. Hirschhorn, J.N. N. Engl. J. Med. 360, 1699–1701 (2009).

    CAS  Article  Google Scholar 

  10. Pocock, S.J., Hughes, M.D. & Lee, R.J. N. Engl. J. Med. 317, 426–432 (1987).

    CAS  Article  Google Scholar 

  11. Schulz, K.F. et al. Br. Med. J. 340, c332 (2010).

    Article  Google Scholar 

  12. Kilkenny, C. et al. PLoS Biol. 8, e1000412 (2010).

    Article  Google Scholar 

  13. Welch, V. et al. PLoS Med. 9, e1001333 (2012).

    Article  Google Scholar 

  14. von Elm, E. et al. PLoS Med. 4, e296 (2007).

    Article  Google Scholar 

  15. Editorial. Nat. Methods 10, 367 (2013).

  16. Editorial. Nat. Biotechnol. 31, 943 (2013).

  17. Wagenmakers, E.J. & Forstmann, B.U. Cortex 51, 105–106 (2014).

    Article  Google Scholar 

  18. Menalled, L. et al. A Field Guide to Working with Mouse Models of Huntington's Disease (The Jackson Laboratory, 2014).

    Google Scholar 

  19. Button, K.S. et al. Nat. Rev. Neurosci. 14, 365–376 (2013).

    CAS  Article  Google Scholar 

  20. Ioannidis, J.P., Hozo, I. & Djulbegovic, B. J. Clin. Epidemiol. 66, 903–910 (2013).

    Article  Google Scholar 

  21. Liang, F. et al. J. Am. Stat. Assoc. 103, 410–423 (2008).

    CAS  Article  Google Scholar 

  22. Kerr, N.L. Pers. Soc. Psychol. Rev. 2, 196–217 (1998).

    CAS  Article  Google Scholar 

  23. The World Medical Association. J. Am. Med. Assoc. 310, 2191–2194 (2013).

  24. Ioannidis, J.P. Perspect. Psychol. Sci. 7, 645–654 (2012).

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Simon Noble.

Ethics declarations

Competing interests

S.N. and R.B. are employees of CHDI Management, Inc., which provides advisory services to CHDI Foundation and other nonprofit organizations that support Huntington's disease research. D.B. is employed by PsychoGenics, Inc., which conducts research through fee-for-service agreements for CHDI. J.F. and D.L. receive research funding from CHDI. All authors received reimbursement of travel costs for attendance at the working group cited. M.M., W.J.B., G.L., M.L., E.-J.W. and K.T. have now signed consulting agreements with CHDI to work on the independent standing committee cited.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Munafò, M., Noble, S., Browne, W. et al. Scientific rigor and the art of motorcycle maintenance. Nat Biotechnol 32, 871–873 (2014).

Download citation

  • Published:

  • Issue Date:

  • DOI:

Further reading


Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing