Reply | Published:

Empirical evidence for low reproducibility indicates low pre-study odds

Nature Reviews Neuroscience volume 14, page 877 (2013) | Download Citation

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.


All prices are NET prices.


  1. 1.

    et al. Power failure: why small sample size undermines the reliability of neuroscience. Nature Rev. Neurosci. 14, 365–376 (2013).

  2. 2.

    A test is not a test. Nature Rev. Neurosci. (2013).

  3. 3.

    , , , & Medical research: trial unpredictability yields predictable therapy gains. Nature 500, 395–396 (2013).

  4. 4.

    & Drug development: raise standards for preclinical cancer research. Nature 483, 531–533 (2012).

  5. 5.

    , , , & A survey on data reproducibility in cancer research provides insights into our limited ability to translate findings from the laboratory to the clinic. PLoS ONE 8, e63221 (2013).

  6. 6.

    , & Believe it or not: how much can we rely on published data on potential drug targets? Nature Rev. Drug Discov. 10, 712 (2011).

  7. 7.

    & Type S error rates for classical and Bayesian single and multiple comparison procedures. Comput. Stat. 15, 373–390 (2000).

Download references

Author information


  1. School of Experimental Psychology, University of Bristol, BS8 1TU, UK.

    • Katherine S. Button
    • , Claire Mokrysz
    •  & Marcus R. Munafò
  2. School of Social and Community Medicine, University of Bristol, BS8 2BN, UK.

    • Katherine S. Button
  3. Stanford University School of Medicine, California 94305, USA.

    • John P. A. Ioannidis
  4. Department of Psychology, University of Virginia, Charlottesville, Virginia 22903, USA.

    • Brian A. Nosek
  5. Wellcome Trust Centre for Human Genetics, University of Oxford, OX 7BN, UK.

    • Jonathan Flint
  6. School of Physiology and Pharmacology, University of Bristol, BS8 1TD, UK.

    • Emma S. J. Robinson


  1. Search for Katherine S. Button in:

  2. Search for John P. A. Ioannidis in:

  3. Search for Claire Mokrysz in:

  4. Search for Brian A. Nosek in:

  5. Search for Jonathan Flint in:

  6. Search for Emma S. J. Robinson in:

  7. Search for Marcus R. Munafò in:

Competing interests

The authors declare no competing financial interests.

Corresponding author

Correspondence to Marcus R. Munafò.

About this article

Publication history



Further reading

Newsletter Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing