Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • COMMENT

Robust research needs many lines of evidence

Replication is not enough. Marcus R. Munafò and George Davey Smith state the case for triangulation.
  1. Marcus R. Munafò

    1. Marcus R. Munafò is programme lead at the Medical Research Council’s Integrative Epidemiology Unit at the University of Bristol, UK.

    View author publications

    You can also search for this author in PubMed  Google Scholar

  2. George Davey Smith

    1. George Davey Smith is director at the Medical Research Council’s Integrative Epidemiology Unit at the University of Bristol, UK.

    View author publications

    You can also search for this author in PubMed  Google Scholar

Several studies across many fields estimate that only around 40% of published findings can be replicated reliably. Various funders and communities are promoting ways for independent teams to routinely replicate the findings of others.

Access options

Rent or buy this article

Prices vary by article type

from$1.95

to$39.95

Learn more

Prices may be subject to local taxes which are calculated during checkout

Nature 553, 399-401 (2018)

doi: https://doi.org/10.1038/d41586-018-01023-3

References

  1. Baell, J. & Walters, M. A. Nature 513, 481–483 (2014).

    Article  PubMed  CAS  Google Scholar 

  2. Munafò, M. R. et al. Nature Hum. Behav. 1, 0021 (2017).

    Article  Google Scholar 

  3. Lawlor, D. A., Tilling, K. & Davey Smith, G. Int. J. Epidemiol. 45, 1866–1886 (2016).

    Article  PubMed  Google Scholar 

  4. Kaelin, W. G. Jr Nature 545, 387 (2017).

    Article  PubMed  CAS  Google Scholar 

  5. Chokshi, D. A., El-Sayed, A. M. & Stine, N. W. J. Am. Med. Assoc. 314, 1339–1340 (2015).

    Article  CAS  Google Scholar 

  6. Krieger, N. & Davey Smith, G. Int. J. Epidemiol. 45, 1787–1808 (2016).

    Article  PubMed  Google Scholar 

  7. Lipton, P. Inference to the Best Explanation 2nd edn (Routledge, 2004).

    Google Scholar 

  8. Rennie, D., Yank, V. & Emanuel, L. J. Am. Med. Assoc. 278, 579–585 (1997).

    Article  CAS  Google Scholar 

  9. Mogil, J. S. & MacLeod, M. R. Nature 542, 409–411 (2017).

    Article  PubMed  CAS  Google Scholar 

Download references

Subjects

Latest on:

Nature Careers

Jobs

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing

Search

Advanced search

Quick links