Reproducibility and replicability are fundamental requirements of scientific studies. Disagreements over universal definitions for these terms have affected the interpretation of large-scale replication attempts. We provide a visual tool for representing definitions and use it to re-examine these attempts.
This is a preview of subscription content, access via your institution
Relevant articles
Open Access articles citing this article.
-
Computer-aided autism diagnosis using visual attention models and eye-tracking: replication and improvement proposal
BMC Medical Informatics and Decision Making Open Access 14 December 2023
-
Orchestrating and sharing large multimodal data for transparent and reproducible research
Nature Communications Open Access 04 October 2021
-
Optimization of cell viability assays to improve replicability and reproducibility of cancer drug sensitivity screens
Scientific Reports Open Access 02 April 2020
Access options
Access Nature and 54 other Nature Portfolio journals
Get Nature+, our best-value online-access subscription
$29.99 / 30 days
cancel any time
Subscribe to this journal
Receive 12 digital issues and online access to articles
$119.00 per year
only $9.92 per issue
Buy this article
- Purchase on Springer Link
- Instant access to full article PDF
Prices may be subject to local taxes which are calculated during checkout
Data and code availability
The scifigure package and its accompanying vignette can be downloaded from https://CRAN.R-project.org/package=scifigure
Change history
29 July 2019
An amendment to this paper has been published and can be accessed via a link at the top of the paper.
References
Fanelli, D. Proc. Natl. Acad. Sci. USA 115, 2628–2631 (2018).
Kenett, R. S. & Shmueli, G. Nat. Methods 12, 699 (2015).
Open Science Collaboration. Science 349, aac4716 (2015).
Peng, R. D. Science 334, 1226–1227 (2011).
Gilbert, D. T., King, G., Pettigrew, S. & Wilson, T. D. Science 351, 1037 (2016).
Heller, R., Bogomolov, M. & Benjamini, Y. Proc. Natl. Acad. Sci. USA 111, 16262–16267 (2014).
Begley, C. G. & Ellis, L. M. Nature 483, 531–533 (2012).
Cramer, P. E. et al. Science 335, 1503–1506 (2012).
Klein, R. A. et al. Adv. Methods Pract. Psychol. Sci. 1, 443–490 (2018).
Baggerly, K. A. & Coombes, K. R. Ann. Appl. Stat. 3, 1309–1334 (2009).
Johnson, R. A. Statistics: Principles and Methods (Wiley, 2009).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing interests.
Supplementary material
Supplementary Information
Supplementary Information.
Rights and permissions
About this article
Cite this article
Patil, P., Peng, R.D. & Leek, J.T. A visual tool for defining reproducibility and replicability. Nat Hum Behav 3, 650–652 (2019). https://doi.org/10.1038/s41562-019-0629-z
Published:
Issue Date:
DOI: https://doi.org/10.1038/s41562-019-0629-z
This article is cited by
-
Computer-aided autism diagnosis using visual attention models and eye-tracking: replication and improvement proposal
BMC Medical Informatics and Decision Making (2023)
-
Abnormal global-brain functional connectivity and its relationship with cognitive deficits in drug-naive first-episode adolescent-onset schizophrenia
Brain Imaging and Behavior (2022)
-
Provenance matters
Nature Geoscience (2021)
-
Orchestrating and sharing large multimodal data for transparent and reproducible research
Nature Communications (2021)
-
Optimization of cell viability assays to improve replicability and reproducibility of cancer drug sensitivity screens
Scientific Reports (2020)
