Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • News & Views
  • Published:

HISTORICAL NEWS & VIEWS: REPRODUCIBILITY

Double-dipping revisited

Robust conclusions require rigorous statistics. In 2009 a seminal paper described the dangers and prevalence of double-dipping in neuroscience. Ten years on, I consider progress toward statistical rigor in neuroimaging.

This is a preview of subscription content, access via your institution

Relevant articles

Open Access articles citing this article.

Access options

Buy this article

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: Number of fMRI articles published per year from 1990 to 2018.

References

  1. Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F. & Baker, C. I. Nat. Neurosci. 12, 535–540 (2009).

    Article  CAS  Google Scholar 

  2. Ioannidis, J. P. PLoS Med. 2, e124 (2005).

    Article  Google Scholar 

  3. Poldrack, R. A. et al. Nat. Rev. Neurosci. 18, 115–126 (2017).

    Article  CAS  Google Scholar 

  4. Vul, E., Harris, C., Winkielman, P. & Pashler, H. Perspect. Psychol. Sci. 4, 274–290 (2009).

    Article  Google Scholar 

  5. Bennett, C. M., Miller, M. B. & Wolford, G. L. Neural correlates of interspecies perspective taking in the post-mortem Atlantic Salmon: an argument for multiple comparisons correction. NeuroImage 47, S125 (2009).

    Article  Google Scholar 

  6. Button, K. S. et al. Nat. Rev. Neurosci. 14, 365–376 (2013).

    Article  CAS  Google Scholar 

  7. Thompson, P. M. et al. Alzheimer’s Disease Neuroimaging Initiative, EPIGEN Consortium, IMAGEN Consortium, Saguenay Youth Study (SYS) Group. Brain Imaging Behav. 8, 153–182 (2014).

    PubMed  PubMed Central  Google Scholar 

  8. Biswal, B. B. et al. Proc. Natl. Acad. Sci. USA 107, 4734–4739 (2010).

    Article  CAS  Google Scholar 

  9. Nichols, T. E. et al. Nat. Neurosci. 20, 299–303 (2017).

    Article  CAS  Google Scholar 

  10. Dickersin, K. & Rennie, D. J. Am. Med. Assoc. 290, 516–523 (2003).

    Article  Google Scholar 

  11. Munafò, M. R. et al. Nat. Hum. Behav. 1, 0021 (2017).

    Article  Google Scholar 

  12. Carp, J. Neuroimage 63, 289–300 (2012).

    Article  Google Scholar 

  13. Guo, Q. et al. PLoS One 9, e94412 (2014).

    Article  Google Scholar 

  14. Carp, J. Front. Neurosci. 6, 149 (2012).

    Article  Google Scholar 

  15. Ioannidis, J. P., Tarone, R. & McLaughlin, J. K. Epidemiology 22, 450–456 (2011).

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Katherine S. Button.

Ethics declarations

Competing interests

The author declares no competing interests.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Button, K.S. Double-dipping revisited. Nat Neurosci 22, 688–690 (2019). https://doi.org/10.1038/s41593-019-0398-z

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41593-019-0398-z

This article is cited by

Search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing