Subjects

Abstract

Given concerns about the reproducibility of scientific findings, neuroimaging must define best practices for data analysis, results reporting, and algorithm and data sharing to promote transparency, reliability and collaboration. We describe insights from developing a set of recommendations on behalf of the Organization for Human Brain Mapping and identify barriers that impede these practices, including how the discipline must change to fully exploit the potential of the world's neuroimaging data.

Access optionsAccess options

Rent or Buy article

Get time limited or full article access on ReadCube.

from$8.99

All prices are NET prices.

References

  1. 1.

    PLoS Med. 2, e124 (2005).

  2. 2.

    Open Science Collaboration. Science 349, aac4716 (2015).

  3. 3.

    Anonymous. Nature 515, 7 (2014).

  4. 4.

    et al. bioRxiv (2016).

  5. 5.

    Science 334, 1226–1227 (2011).

  6. 6.

    & Cogn. Affect. Behav. Neurosci. 13, 690–702 (2013).

  7. 7.

    et al. Hum. Brain Mapp. 31, 1967–1982 (2010).

  8. 8.

    et al. Neuroimage 277, 88–100 (2017).

  9. 9.

    et al. Cortex 66, 115–133 (2015).

  10. 10.

    , , & Nat. Neurosci. 12, 535–540 (2009).

  11. 11.

    et al. Neuroimage 40, 409–414 (2008).

  12. 12.

    & Neuroimage 82, 671–676 (2013).

  13. 13.

    , , , & J. Neurosci. 34, 10743–10755 (2014).

  14. 14.

    et al. Proceedings of the National Academy of Sciences, 113, 9105–9110 (2016).

  15. 15.

    et al. Neuroimage 119, 164–174 (2015).

  16. 16.

    Science 351, 329 (2016).

  17. 17.

    , , & Neuroimage 82, 683–691 (2013).

  18. 18.

    et al. Sci. Data 3, 160044 (2016).

  19. 19.

    et al. Nat. Genet. 47, 291–295 (2015).

  20. 20.

    , , , & Neuroimage 45, 810–823 (2009).

  21. 21.

    IEEE Internet Comput. 18, 4–8 (2014).

  22. 22.

    et al. Nat. Neurosci. 19, 1175–1187 (2016).

  23. 23.

    et al. Neuroimage 147, 736–745 (2016).

  24. 24.

    ISO. Statistics - Vocabulary and Symbols. Part 2: Applied Statistics. ISO 3534–2 (Second ed.) (ISO, 2006).

Download references

Acknowledgements

T.E.N. is supported by the Wellcome Trust (100309/Z/12/Z) and NIH (R01 NS075066-01A1, R01 EB015611-01). B.T.T.Y. is supported by Singapore MOE Tier 2 (MOE2014-T2-2-016), NUS (DPRT/944/09/14, R185000271720), NMRC (CBRG14nov007) and the NUS YIA. S.B.E. is supported by the Deutsche Forschungsgemeinschaft (DFG, EI 816/4-1, LA 3071/3-1; EI 816/6-1), the National Institute of Mental Health (R01-MH074457), the Helmholtz Portfolio Theme 'Supercomputing and Modeling for the Human Brain' and the European Union Seventh Framework Programme (FP7/2007-2013) under grant agreement no. 604102). M.H. was supported by funds from the German federal state of Saxony-Anhalt and the European Regional Development Fund (ERDF), project: Center for Behavioral Brain Sciences, and CRCNS BMBF/NSF (01GQ1411/1429999). N.K. was supported by the UK Medical Research Council and a European Research Council Starting Grant (261352). A.C.E., S.D. and T.G. are supported by the Irving Ludmer Family Foundation and the Ludmer Centre for Neuroinformatics and Mental Health. T.W. was supported by a ZonMw TOP grant (91211021). R.A.P. is supported by the Laura and John Arnold Foundation. M.P.M. is a Phyllis Green and Randolph Cowen Scholar and is supported in part by the NIH (U01 MH099059; R01 AG047596). J.-B.P. is supported by the NIBIB (P41EB019936) and by NIH–National Institute on Drug Abuse (U24DA038653), as well as by the Laura and John Arnold Foundation.

Author information

Affiliations

  1. University of Warwick, Coventry, UK.

    • Thomas E Nichols
  2. McGill University, Montreal, Canada.

    • Samir Das
    • , Alan C Evans
    •  & Tristan Glatard
  3. Montreal Neurological Institute, Montreal, Canada.

    • Samir Das
    •  & Alan C Evans
  4. Institute of Neuroscience and Medicine (INM-1), Jülich Research Center, Jülich, Germany.

    • Simon B Eickhoff
  5. Institute for Systems Neuroscience, Medical Faculty, Heinrich-Heine University Düsseldorf, Düsseldorf, Germany.

    • Simon B Eickhoff
  6. Department of Computer Science and Software Engineering, Concordia University, Montreal, Canada.

    • Tristan Glatard
  7. Otto-von-Guericke-University, Magdeburg, Germany.

    • Michael Hanke
  8. Center for Behavioral Brain Sciences, Magdeburg, Germany.

    • Michael Hanke
  9. MRC Cognition and Brain Sciences Unit, Cambridge, UK.

    • Nikolaus Kriegeskorte
  10. Child Mind Institute, New York, New York, USA.

    • Michael P Milham
  11. Nathan S. Kline Institute for Psychiatric Research, Orangeburg, New York, USA.

    • Michael P Milham
  12. Stanford University, Stanford, California, USA.

    • Russell A Poldrack
  13. University of California, Berkeley, California, USA.

    • Jean-Baptiste Poline
  14. NEUROingenia Clinical and Research Center, Mexico City, Mexico.

    • Erika Proal
  15. Inria, Paris-Saclay University, Paris, France.

    • Bertrand Thirion
  16. Washington University in St. Louis, St. Louis, Missouri, USA.

    • David C Van Essen
  17. Erasmus University Medical Center, Rotterdam, The Netherlands.

    • Tonya White
  18. National University of Singapore, Singapore.

    • B T Thomas Yeo

Authors

  1. Search for Thomas E Nichols in:

  2. Search for Samir Das in:

  3. Search for Simon B Eickhoff in:

  4. Search for Alan C Evans in:

  5. Search for Tristan Glatard in:

  6. Search for Michael Hanke in:

  7. Search for Nikolaus Kriegeskorte in:

  8. Search for Michael P Milham in:

  9. Search for Russell A Poldrack in:

  10. Search for Jean-Baptiste Poline in:

  11. Search for Erika Proal in:

  12. Search for Bertrand Thirion in:

  13. Search for David C Van Essen in:

  14. Search for Tonya White in:

  15. Search for B T Thomas Yeo in:

Competing interests

The authors declare no competing financial interests.

Corresponding author

Correspondence to Thomas E Nichols.

Supplementary information

PDF files

  1. 1.

    Supplementary Text and Figures

    Supplementary Table 1

About this article

Publication history

Published

DOI

https://doi.org/10.1038/nn.4500

Further reading

Newsletter Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing