Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Justify your alpha

Nature Human Behaviour volume 2, pages 168–171 (2018)Cite this article

Subjects

In response to recommendations to redefine statistical significance to P ≤ 0.005, we propose that researchers should transparently report and justify all choices they make when designing a study, including the alpha level.

Benjamin et al.1 proposed changing the conventional “statistical significance” threshold (that is, the alpha level) from P ≤ 0.05 to P ≤ 0.005 for all novel claims with relatively low prior odds. They provided two arguments for why lowering the significance threshold would “immediately improve the reproducibility of scientific research”. First, a P value near 0.05 provides weak evidence for the alternative hypothesis. Second, under certain assumptions, an alpha level of 0.05 leads to high false positive report probabilities (FPRPs2; the probability that a significant finding is a false positive).

This is a preview of subscription content, access via your institution

Relevant articles

Open Access articles citing this article.

Access options

Rent or buy this article

Get just this article for as long as you need it

$39.95

Learn more

Prices may be subject to local taxes which are calculated during checkout

Fig. 1: The proportion of studies3 replicated at α = 0.05 (with a bin width of 0.005).

References

  1. Benjamin, D. J. et al. Nat. Hum. Behav. 2, 6–10 (2018).

    Article  Google Scholar 

  2. Wacholder, S., Chanock, S., Garcia-Closas, M., El Ghormli, L. & Rothman, N. J. Natl Cancer Inst. 96, 434–442 (2004).

    Article  PubMed  Google Scholar 

  3. Open Science Collaboration Science 349, aac4716 (2015).

  4. Senn, S. Statistical Issues in Drug Development 2nd edn (John Wiley & Sons, Chichester, 2007).

  5. Mayo, D. Statistical Inference as Severe Testing: How to Get Beyond the Statistics Wars (Cambridge Univ. Press, Cambridge, 2018).

  6. Johnson, V. E., Payne, R. D., Wang, T., Asher, A. & Mandal, S. J. Am. Stat. Assoc. 112, 1–10 (2017).

    Article  CAS  Google Scholar 

  7. Chambers, C. D., Dienes, Z., McIntosh, R. D., Rotshtein, P. & Willmes, K. Cortex 66, A1–A2 (2015).

    Article  PubMed  Google Scholar 

  8. Lyons, L. Preprint at http://arxiv.org/abs/1310.1284 (2013).

  9. Field, S. A., Tyre, A. J., Jonzen, N., Rhodes, J. R. & Possingham, H. P. Ecol. Lett. 7, 669–675 (2004).

    Article  Google Scholar 

  10. Grieve, A. P. Pharm. Stat. 14, 139–150 (2015).

    Article  PubMed  Google Scholar 

  11. Mudge, J. F., Baker, L. F., Edge, C. B. & Houlahan, J. E. PLoS ONE 7, e32734 (2012).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  12. Skipper, J. K., Guenther, A. L. & Nass, G. Am. Sociol. 2, 16–18 (1967).

    Google Scholar 

  13. Neyman, J. & Pearson, E. S. Phil. Trans. R. Soc. Lond. Ser. A 231, 694–706 (1933).

    Article  Google Scholar 

  14. Fisher R. A. Statistical Methods and Scientific Inferences (Hafner, Oxford, 1956).

  15. Casadevall, A. & Fang, F. C. mBio 7, e01902–16 (2016).

    PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

We thank D. Barr, F. Cheung, D. Colquhoun, H. IJzerman, H. Motulsky and R. Morey for helpful discussions while drafting this Comment. D.L. was supported by Nederlandse Organisatie voor Wetenschappelijk Onderzoek 452-17-013. F.G.A. was supported by CONICET. M.A.J.A. was funded by a Biotechnology and Biological Sciences Research Council AFL Fellowship (BB/M013596/1). G.S.C. was supported by the National Institute for Health Research Biomedical Research Centre, Oxford. Z.C. was supported by the Economic and Social Research Council (grant number C106891X). E.S.C. was supported by the European Research Council (ERC-2015-StG-677270). L.D. is supported by the European Research Council (ERC-2014-CoG-647910 KINSHIP). A.-L.v.H. is funded by a Royal Society Dorothy Hodgkin Fellowship (DH150176). M.R.H. was supported by the National Science Foundation under grant SBE SPRF-FR 1714446. J.Lao was supported by the Swiss National Science Foundation grant 100014_156490/1. C.L.d.O. was supported by Conselho Nacional de Desenvolvimento Científico e Tecnológico. A.E.M. was supported by the Economic and Social Research Council of the United Kingdom (grant number ES/K009095/1). J.-J.O.d.X. is supported by an internal grant from the KU Leuven (STG/14/054) and by the Fonds voor Wetenschappelijk Onderzoek (1519916N). S.P. was supported by the European Research Council (FP7/2007–2013; ERC grant agreement no. 324176). G.M.A.L. was funded by Nederlandse Organisatie voor Wetenschappelijk Onderzoek 453-14-016. S.G.S. is supported by a Cancer Research UK Fellowship (C42785/A17965). V.S. was supported by the National Institute for Neurological Disorders and Stroke Intramural Research Program (IRP). M.A.V. was supported by grant 2016-T1/SOC-1395 from Comunidad de Madrid. T.Y. was supported by National Institutes of Health award R01MH109682.

Author information

Author notes

  1. Unaffiliated: michael.ingre@gmail.com

Authors and Affiliations

  1. Human-Technology Interaction, Eindhoven University of Technology, Eindhoven, The Netherlands

    Daniel Lakens

  2. National Scientific and Technical Research Council (CONICET), Buenos Aires, Argentina

    Federico G. Adolfi

  3. Max Planck Institute for Empirical Aesthetics, Frankfurt, Germany

    Federico G. Adolfi

  4. Heymans Institute for Psychological Research, University of Groningen, Groningen, The Netherlands

    Casper J. Albers

  5. College of Education, Psychology and Social Work, Flinders University, Adelaide, South Australia, Australia

    Farid Anvari

  6. Department of Experimental Psychology, University of Oxford, Oxford, UK

    Matthew A. J. Apps & Sam Parsons

  7. Department of Computer Science, Illinois Institute of Technology, Chicago, IL, USA

    Shlomo E. Argamon

  8. Department of Psychology, Nottingham Trent University, Nottingham, UK

    Thom Baguley

  9. Faculty of Linguistics and Literature, Bielefeld University, Bielefeld, Germany

    Raymond B. Becker

  10. Psychology, University of Nevada, Las Vegas, Las Vegas, NV, USA

    Stephen D. Benning

  11. Psychology, University of Wisconsin-Madison, Madison, WI, USA

    Daniel E. Bradford

  12. Psychology, Missouri State University, Springfield, MO, USA

    Erin M. Buchanan

  13. Health, Human Performance, and Recreation, University of Arkansas, Fayetteville, AR, USA

    Aaron R. Caldwell

  14. Department of Development and Regeneration, KU Leuven, Leuven, Belgium

    Ben Van Calster

  15. Department of Medical Statistics and Bioinformatics, Leiden University Medical Center, Leiden, The Netherlands

    Ben Van Calster

  16. Department of Psychology, Linnaeus University, Kalmar, Sweden

    Rickard Carlsson

  17. Department of Human Development and Psychology, Tzu-Chi University, Hualien City, Taiwan

    Sau-Chin Chen

  18. Department of Surgery, University of British Columbia, Victoria, British Columbia, Canada

    Bryan Chung

  19. Department of Psychology, University of Cambridge, Cambridge, UK

    Lincoln J. Colling

  20. Centre for Statistics in Medicine, University of Oxford, Oxford, UK

    Gary S. Collins

  21. Department of Psychology, School of Philosophy, Psychology and Language Sciences, The University of Edinburgh, Edinburgh, UK

    Zander Crook & Andrea E. Martin

  22. School of Psychology, Bangor University, Bangor, UK

    Emily S. Cross

  23. Institute of Neuroscience and Psychology, University of Glasgow, Glasgow, UK

    Emily S. Cross & Lisa DeBruine

  24. Ramsey Decision Theoretics, Washington, DC, USA

    Sameera Daniels

  25. Department of Behavioural Sciences and Learning, Linköping University, Linköping, Sweden

    Henrik Danielsson

  26. College of Social Work, Florida State University, Tallahassee, FL, USA

    Daniel J. Dunleavy

  27. Departments of Psychology and Philosophy, Yale University, New Haven, CT, USA

    Brian D. Earp

  28. Department of English, University of Louisiana at Lafayette, Lafayette, LA, USA

    Michele I. Feist

  29. Department of Psychology, St. Edward’s University, Austin, TX, USA

    Jason D. Ferrell

  30. Department of Psychology, University of Texas at Austin, Austin, TX, USA

    Jason D. Ferrell & Tal Yarkoni

  31. Department of Management, West Virginia University, Morgantown, WV, USA

    James G. Field

  32. Department of Psychology, Rutgers University, New Brunswick, NJ, USA

    Nicholas W. Fox

  33. Department of Political Science, Indiana University Purdue University, Indianapolis, IN, USA

    Amanda Friesen

  34. Booking.com, Amsterdam, The Netherlands

    Caio Gomes

  35. Department of English, American and Romance Studies, RWTH Aachen University, Aachen, Germany

    Monica Gonzalez-Marquez

  36. School of Psychology, Keele University, Keele, UK

    James A. Grange

  37. Centre of Excellence for Statistical Innovation, UCB Celltech, Slough, UK

    Andrew P. Grieve

  38. Translational Neurosurgery, Eberhard Karls University Tübingen, Tübingen, Germany

    Robert Guggenberger

  39. International Centre for Ethics in Sciences and Humanities, Eberhard Karls University Tübingen, Tübingen, Germany

    Robert Guggenberger

  40. Department of Radiology, University of Cambridge, Cambridge, UK

    James Grist

  41. Department of Psychiatry, University of Cambridge, Cambridge, UK

    Anne-Laura van Harmelen

  42. Behavioural Science Institute, Radboud University Nijmegen, Nijmegen, The Netherlands

    Fred Hasselman

  43. Department of Psychology, University of Chester, Chester, UK

    Kevin D. Hochard

  44. Department of Psychology, New York University, New York, NY, USA

    Mark R. Hoffarth

  45. School of Psychology, University of Nottingham, Nottingham, UK

    Nicholas P. Holmes & Christopher R. Madan

  46. Department of Psychology, Education, and Child Studies, Erasmus University Rotterdam, Rotterdam, The Netherlands

    Michael Ingre & Rolf A. Zwaan

  47. Department of Clinical and Experimental Medicine, University of Linköping, Linköping, Sweden

    Peder M. Isager

  48. School of Clinical Sciences, University of Bristol, Bristol, UK

    Hanna K. Isotalus

  49. Occupational Orthopaedics and Research, Sahlgrenska University Hospital, Gothenburg, Sweden

    Christer Johansson

  50. The Faculty of Modern Languages and Literatures, Institute of Linguistics, Psycholinguistics Department, Adam Mickiewicz University, Poznań, Poland

    Konrad Juszczyk

  51. Department of Psychological Sciences, University of Connecticut, Storrs, CT, USA

    David A. Kenny

  52. Center for Stroke Research Berlin, Charité Universitätsmedizin Berlin, Berlin, Germany

    Ahmed A. Khalil

  53. Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany

    Ahmed A. Khalil

  54. Berlin School of Mind and Brain, Humboldt-Universität zu Berlin, Berlin, Germany

    Ahmed A. Khalil

  55. Social Sciences, Adam Mickiewicz University, Poznań, Poland

    Barbara Konat

  56. Department of Psychology, University of Fribourg, Fribourg, Switzerland

    Junpeng Lao

  57. School of Politics and International Relations, University of Kent, Canterbury, UK

    Erik Gahner Larsen

  58. Department of Sociology/ICS, University of Groningen, Groningen, The Netherlands

    Gerine M. A. Lodder

  59. Institute of Psychology, Czech Academy of Sciences, Prague, Czech Republic

    Jiří Lukavský

  60. Pardee RAND Graduate School, RAND Corporation, Arlington, VA, USA

    David Manheim

  61. Psychology and Neuroscience, Baylor University, Waco, TX, USA

    Stephen R. Martin

  62. Max Planck Institute for Psycholinguistics, Nijmegen, The Netherlands

    Andrea E. Martin

  63. Department of Philosophy, Virginia Tech, Blacksburg, VA, USA

    Deborah G. Mayo

  64. Center for the Study of Family Violence and Sexual Assault, Northern Illinois University, DeKalb, IL, USA

    Randy J. McCarthy

  65. School of Mathematics and Statistics, The Open University, Milton Keynes, UK

    Kevin McConway

  66. Skyscanner, Edinburgh, UK

    Colin McFarland

  67. School of Biomedical Engineering and Imaging Sciences, King’s College London, London, UK

    Amanda Q. X. Nio

  68. Stress Research Institute, Stockholm University, Stockholm, Sweden

    Gustav Nilsonne

  69. Department of Clinical Neuroscience, Stockholm, Sweden

    Gustav Nilsonne

  70. Department of Psychology, Stanford University, Stanford, CA, USA

    Gustav Nilsonne

  71. Laboratory of Behavioral Neurobiology, Department of Physiological Sciences, Federal University of Santa Catarina, Florianópolis, Brazil

    Cilene Lino de Oliveira

  72. Department of Kinesiology, KU Leuven, Leuven, Belgium

    Jean-Jacques Orban de Xivry

  73. Department of Psychology, UiT The Arctic University of Norway, Tromsø, Norway

    Gerit Pfuhl

  74. Department of Psychology, DePaul University, Chicago, IL, USA

    Kimberly A. Quinn

  75. Center for Neural Science, New York University, New York, NY, USA

    John J. Sakon

  76. Department of Psychology, Boğaziçi University, Istanbul, Turkey

    S. Adil Saribay

  77. Psychology, University of Cologne, Cologne, Germany

    Iris K. Schneider

  78. Saudi Human Genome Program, King Abdulaziz City for Science and Technology (KACST), Riyadh, Saudi Arabia

    Manojkumar Selvaraju

  79. Integrated Gulf Biosystems, Riyadh, Saudi Arabia

    Manojkumar Selvaraju

  80. Cognitive Psychology Unit, Institute of Psychology, Leiden University, Leiden, The Netherlands

    Zsuzsika Sjoerds

  81. Leiden Institute for Brain and Cognition, Leiden University, Leiden, The Netherlands

    Zsuzsika Sjoerds

  82. Leeds Institute of Health Sciences, University of Leeds, Leeds, UK

    Samuel G. Smith

  83. Institute for Media Studies, KU Leuven, Leuven, Belgium

    Tim Smits

  84. Center for Open Science, Charlottesville, VA, USA

    Jeffrey R. Spies

  85. Department of Engineering and Society, University of Virginia, Charlottesville, VA, USA

    Jeffrey R. Spies

  86. Surgical Neurology Branch, National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA

    Vishnu Sreekumar

  87. Department of Psychology, University of Southern Indiana, Evansville, IN, USA

    Crystal N. Steltenpohl

  88. Life Sciences Communication, University of Wisconsin-Madison, Madison, WI, USA

    Neil Stenhouse

  89. Department of Social Psychology, Institute of Psychology, University of Lausanne, Lausanne, Switzerland

    Wojciech Świątkowski

  90. Departamento de Psicología Básica, Universidad Autónoma de Madrid, Madrid, Spain

    Miguel A. Vadillo

  91. Department of Methodology and Statistics, Tilburg University, Tilburg, The Netherlands

    Marcel A. L. M. Van Assen

  92. Department of Sociology, Utrecht University, Utrecht, The Netherlands

    Marcel A. L. M. Van Assen

  93. School of Psychology, Massey University, Auckland, New Zealand

    Matt N. Williams

  94. Psychology, Saint Louis University, St. Louis, MO, USA

    Samantha E. Williams

  95. Psychology, University of California, Davis, Davis, CA, USA

    Donald R. Williams

  96. Marketing Department, Ghent University, Ghent, Belgium

    Ignazio Ziano

Authors
  1. Daniel Lakens
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Federico G. Adolfi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Casper J. Albers
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Farid Anvari
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Matthew A. J. Apps
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Shlomo E. Argamon
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Thom Baguley
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Raymond B. Becker
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Stephen D. Benning
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Daniel E. Bradford
    View author publications

    You can also search for this author in PubMed Google Scholar

  11. Erin M. Buchanan
    View author publications

    You can also search for this author in PubMed Google Scholar

  12. Aaron R. Caldwell
    View author publications

    You can also search for this author in PubMed Google Scholar

  13. Ben Van Calster
    View author publications

    You can also search for this author in PubMed Google Scholar

  14. Rickard Carlsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  15. Sau-Chin Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  16. Bryan Chung
    View author publications

    You can also search for this author in PubMed Google Scholar

  17. Lincoln J. Colling
    View author publications

    You can also search for this author in PubMed Google Scholar

  18. Gary S. Collins
    View author publications

    You can also search for this author in PubMed Google Scholar

  19. Zander Crook
    View author publications

    You can also search for this author in PubMed Google Scholar

  20. Emily S. Cross
    View author publications

    You can also search for this author in PubMed Google Scholar

  21. Sameera Daniels
    View author publications

    You can also search for this author in PubMed Google Scholar

  22. Henrik Danielsson
    View author publications

    You can also search for this author in PubMed Google Scholar

  23. Lisa DeBruine
    View author publications

    You can also search for this author in PubMed Google Scholar

  24. Daniel J. Dunleavy
    View author publications

    You can also search for this author in PubMed Google Scholar

  25. Brian D. Earp
    View author publications

    You can also search for this author in PubMed Google Scholar

  26. Michele I. Feist
    View author publications

    You can also search for this author in PubMed Google Scholar

  27. Jason D. Ferrell
    View author publications

    You can also search for this author in PubMed Google Scholar

  28. James G. Field
    View author publications

    You can also search for this author in PubMed Google Scholar

  29. Nicholas W. Fox
    View author publications

    You can also search for this author in PubMed Google Scholar

  30. Amanda Friesen
    View author publications

    You can also search for this author in PubMed Google Scholar

  31. Caio Gomes
    View author publications

    You can also search for this author in PubMed Google Scholar

  32. Monica Gonzalez-Marquez
    View author publications

    You can also search for this author in PubMed Google Scholar

  33. James A. Grange
    View author publications

    You can also search for this author in PubMed Google Scholar

  34. Andrew P. Grieve
    View author publications

    You can also search for this author in PubMed Google Scholar

  35. Robert Guggenberger
    View author publications

    You can also search for this author in PubMed Google Scholar

  36. James Grist
    View author publications

    You can also search for this author in PubMed Google Scholar

  37. Anne-Laura van Harmelen
    View author publications

    You can also search for this author in PubMed Google Scholar

  38. Fred Hasselman
    View author publications

    You can also search for this author in PubMed Google Scholar

  39. Kevin D. Hochard
    View author publications

    You can also search for this author in PubMed Google Scholar

  40. Mark R. Hoffarth
    View author publications

    You can also search for this author in PubMed Google Scholar

  41. Nicholas P. Holmes
    View author publications

    You can also search for this author in PubMed Google Scholar

  42. Michael Ingre
    View author publications

    You can also search for this author in PubMed Google Scholar

  43. Peder M. Isager
    View author publications

    You can also search for this author in PubMed Google Scholar

  44. Hanna K. Isotalus
    View author publications

    You can also search for this author in PubMed Google Scholar

  45. Christer Johansson
    View author publications

    You can also search for this author in PubMed Google Scholar

  46. Konrad Juszczyk
    View author publications

    You can also search for this author in PubMed Google Scholar

  47. David A. Kenny
    View author publications

    You can also search for this author in PubMed Google Scholar

  48. Ahmed A. Khalil
    View author publications

    You can also search for this author in PubMed Google Scholar

  49. Barbara Konat
    View author publications

    You can also search for this author in PubMed Google Scholar

  50. Junpeng Lao
    View author publications

    You can also search for this author in PubMed Google Scholar

  51. Erik Gahner Larsen
    View author publications

    You can also search for this author in PubMed Google Scholar

  52. Gerine M. A. Lodder
    View author publications

    You can also search for this author in PubMed Google Scholar

  53. Jiří Lukavský
    View author publications

    You can also search for this author in PubMed Google Scholar

  54. Christopher R. Madan
    View author publications

    You can also search for this author in PubMed Google Scholar

  55. David Manheim
    View author publications

    You can also search for this author in PubMed Google Scholar

  56. Stephen R. Martin
    View author publications

    You can also search for this author in PubMed Google Scholar

  57. Andrea E. Martin
    View author publications

    You can also search for this author in PubMed Google Scholar

  58. Deborah G. Mayo
    View author publications

    You can also search for this author in PubMed Google Scholar

  59. Randy J. McCarthy
    View author publications

    You can also search for this author in PubMed Google Scholar

  60. Kevin McConway
    View author publications

    You can also search for this author in PubMed Google Scholar

  61. Colin McFarland
    View author publications

    You can also search for this author in PubMed Google Scholar

  62. Amanda Q. X. Nio
    View author publications

    You can also search for this author in PubMed Google Scholar

  63. Gustav Nilsonne
    View author publications

    You can also search for this author in PubMed Google Scholar

  64. Cilene Lino de Oliveira
    View author publications

    You can also search for this author in PubMed Google Scholar

  65. Jean-Jacques Orban de Xivry
    View author publications

    You can also search for this author in PubMed Google Scholar

  66. Sam Parsons
    View author publications

    You can also search for this author in PubMed Google Scholar

  67. Gerit Pfuhl
    View author publications

    You can also search for this author in PubMed Google Scholar

  68. Kimberly A. Quinn
    View author publications

    You can also search for this author in PubMed Google Scholar

  69. John J. Sakon
    View author publications

    You can also search for this author in PubMed Google Scholar

  70. S. Adil Saribay
    View author publications

    You can also search for this author in PubMed Google Scholar

  71. Iris K. Schneider
    View author publications

    You can also search for this author in PubMed Google Scholar

  72. Manojkumar Selvaraju
    View author publications

    You can also search for this author in PubMed Google Scholar

  73. Zsuzsika Sjoerds
    View author publications

    You can also search for this author in PubMed Google Scholar

  74. Samuel G. Smith
    View author publications

    You can also search for this author in PubMed Google Scholar

  75. Tim Smits
    View author publications

    You can also search for this author in PubMed Google Scholar

  76. Jeffrey R. Spies
    View author publications

    You can also search for this author in PubMed Google Scholar

  77. Vishnu Sreekumar
    View author publications

    You can also search for this author in PubMed Google Scholar

  78. Crystal N. Steltenpohl
    View author publications

    You can also search for this author in PubMed Google Scholar

  79. Neil Stenhouse
    View author publications

    You can also search for this author in PubMed Google Scholar

  80. Wojciech Świątkowski
    View author publications

    You can also search for this author in PubMed Google Scholar

  81. Miguel A. Vadillo
    View author publications

    You can also search for this author in PubMed Google Scholar

  82. Marcel A. L. M. Van Assen
    View author publications

    You can also search for this author in PubMed Google Scholar

  83. Matt N. Williams
    View author publications

    You can also search for this author in PubMed Google Scholar

  84. Samantha E. Williams
    View author publications

    You can also search for this author in PubMed Google Scholar

  85. Donald R. Williams
    View author publications

    You can also search for this author in PubMed Google Scholar

  86. Tal Yarkoni
    View author publications

    You can also search for this author in PubMed Google Scholar

  87. Ignazio Ziano
    View author publications

    You can also search for this author in PubMed Google Scholar

  88. Rolf A. Zwaan
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

D.L., N.W.F., M.G.-M., J.A.G., N.P.H., A.A.K., S.R.M., V.S., S.D.B. and C.N.S. participated in brainstorming, drafting the Comment and data analysis. C.J.A., S.E.A., T.B., E.M.B., B.V.C., Z.C., G.S.C., S.D., D.J.D., B.D.E., J.D.F., J.G.F., A.-L.v.H., M.I., P.M.I., H.K.I., J.Lao, G.M.A.L., D.M., A.E.M., K.M., A.Q.X.N., G.N., C.L.d.O., J.-J.O.d.X., G.P, K.A.Q., I.K.S., Z.S., S.G.S., J.R.S., M.A.L.M.V.A., M.N.W., D.R.W., T.Y. and R.A.Z. participated in brainstorming and drafting the Comment. F.G.A., R.B.B., M.I.F., F.H. and S.P. participated in drafting the Comment and data analysis. M.A.J.A., D.E.B., S.-C.C., B.C., L.J.C., H.D., L.D., M.R.H., E.G.L., R.J.M., J.J.S., S.A.S., T.S., N.S., W.Ś. and M.A.V. participated in brainstorming. F.A., A.R.C., R.C., E.S.C., A.F, C.G., A.P.G., R.G., J.G., K.D.H, C.J., K.J, D.A.K., B.K., J.Lukavský, C.R.M., D.G.M., C.M., M.S., S.E.W. I.Z. did not participate in drafting the Comment because the points that they would have raised had already been incorporated, or they endorse a sufficiently large part of the contents as if participation had occurred. Except for the first author, authorship order is alphabetical.

Corresponding author

Correspondence to Daniel Lakens.

Ethics declarations

Competing interests

The authors declare no competing interests.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Lakens, D., Adolfi, F.G., Albers, C.J. et al. Justify your alpha. Nat Hum Behav 2, 168–171 (2018). https://doi.org/10.1038/s41562-018-0311-x

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1038/s41562-018-0311-x

This article is cited by

Search

Advanced search

Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing