Skip to main content

Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

  • COMMENT

Scientists rise up against statistical significance

Valentin Amrhein, Sander Greenland, Blake McShane and more than 800 signatories call for an end to hyped claims and the dismissal of possibly crucial effects.
  1. Valentin Amrhein

    1. Valentin Amrhein is a professor of zoology at the University of Basel, Switzerland.

    View author publications

    You can also search for this author in PubMed  Google Scholar

  2. Sander Greenland

    1. Sander Greenland is a professor of epidemiology and statistics at the University of California, Los Angeles.

    View author publications

    You can also search for this author in PubMed  Google Scholar

  3. Blake McShane

    1. Blake McShane is a statistical methodologist and professor of marketing at Northwestern University in Evanston, Illinois.

    View author publications

    You can also search for this author in PubMed  Google Scholar

Illustration by David Parkins

When was the last time you heard a seminar speaker claim there was ‘no difference’ between two groups because the difference was ‘statistically non-significant’?

Access options

Rent or buy this article

Prices vary by article type

from$1.95

to$39.95

Learn more

Prices may be subject to local taxes which are calculated during checkout

Nature 567, 305-307 (2019)

doi: https://doi.org/10.1038/d41586-019-00857-9

References

  1. Fisher, R. A. Nature 136, 474 (1935).

    Article  Google Scholar 

  2. Schmidt, M. & Rothman, K. J. Int. J. Cardiol. 177, 1089–1090 (2014).

    Article  PubMed  Google Scholar 

  3. Wasserstein, R. L., Schirm, A. & Lazar, N. A. Am. Stat. https://doi.org/10.1080/00031305.2019.1583913 (2019).

    Article  Google Scholar 

  4. Hurlbert, S. H., Levine, R. A. & Utts, J. Am. Stat. https://doi.org/10.1080/00031305.2018.1543616 (2019).

    Article  Google Scholar 

  5. Lehmann, E. L. Testing Statistical Hypotheses 2nd edn 70–71 (Springer, 1986).

    Google Scholar 

  6. Gigerenzer, G. Adv. Meth. Pract. Psychol. Sci. 1, 198–218 (2018).

    Article  Google Scholar 

  7. Greenland, S. Am. J. Epidemiol. 186, 639–645 (2017).

    Article  PubMed  Google Scholar 

  8. McShane, B. B., Gal, D., Gelman, A., Robert, C. & Tackett, J. L. Am. Stat. https://doi.org/10.1080/00031305.2018.1527253 (2019).

    Article  Google Scholar 

  9. Gelman, A. & Loken, E. Am. Sci. 102, 460–465 (2014).

    Article  Google Scholar 

  10. Amrhein, V., Trafimow, D. & Greenland, S. Am. Stat. https://doi.org/10.1080/00031305.2018.1543137 (2019).

    Article  Google Scholar 

Download references

Supplementary Information

  1. Supp info for Amrhein et al Comment_data V2

Subjects

Latest on:

Nature Careers

Jobs

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing

Search

Advanced search

Quick links