Skip to main content

Thank you for visiting You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.

Overfitting to ‘predict’ suicidal ideation

The Original Article was published on 30 October 2017

This is a preview of subscription content, access via your institution

Access options

Rent or buy this article

Prices vary by article type



Prices may be subject to local taxes which are calculated during checkout

Data availability

The data used in these analyses can be found at and

Code availability

The code used in these analyses can be found at and the original code shared by ref. 3 can be found at


  1. Fuchs, T. Subjectivity and intersubjectivity in psychiatric diagnosis. Psychopathology 43, 268–274 (2010).

    Article  PubMed  Google Scholar 

  2. Bzdok, D. & Meyer-Lindenberg, A. Machine learning for precision psychiatry: opportunities and challenges. Biol. Psychiatry Cogn. Neurosci. Neuroimaging 3, 223–230 (2018).

    PubMed  Google Scholar 

  3. Just, M. A. et al. Machine learning of neural representations of suicide and emotion concepts identifies suicidal youth. Nat. Hum. Behav. 1, 911–919 (2017).

    Article  PubMed  PubMed Central  Google Scholar 

  4. Flint, C. et al. Systematic misestimation of machine learning performance in neuroimaging studies of depression. Neuropsychopharmacology 46, 1510–1517 (2021).

    Article  PubMed  PubMed Central  Google Scholar 

  5. Cawley, G. C. & Talbot, N. L. C. On over-fitting in model selection and subsequent selection bias in performance evaluation. J. Mach. Learn. Res. 11, 2079–2107 (2010).

    Google Scholar 

  6. Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F. & Baker, C. I. Circular analysis in systems neuroscience: the dangers of double dipping. Nat. Neurosci. 12, 535–540 (2009).

    Article  CAS  PubMed  PubMed Central  Google Scholar 

Download references

Author information

Authors and Affiliations



T.V. and K.P.K. contributed to writing and conceptualization. T.V. wrote the analysis.

Corresponding author

Correspondence to Timothy Verstynen.

Ethics declarations

Competing interests

T.V. works at the same institution as the senior and first author of ref. 3. The authors have no other competing interests.

Additional information

Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Verstynen, T., Kording, K.P. Overfitting to ‘predict’ suicidal ideation. Nat Hum Behav 7, 680–681 (2023).

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI:

This article is cited by


Quick links

Nature Briefing

Sign up for the Nature Briefing newsletter — what matters in science, free to your inbox daily.

Get the most important science stories of the day, free in your inbox. Sign up for Nature Briefing