Article | Published:

Machine learning of neural representations of suicide and emotion concepts identifies suicidal youth

Nature Human Behaviourvolume 1pages911919 (2017) | Download Citation


The clinical assessment of suicidal risk would be substantially complemented by a biologically based measure that assesses alterations in the neural representations of concepts related to death and life in people who engage in suicidal ideation. This study used machine-learning algorithms (Gaussian Naive Bayes) to identify such individuals (17 suicidal ideators versus 17 controls) with high (91%) accuracy, based on their altered functional magnetic resonance imaging neural signatures of death-related and life-related concepts. The most discriminating concepts were ‘death’, ‘cruelty’, ‘trouble’, ‘carefree’, ‘good’ and ‘praise’. A similar classification accurately (94%) discriminated nine suicidal ideators who had made a suicide attempt from eight who had not. Moreover, a major facet of the concept alterations was the evoked emotion, whose neural signature served as an alternative basis for accurate (85%) group classification. This study establishes a biological, neurocognitive basis for altered concept representations in participants with suicidal ideation, which enables highly accurate group membership classification.

Additional access options:

Already a subscriber?  Log in  now or  Register  for online access.

Additional information

Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.


  1. 1.

    WISQARS Data (CDC, 2016);

  2. 2.

    Glenn, C. R. & Nock, M. K. Improving the short-term prediction of suicidal behavior. Am. J. Prev. Med. 47, S176–S180 (2014).

  3. 3.

    Nock, M. K. et al. Measuring the suicidal mind: implicit cognition predicts suicidal behavior. Psychol. Sci. 21, 511–517 (2010).

  4. 4.

    Busch, K. A., Fawcett, J. & Jacobs, D. G. Clinical correlates of inpatient suicide. J. Clin. Psychiatry 64, 14–19 (2003).

  5. 5.

    Mann, J. J. et al. Candidate endophenotypes for genetic studies of suicidal behavior. Biol. Psychiatry 65, 556–563 (2009).

  6. 6.

    Ribeiro, J. D. et al. Self-injurious thoughts and behaviors as risk factors for future suicide ideation, attempts, and death: a meta-analysis of longitudinal studies. Psychol. Med. 46, 225–236 (2016).

  7. 7.

    Just, M. A., Cherkassky, V. L., Aryal, S. & Mitchell, T. M. A neurosemantic theory of concrete noun representation based on the underlying brain codes. PLoS ONE 5, e8622 (2010).

  8. 8.

    Kassam, K. S., Markey, A. R., Cherkassky, V. L., Loewenstein, G. & Just, M. A. Identifying emotions on the basis of neural activation. PLoS ONE 8, e66032 (2013).

  9. 9.

    Mitchell, T. M. et al. Predicting human brain activity associated with the meanings of nouns. Science 320, 1191–1195 (2008).

  10. 10.

    Just, M. A., Cherkassky, V. L., Buchweitz, A., Keller, T. A. & Mitchell, T. M. Identifying autism from neural representations of social interactions: neurocognitive markers of autism. PLoS ONE 9, e113879 (2014).

  11. 11.

    Cha, C. B., Najmi, S., Park, J. M., Finn, C. T. & Nock, M. K. Attentional bias toward suicide-related stimuli predicts suicidal behavior. J. Abnorm. Psychol. 119,616–622 (2010).

  12. 12.

    Armey, M. F., Crowther, J. H. & Miller, I. W. Changes in ecological momentary assessment reported affect associated with episodes of nonsuicidal self-injury. Behav. Ther. 42, 579–588 (2011).

  13. 13.

    Bresin, K., Carter, D. L. & Gordon, K. H. The relationship between trait impulsivity, negative affective states, and urge for nonsuicidal self-injury: a daily diary study. Psychiatry Res. 205, 227–231 (2013).

  14. 14.

    Bryan, C. J., Morrow, C. E., Etienne, N. & Ray-Sannerud, B. Guilt, shame, and suicidal ideation in a military outpatient clinical sample. Depress. Anxiety 30,55–60 (2013).

  15. 15.

    Bryan, C. J., Ray-Sannerud, B., Morrow, C. E. & Etienne, N. Shame, pride, and suicidal ideation in a military clinical sample. J. Affect. Disord. 147, 212–216 (2013).

  16. 16.

    Humber, N., Emsley, R., Pratt, D. & Tarrier, N. Anger as a predictor of psychological distress and self-harm ideation in inmates: a structured self-assessment diary study. Psychiatry Res. 210, 166–173 (2013).

  17. 17.

    Nock, M. K., Prinstein, M. J. & Sterba, S. K. Revealing the form and function of self-injurious thoughts and behaviors: a real-time ecological assessment study among adolescents and young adults. J. Abnorm. Psychol. 118, 816–827 (2009).

  18. 18.

    Olié, E. et al. Processing of decision-making and social threat in patients with history of suicidal attempt: a neuroimaging replication study. Psychiatry Res. 234,369–377 (2015).

  19. 19.

    Dukart, J., Schroeter, M. L. & Mueller, K. Age correction in dementia — matching to a healthy brain. PLoS ONE 6, e22193 (2011).

  20. 20.

    Koikkalainen, J. et al. Improved classification of Alzheimer’s disease data via removal of nuisance variability. PLoS ONE 7, e31112 (2012).

  21. 21.

    Jacobson, C., Batejan, K., Kleinman, M. & Gould, M. Reasons for attempting suicide among a community sample of adolescents. Suicide Life Threat. Behav. 43,646–662 (2013).

  22. 22.

    Rogers, M. L., Kelliher-Rabon, J., Hagan, C. R., Hirsch, J. K. & Joiner, T. E. Negative emotions in veterans relate to suicide risk through feelings of perceived burdensomeness and thwarted belongingness. J. Affect. Disord. 208, 15–21 (2017).

  23. 23.

    Pestian, J., Matykiewicz, P. & Linn-Gust, M. What’s in a note: construction of a suicide note corpus. Biomed. Inform. Insights 5, 1–6 (2012).

  24. 24.

    Pan, L. A. et al. Differential patterns of activity and functional connectivity in emotion processing neural circuitry to angry and happy faces in adolescents with and without suicide attempt. Psychol. Med. 43, 2129–2142 (2013).

  25. 25.

    Beck, A. T. & Haigh, E. A. P. Advances in cognitive theory and therapy: the generic cognitive model. Annu. Rev. Clin. Psychol. 10, 1–24 (2014).

  26. 26.

    Adler, A. et al. A mixed methods approach to identify cognitive warning signs for suicide attempts. Arch. Suicide Res. 20, 528–538 (2016).

  27. 27.

    Jager-Hyman, S. et al. Cognitive distortions and suicide attempts. Cognit. Ther. Res. 38, 369–374 (2014).

  28. 28.

    Brown, G. K., Steer, R. A., Henriques, G. R. & Beck, A. T. The internal struggle between the wish to die and the wish to live: a risk factor for suicide. Am. J. Psychiatry 162, 1977–1979 (2005).

  29. 29.

    Bakhiyi, C. L., Calati, R., Guillaume, S. & Courtet, P. Do reasons for living protect against suicidal thoughts and behaviors? A systematic review of the literature. J. Psychiatr. Res. 77, 92–108 (2016).

  30. 30.

    Jollant, F. et al. Orbitofrontal cortex response to angry faces in men with histories of suicide attempts. Am. J. Psychiatry 165, 740–748 (2008).

  31. 31.

    Mann, J. J., Waternaux, C., Haas, G. L. & Malone, K. M. Toward a clinical model of suicidal behavior in psychiatric patients. Am. J. Psychiatry 156, 181–189 (1999).

  32. 32.

    Brent, D. A. et al. Familial pathways to early-onset suicide attempt: a 5.6 year prospective study. JAMA Psychiatry 72, 160–168 (2015).

  33. 33.

    Minzenberg, M. J. & Carter, C. S. Developing treatments for impaired cognition in schizophrenia. Trends Cogn. Sci. 16, 35–42 (2012).

  34. 34.

    Suppes, P., Han, B., Epelboim, J. & Lu, Z.-L. Invariance of brain-wave representations of simple visual images and their names. Proc. Natl Acad. Sci. USA 96, 14658–14663 (1999).

  35. 35.

    Kessler, R. C. et al. Predicting suicides after psychiatric hospitalization in US Army soldiers. JAMA Psychiatry 72, 49–57 (2015).

  36. 36.

    Wechsler, D. Wechsler Abbreviated Scale of Intelligence (Harcourt Assessment, 1999).

  37. 37.

    Beck, A. T., Schuyler, D. & Herman, I. in The Prediction of Suicide (eds Beck, A. T. et al.) 45–56 (Charles Press, Bowie, MD, 1974).

  38. 38.

    Oquendo, M. A., Halberstam, B. & Mann, J. J. in Standardized Evaluation in Clinical Practice (ed. First, M. B.) 103–129 (American Psychiatric Press, Washington DC,  2003).

  39. 39.

    Posner, K. et al. Columbia-Suicide Severity Rating Scale (C-SSRS) (Columbia Univ. Medical Center, New York, NY, 2008).

  40. 40.

    Reynolds, W. M. Professional Manual for the Suicidal Ideation Questionnaire (Psychological Assessment Resources, Odessa, FL, 1987).

  41. 41.

    Achenbach, T. M., Howell, C. T., McConaughy, S. H. & Stanger, C. Six-year predictors of problems in a national sample: IV. Young adult signs of disturbance. J. Am. Acad. Child Adolesc. Psychiatry 37, 718–727 (1998).

  42. 42.

    Achenbach, T. Adult Self Report Measure for Ages 18–59 (Univ. Vermont, Burlington, VT, 2003).

  43. 43.

    Kroenke, K., Spitzer, R. L. & Williams, J. B. W. The PHQ-9: validity of a brief depression severity measure. J. Gen. Intern. Med. 16, 606–613 (2001).

  44. 44.

    Spielberger, C. D. State Trait Anxiety Inventory for Adults: Sampler Set: Manual, Test, Scoring Key;[form Y] (Mind Garden, Menlo Park, CA, 1983).

  45. 45.

    Bernstein, D. P. et al. Initial reliability and validity of a new retrospective measure of child abuse and neglect (CTQ). Am. J. Psychiatry 151, 1132–1136 (1994).

Download references


This research was partially supported by the National Institute of Mental Health Grant MH029617 and an Endowed Chair in Suicide Studies at the University of Pittsburgh School of Medicine. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Author information


  1. Department of Psychology, Carnegie Mellon University, Pittsburgh, PA, USA

    • Marcel Adam Just
    •  & Vladimir L. Cherkassky
  2. Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, PA, USA

    • Lisa Pan
    •  & David Brent
  3. Department of Psychology, Florida International University, Miami, FL, USA

    • Dana L. McMakin
  4. Clinical Psychology Department, Columbia University, New York, NY, USA

    • Christine Cha
  5. Department of Psychology, Harvard University, Cambridge, MA, USA

    • Matthew K. Nock


  1. Search for Marcel Adam Just in:

  2. Search for Lisa Pan in:

  3. Search for Vladimir L. Cherkassky in:

  4. Search for Dana L. McMakin in:

  5. Search for Christine Cha in:

  6. Search for Matthew K. Nock in:

  7. Search for David Brent in:


The experiments were conceived and designed by M.A.J., L.P., V.L.C., D.L.M. and D.B. The experiments were performed by M.A.J., L.P. and D.B. The materials and analysis tools were contributed by M.A.J., V.L.C., C.C. and M.K.N. The data were analysed by V.L.C. The paper was written by M.A.J., V.L.C. and D.B.

Competing interests

The authors declare no competing interests.

Corresponding author

Correspondence to Marcel Adam Just.

Electronic supplementary material

  1. Supplementary Information

    Supplementary Methods, Supplementary Table 1, Supplementary Figures 1–4, Supplementary Notes and Supplementary References

  2. Life Sciences Reporting Summary and MRI Accessory Summary

About this article

Publication history





Rights and permissions

To obtain permission to re-use content from this article visit RightsLink.