The Role of Big Data Analytics in Predicting Suicide

This chapter reviews the long history of using electronic medical records and other types of big data to predict suicide. Although a number of the most recent of these studies used machine learning (ML) methods, these studies were all suboptimal both in the features used as predictors and in the analytic approaches used to develop the prediction models. We review these limitations and describe opportunities for making improvements in future applications. We also review the controversy among clinical experts about using structured suicide risk assessment tools (be they based on ML or older prediction methods) versus in-depth clinical evaluations of needs for treatment planning. Rather than seeing them as competitors, we propose integrating these different approaches to capitalize on their complementary strengths. We also emphasize the distinction between two types of ML analyses: those aimed at predicting which patients are at highest suicide risk, and those aimed at predicting the treatment options that will be best for individual patients. We explain why both are needed to optimize the value of big data ML methods in addressing the suicide problem.

[1]  R. DeRubeis,et al.  Treatment Selection in Depression. , 2018, Annual review of clinical psychology.

[2]  L. Flashman,et al.  Predicting the Risk of Suicide by Analyzing the Text of Clinical Notes , 2014, PloS one.

[3]  Christophe Giraud-Carrier,et al.  Validating Machine Learning Algorithms for Twitter Data Against Established Measures of Suicidality , 2016, JMIR mental health.

[4]  L. Roberts,et al.  A Review of Multidisciplinary Clinical Practice Guidelines in Suicide Prevention: Toward an Emerging Standard in Suicide Risk Assessment and Management, Training and Practice , 2014, Academic Psychiatry.

[5]  W. Leslie,et al.  Predicting suicide with the SAD PERSONS scale , 2017, Depression and anxiety.

[6]  J. Yager,et al.  The American Psychiatric Association Practice Guidelines for the Psychiatric Evaluation of Adults. , 2015, The American journal of psychiatry.

[7]  E. Arensman,et al.  Risk Factors for Repetition of Self-Harm: A Systematic Review of Prospective Hospital-Based Studies , 2014, PloS one.

[8]  D. Owens,et al.  Predictive properties of risk assessment instruments following self-harm , 2017, British Journal of Psychiatry.

[9]  Matthew K Nock,et al.  Improving the short-term prediction of suicidal behavior. , 2014, American journal of preventive medicine.

[10]  R. Gallop,et al.  Dialectical behavior therapy for high suicide risk in individuals with borderline personality disorder: a randomized clinical trial and component analysis. , 2015, JAMA psychiatry.

[11]  Robert Bossarte,et al.  Does Suicidal Ideation as Measured by the PHQ-9 Predict Suicide Among VA Patients? , 2016, Psychiatric services.

[12]  Agneta Pettersson,et al.  Instruments for the assessment of suicide risk: A systematic review evaluating the certainty of the evidence , 2017, PloS one.

[13]  W. M. Patterson,et al.  Evaluation of suicidal patients: the SAD PERSONS scale. , 1983, Psychosomatics.

[14]  J. Barros,et al.  Suicide detection in Chile: proposing a predictive model for suicide risk in a clinical sample of patients with mood disorders , 2016, Revista brasileira de psiquiatria.

[15]  D. Lindqvist,et al.  Suicidal intent and psychiatric symptoms among inpatient suicide attempters , 2007, Nordic journal of psychiatry.

[16]  R. El-Mallakh,et al.  Pharmacogenomics in Psychiatric Practice. , 2016, Clinics in laboratory medicine.

[17]  J. Pirkis,et al.  Accuracy of Clinician Predictions of Future Self‐Harm: A Systematic Review and Meta‐Analysis of Predictive Studies , 2019, Suicide & life-threatening behavior.

[18]  A. House,et al.  Are hospital services for self-harm getting better? An observational study examining management, service provision and temporal trends in England , 2013, BMJ Open.

[19]  L. Diep,et al.  The suicide assessment scale: Psychometric properties of a Norwegian language version , 2012, BMC Research Notes.

[20]  M. Large,et al.  Suicide risk assessment among psychiatric inpatients: a systematic review and meta-analysis of high-risk categories , 2017, Psychological Medicine.

[21]  J. Sareen,et al.  Population‐based analysis of health care contacts among suicide decedents: identifying opportunities for more targeted suicide prevention strategies , 2016, World psychiatry : official journal of the World Psychiatric Association.

[22]  M. Åsberg,et al.  Combining the Suicide Intent Scale and the Karolinska Interpersonal Violence Scale in suicide risk assessments , 2015, BMC Psychiatry.

[23]  Wei Luo,et al.  Risk stratification using data from electronic medical records better predicts suicide risks than clinician assessments , 2014, BMC Psychiatry.

[24]  M. Large,et al.  Meta‐analysis of suicide rates among psychiatric in‐patients , 2015, Acta psychiatrica Scandinavica.

[25]  M. Nordentoft,et al.  Environmental Research and Public Health Risk Estimates and Risk Factors Related to Psychiatric Inpatient Suicide—an Overview , 2022 .

[26]  M. Just,et al.  Machine learning of neural representations of suicide and emotion concepts identifies suicidal youth , 2017, Nature Human Behaviour.

[27]  Kai Kaspar,et al.  Disclosure of sensitive behaviors across self-administered survey modes: a meta-analysis , 2014, Behavior Research Methods.

[28]  Matthew K Nock,et al.  Predicting Suicidal Behavior From Longitudinal Electronic Health Records. , 2017, The American journal of psychiatry.

[29]  Kenric W. Hammond,et al.  Text Mining the EMR for Modeling and Predicting Suicidal Behavior among US Veterans of the 1991 Persian Gulf War , 2015, 2015 48th Hawaii International Conference on System Sciences.

[30]  K. Yun,et al.  Classification of Suicide Attempts through a Machine Learning Algorithm Based on Multiple Systemic Psychiatric Scales , 2017, Front. Psychiatry.

[31]  Soo Beom Choi,et al.  Ten-year prediction of suicide death using Cox regression and machine learning in a nationwide retrospective cohort study in South Korea. , 2018, Journal of affective disorders.

[32]  S. Sharkey,et al.  Needs and fears of young people presenting at accident and emergency department following an act of self-harm: secondary analysis of qualitative data , 2016, British Journal of Psychiatry.

[33]  R. DiClemente,et al.  Application of Audio Computer-Assisted Self-Interviews to Collect Self-Reported Health Data: An Overview , 2013, Caries Research.

[34]  K. Hawton,et al.  Attitudes towards clinical services among people who self-harm: systematic review. , 2009, The British journal of psychiatry : the journal of mental science.

[35]  G. Simon,et al.  Does response on the PHQ-9 Depression Questionnaire predict subsequent suicide attempt or suicide death? , 2013, Psychiatric services.

[36]  D. Gunnell,et al.  Which are the most useful scales for predicting repeat self-harm? A systematic review evaluating risk scales using measures of diagnostic accuracy , 2016, BMJ Open.

[37]  J. Bolton SUICIDE RISK ASSESSMENT IN THE EMERGENCY DEPARTMENT: OUT OF THE DARKNESS , 2015, Depression and anxiety.

[38]  Evan M. Kleiman,et al.  Risk Factors for Suicidal Thoughts and Behaviors: A Meta-Analysis of 50 Years of Research , 2017, Psychological bulletin.

[39]  D. Gustafson,et al.  A computer interview for suicide-risk prediction. , 1973, The American journal of psychiatry.

[40]  R. Weaver,et al.  Quantifying the relationship between social capital and economic conditions in Appalachia , 2018 .

[41]  M. Rudd,et al.  Core Competencies, Warning Signs, and a Framework for Suicide Risk Assessment in Clinical Practice , 2014 .

[42]  J. Mundt,et al.  Predictive Value of Baseline Electronic Columbia-Suicide Severity Rating Scale (eC-SSRS) Assessments for Identifying Risk of Prospective Reports of Suicidal Behavior During Research Participation. , 2014, Innovations in clinical neuroscience.

[43]  Christine Stewart,et al.  Health Care Contacts in the Year Before Suicide Death , 2014, Journal of General Internal Medicine.

[44]  D. Gunnell,et al.  Hospital Presenting Self-Harm and Risk of Fatal and Non-Fatal Repetition: Systematic Review and Meta-Analysis , 2014, PloS one.

[45]  N. Kreitman,et al.  The Construction and Selection of Predictive Scales, with Special Reference to Parasuicide , 1991, British Journal of Psychiatry.

[46]  M. Olfson,et al.  Focusing suicide prevention on periods of high risk. , 2014, JAMA.

[47]  L. Appleby,et al.  Primary care contact prior to suicide in individuals with mental illness. , 2009, The British journal of general practice : the journal of the Royal College of General Practitioners.

[48]  M. Large,et al.  Can we usefully stratify patients according to suicide risk? , 2017, British Medical Journal.

[49]  A. Rosen Detection of suicidal patients: an example of some limitations in the prediction of infrequent events. , 1954, Journal of consulting psychology.

[50]  Arshya Vahabzadeh,et al.  Digital Suicide Prevention: Can Technology Become a Game-changer? , 2016, Innovations in clinical neuroscience.

[51]  J. Pirkis,et al.  The Repeated Episodes of Self-Harm (RESH) score: A tool for predicting risk of future episodes of self-harm by hospital patients. , 2014, Journal of affective disorders.

[52]  Katherine J Hoggatt,et al.  Exploratory data mining analysis identifying subgroups of patients with depression who are at high risk for suicide. , 2009, The Journal of clinical psychiatry.

[53]  B. Mwangi,et al.  Identifying a clinical signature of suicidality among patients with mood disorders: A pilot study using a machine learning approach. , 2016, Journal of affective disorders.

[54]  M. Nock,et al.  Assessment of self-harm risk using implicit thoughts. , 2013, Psychological assessment.

[55]  R. Kessler,et al.  Predicting suicides after psychiatric hospitalization in US Army soldiers: the Army Study To Assess Risk and rEsilience in Servicemembers (Army STARRS). , 2015, JAMA psychiatry.

[56]  I. Katz,et al.  Predictive Modeling and Concentration of the Risk of Suicide: Implications for Preventive Interventions in the US Department of Veterans Affairs. , 2015, American journal of public health.

[57]  Jitender Sareen,et al.  The prevalence rates of suicide are likely underestimated worldwide: why it matters , 2015, Social Psychiatry and Psychiatric Epidemiology.

[58]  Jeremy W Coid,et al.  The futility of risk prediction in psychiatry. , 2016, The British journal of psychiatry : the journal of mental science.

[59]  K. Hawton,et al.  The development of a population-level clinical screening tool for self-harm repetition and suicide: the ReACT Self-Harm Rule , 2012, Psychological Medicine.

[60]  B. Gaynes,et al.  Screening for and Treatment of Suicide Risk Relevant to Primary Care: A Systematic Review for the U.S. Preventive Services Task Force , 2013, Annals of Internal Medicine.

[61]  P. A. Bradley,et al.  Developing a practical suicide risk prediction model for targeting high‐risk patients in the Veterans health Administration , 2017, International journal of methods in psychiatric research.

[62]  J. Mintz,et al.  Brief cognitive-behavioral therapy effects on post-treatment suicide attempts in a military sample: results of a randomized clinical trial with 2-year follow-up. , 2015, The American journal of psychiatry.

[63]  Aaron Klein,et al.  Efficient and Robust Automated Machine Learning , 2015, NIPS.

[64]  Randal S. Olson,et al.  A System for Accessible Artificial Intelligence , 2017, GPTP.

[65]  Haibo He,et al.  Learning from Imbalanced Data , 2009, IEEE Transactions on Knowledge and Data Engineering.

[66]  C. Bryan,et al.  Improving the detection and prediction of suicidal behavior among military personnel by measuring suicidal beliefs: an evaluation of the Suicide Cognitions Scale. , 2014, Journal of affective disorders.

[67]  S. Levine,et al.  Assessment of suicide risk by computer‐delivered self‐rating questionnaire: preliminary findings , 1989, Acta psychiatrica Scandinavica.

[68]  Louis-Philippe Morency,et al.  A Machine Learning Approach to Identifying the Thought Markers of Suicidal Subjects: A Prospective Multicenter Trial , 2017, Suicide & life-threatening behavior.

[69]  D. Boduszek,et al.  Differentiating suicide attempters from suicide ideators using the Integrated Motivational-Volitional model of suicidal behaviour. , 2015, Journal of affective disorders.

[70]  G. Murphy Clinical identification of suicidal risk. , 1972, Archives of general psychiatry.

[71]  Thai Binh Nguyen,et al.  Classification of suicide attempters in schizophrenia using sociocultural and clinical features: A machine learning approach. , 2017, General hospital psychiatry.

[72]  D. Jobes,et al.  Psychological Approaches to Suicide Treatment and Prevention , 2015, Current Treatment Options in Psychiatry.

[73]  D. Gunnell,et al.  Suicide risk assessment and intervention in people with mental illness , 2015, BMJ : British Medical Journal.

[74]  Kevin Mackway-Jones,et al.  A clinical tool for assessing risk after self-harm. , 2006, Annals of emergency medicine.

[75]  Shaun Treweek,et al.  Making trials matter: pragmatic and explanatory trials and the problem of applicability , 2009, Trials.

[76]  Jane Pirkis,et al.  Predicting suicidal behaviours using clinical instruments: Systematic review and meta-analysis of positive predictive values for risk scales , 2017, British Journal of Psychiatry.

[77]  T. McCoy,et al.  Improving Prediction of Suicide and Accidental Death After Discharge From General Hospitals With Natural Language Processing. , 2016, JAMA psychiatry.

[78]  N. Kapur,et al.  Service user perspectives on psychosocial assessment following self-harm and its impact on further help-seeking: a qualitative study. , 2013, Journal of affective disorders.

[79]  M. Silverman,et al.  Suicide risk assessment and risk formulation part II: Suicide risk formulation and the determination of levels of risk. , 2014, Suicide & life-threatening behavior.

[80]  Kezia Lange,et al.  Predictive accuracy of risk scales following self-harm: multicentre, prospective cohort study† , 2017, British Journal of Psychiatry.

[81]  P. Sparén,et al.  Suicide and hospitalization for mental disorders in Sweden: a population-based case-control study. , 2010, Journal of psychiatric research.

[82]  Ben Y. Reis,et al.  Predicting suicides after outpatient mental health visits in the Army Study to Assess Risk and Resilience in Servicemembers (Army STARRS) , 2016, Molecular Psychiatry.

[83]  C. Ottosson,et al.  Deliberate self-harm patients in the emergency department: who will repeat and who will not? Validation and development of clinical decision rules , 2012, Emergency Medicine Journal.

[84]  D. Gunnell,et al.  Scales for predicting risk following self-harm: an observational study in 32 hospitals in England , 2014, BMJ Open.

[85]  B. Löwe,et al.  Predicting suicidal ideation in primary care: An approach to identify easily assessable key variables. , 2018, General hospital psychiatry.

[86]  Barbara Stanley,et al.  The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. , 2011, The American journal of psychiatry.

[87]  S. Wilkinson,et al.  KETAMINE: A POTENTIAL RAPID‐ACTING ANTISUICIDAL AGENT? , 2016, Depression and anxiety.

[88]  E. Severance,et al.  The association between immune markers and recent suicide attempts in patients with serious mental illness: A pilot study , 2017, Psychiatry Research.

[89]  M. Large,et al.  Suicide Rates After Discharge From Psychiatric Facilities: A Systematic Review and Meta-analysis , 2017, JAMA psychiatry.

[90]  Stijn Vansteelandt,et al.  Bias-Reduced Doubly Robust Estimation , 2015 .

[91]  T. Joiner,et al.  Do Undiagnosed Suicide Decedents Have Symptoms of a Mental Disorder? , 2017, Journal of clinical psychology.

[92]  Mark J van der Laan,et al.  Optimal Individualized Treatments in Resource-Limited Settings , 2016, The international journal of biostatistics.

[93]  J. Pearson,et al.  Contact with mental health and primary care providers before suicide: a review of the evidence. , 2002, The American journal of psychiatry.

[94]  Enrique Baca-García,et al.  Novel Use of Natural Language Processing (NLP) to Predict Suicidal Ideation and Psychiatric Symptoms in a Text-Based Mental Health Intervention in Madrid , 2016, Comput. Math. Methods Medicine.

[95]  Mahzarin R. Banaji,et al.  Measuring the Suicidal Mind , 2010, Psychological science.

[96]  David C. Atkins,et al.  A Randomized Controlled Trial of the Collaborative Assessment and Management of Suicidality versus Enhanced Care as Usual With Suicidal Soldiers , 2017, Psychiatry.

[97]  R. Kessler The potential of predictive analytics to provide clinical decision support in depression treatment planning , 2018, Current opinion in psychiatry.

[98]  E. Seifritz,et al.  Modelling suicide and unemployment: a longitudinal analysis covering 63 countries, 2000-11. , 2015, The lancet. Psychiatry.

[99]  Colin G. Walsh,et al.  Predicting Risk of Suicide Attempts Over Time Through Machine Learning , 2017 .

[100]  Tim Kendall,et al.  Predicting suicide following self-harm: systematic review of risk factors and risk scales. , 2016, The British journal of psychiatry : the journal of mental science.