Predicting suicidal behaviours using clinical instruments: Systematic review and meta-analysis of positive predictive values for risk scales

Background Prediction of suicidal behaviour is an aspirational goal for clinicians and policy makers; with patients classified as ‘high risk’ to be preferentially allocated treatment. Clinical usefulness requires an adequate positive predictive value (PPV). Aims To identify studies of predictive instruments and to calculate PPV estimates for suicidal behaviours. Method A systematic review identified studies of predictive instruments. A series of meta-analyses produced pooled estimates of PPV for suicidal behaviours. Results For all scales combined, the pooled PPVs were: suicide 5.5% (95% CI 3.9–7.9%), self-harm 26.3% (95% CI 21.8–31.3%) and self-harm plus suicide 35.9% (95% CI 25.8–47.4%). Subanalyses on self-harm found pooled PPVs of 16.1% (95% CI 11.3–22.3%) for high-quality studies, 32.5% (95% CI 26.1–39.6%) for hospital-treated self-harm and 26.8% (95% CI 19.5–35.6%) for psychiatric in-patients. Conclusions No ‘high-risk’ classification was clinically useful. Prevalence imposes a ceiling on PPV. Treatment should reduce exposure to modifiable risk factors and offer effective interventions for selected subpopulations and unselected clinical populations.

[1]  A. Nordström,et al.  DST non-suppression predicts suicide after attempted suicide , 2007, Psychiatry Research.

[2]  Z. Gutkovich,et al.  Predictive Validity of the Suicide Trigger Scale (STS-3) for Post-Discharge Suicide Attempt in High-Risk Psychiatric Inpatients , 2014, PloS one.

[3]  G. Guyatt,et al.  Interpreting results and drawing conclusions , 2019, Cochrane Handbook for Systematic Reviews of Interventions.

[4]  A. Öjehagen,et al.  Deliberate self‐poisoning: treatment follow‐up of repeaters and nonrepeaters , 1992, Acta psychiatrica Scandinavica.

[5]  B. Carroll,et al.  SUICIDE, NEUROENDOCRINE DYSFUNCTION AND CSF 5-HIAA CONCENTRATIONS IN DEPRESSION , 1981 .

[6]  C. Chew‐Graham,et al.  Randomised controlled trial of brief psychological intervention after deliberate self poisoning. , 2001, BMJ.

[7]  L. Träskman-bendz,et al.  High Suicidal Intent Scores Indicate Future Suicide , 2002 .

[8]  E. Myers Predicting repetition of deliberate self‐harm: A review of the literature in the light of a current study , 1988, Acta psychiatrica Scandinavica.

[9]  B. Carroll The Dexamethasone Suppression Test for Melancholia , 1982, British Journal of Psychiatry.

[10]  M. Goldacre,et al.  Suicide after discharge from psychiatric inpatient care , 1993, The Lancet.

[11]  W. Coryell,et al.  Hyperactivity of the hypothalamic–pituitary–adrenal axis and mortality in major depressive disorder , 2006, Psychiatry Research.

[12]  John Attia,et al.  Moving beyond sensitivity and specificity: using likelihood ratios to help interpret diagnostic tests , 2003 .

[13]  K. Hawton,et al.  The development of a population-level clinical screening tool for self-harm repetition and suicide: the ReACT Self-Harm Rule , 2012, Psychological Medicine.

[14]  C. Rosen,et al.  Predicting High-Risk Behaviors in Veterans With Posttraumatic Stress Disorder , 2005, The Journal of nervous and mental disease.

[15]  T. McGlashan,et al.  Self-harm subscale of the Schedule for Nonadaptive and Adaptive Personality (SNAP): predicting suicide attempts over 8 years of follow-up. , 2011, The Journal of clinical psychiatry.

[16]  R. Bland,et al.  A multivariate study of predictors of repeat parasuicide , 2004, Acta psychiatrica Scandinavica.

[17]  G. Smith,et al.  Predictive validity of the suicide probability scale among adolescents in group home treatment. , 1996, Journal of the American Academy of Child and Adolescent Psychiatry.

[18]  Jamie D. Feusner,et al.  The dexamethasone suppression test as a predictor of suicidal behavior in unipolar depression. , 2004, Journal of affective disorders.

[19]  D H Gustafson,et al.  Suicide risk prediction by computer interview: a prospective study. , 1987, The Journal of clinical psychiatry.

[20]  A. Beck,et al.  An inventory for measuring depression. , 1961, Archives of general psychiatry.

[21]  K. Hawton,et al.  Value of measuring suicidal intent in the assessment of people attending hospital following self-poisoning or self-injury , 2005, British Journal of Psychiatry.

[22]  R. Kotov,et al.  Hopelessness as a predictor of attempted suicide among first admission patients with psychosis: a 10-year cohort study. , 2012, Suicide & life-threatening behavior.

[23]  Wolfgang Viechtbauer,et al.  Conducting Meta-Analyses in R with the metafor Package , 2010 .

[24]  M. Linnoila,et al.  Cerebrospinal fluid monoamine metabolites and suicidal behavior in depressed patients. A 5-year follow-up study. , 1989, Archives of general psychiatry.

[25]  J. Mann,et al.  Increased risk of suicide attempt in mood disorders and TPH1 genotype. , 2009, Journal of affective disorders.

[26]  L. Träskman-bendz,et al.  The Suicide Assessment Scale: an instrument assessing suicide risk of suicide attempters , 2000, European Psychiatry.

[27]  J. Fawcett,et al.  Prognostic models to detect and monitor the near-term risk of suicide: state of the science. , 2014, American journal of preventive medicine.

[28]  S. Freedenthal Assessing the Wish to Die: A 30-Year Review of the Suicide Intent Scale , 2008, Archives of suicide research : official journal of the International Academy for Suicide Research.

[29]  J A Motto,et al.  Development of a clinical instrument to estimate suicide risk. , 1985, The American journal of psychiatry.

[30]  M. Tansella,et al.  Predictive scales for parasuicide repetition. Further results , 1979, Acta psychiatrica Scandinavica.

[31]  D. Gunnell,et al.  Which are the most useful scales for predicting repeat self-harm? A systematic review evaluating risk scales using measures of diagnostic accuracy , 2016, BMJ Open.

[32]  N. Kreitman,et al.  The Construction and Selection of Predictive Scales, with Special Reference to Parasuicide , 1991, British Journal of Psychiatry.

[33]  Kevin Mackway-Jones,et al.  A clinical tool for assessing risk after self-harm. , 2006, Annals of emergency medicine.

[34]  J. Pirkis,et al.  The Repeated Episodes of Self-Harm (RESH) score: A tool for predicting risk of future episodes of self-harm by hospital patients. , 2014, Journal of affective disorders.

[35]  P. Houck,et al.  Role of Intense Affects in Predicting Short-term Risk for Suicidal Behavior: A Prospective Study , 2010, The Journal of nervous and mental disease.

[36]  C. King,et al.  Assessment of psychiatrically hospitalized suicidal adolescents: self-report instruments as predictors of suicidal thoughts and behavior. , 2007, Journal of the American Academy of Child and Adolescent Psychiatry.

[37]  K. Clover,et al.  Can the Edinburgh Risk of Repetition Scale predict repetition of deliberate self-poisoning in an Australian clinical setting? , 2002, Suicide & life-threatening behavior.

[38]  M. Llorente,et al.  The DST and suicide among depressed alcoholic patients. , 1988, The American journal of psychiatry.

[39]  A. Wells,et al.  The prediction of parasuicide repetition in a high-risk group. , 1999, The British journal of clinical psychology.

[40]  W. M. Patterson,et al.  Evaluation of suicidal patients: the SAD PERSONS scale. , 1983, Psychosomatics.

[41]  Glenn A Melvin,et al.  Suicide risk assessment: where are we now? , 2013, The Medical journal of Australia.

[42]  L. Träskman-bendz,et al.  Hopelessness and suicidal behavior. , 1997, Journal of affective disorders.

[43]  A. Beck,et al.  Hopelessness and eventual suicide: a 10-year prospective study of patients hospitalized with suicidal ideation. , 1985, The American journal of psychiatry.

[44]  B. Rowe,et al.  Emergency Department Assessment of Self-Harm Risk Using Psychometric Questionnaires , 2012, Canadian journal of psychiatry. Revue canadienne de psychiatrie.

[45]  M. Tansella,et al.  Cross-Validation of a Predictive Scale for Subsequent Suicidal Behaviour in an Italian Sample , 1976, British Journal of Psychiatry.

[46]  S. Hetrick,et al.  Effective psychological and psychosocial approaches to reduce repetition of self-harm: a systematic review, meta-analysis and meta-regression , 2016, BMJ Open.

[47]  R A Steer,et al.  Relationship between hopelessness and ultimate suicide: a replication with psychiatric outpatients. , 1990, The American journal of psychiatry.

[48]  J. Sareen,et al.  The SAD PERSONS Scale for Suicide Risk Assessment: A Systematic Review , 2014, Archives of suicide research : official journal of the International Academy for Suicide Research.

[49]  A. Mitchell Sensitivity × PPV is a recognized test called the clinical utility index (CUI+) , 2011, European Journal of Epidemiology.

[50]  M. Åsberg,et al.  CSF 5-HIAA predicts suicide risk after attempted suicide. , 1994, Suicide & life-threatening behavior.

[51]  C. Ottosson,et al.  Deliberate self-harm patients in the emergency department: who will repeat and who will not? Validation and development of clinical decision rules , 2012, Emergency Medicine Journal.

[52]  R A Steer,et al.  Risk factors for suicide in psychiatric outpatients: a 20-year prospective study. , 2000, Journal of consulting and clinical psychology.

[53]  A. Nordström,et al.  CSF 5-HIAA and DST non-suppression — Orthogonal biologic risk factors for suicide in male mood disorder inpatients , 2009, Psychiatry Research.

[54]  P. Corcoran,et al.  A preliminary statistical model for identifying repeaters of parasuicide , 1997 .

[55]  A. Rosen Detection of suicidal patients: an example of some limitations in the prediction of infrequent events. , 1954, Journal of consulting psychology.

[56]  D. Buglass,et al.  A Scale for Predicting Subsequent Suicidal Behaviour , 1973, British Journal of Psychiatry.

[57]  M. Åsberg,et al.  5-HIAA in the cerebrospinal fluid. A biochemical suicide predictor? , 1976, Archives of general psychiatry.

[58]  S. Paul,et al.  Reduced CSF concentrations of homovanillic acid and homovanillic acid to 5-hydroxyindoleacetic acid ratios in depressed patients: relationship to suicidal behavior and dexamethasone nonsuppression. , 1986, The American journal of psychiatry.

[59]  M. Nock,et al.  Assessment of self-harm risk using implicit thoughts. , 2013, Psychological assessment.

[60]  J. Sareen,et al.  Predicting suicide attempts with the SAD PERSONS scale: a longitudinal analysis. , 2012, The Journal of clinical psychiatry.

[61]  H. Möller,et al.  Validation of Six Risk Scales for Suicide Attempters , 1988 .

[62]  S. Gilbody,et al.  Detecting and predicting self-harm behaviour in prisoners: a prospective psychometric analysis of three instruments , 2009, Social Psychiatry and Psychiatric Epidemiology.

[63]  J. Donovan,et al.  Hospital admissions for self harm after discharge from psychiatric inpatient care: cohort study , 2008, BMJ : British Medical Journal.

[64]  C. Ottosson,et al.  Can repetition of deliberate self-harm be predicted? A prospective multicenter study validating clinical decision rules. , 2013, Journal of affective disorders.

[65]  A. Araszkiewicz,et al.  Dexamethasone suppression test and suicide attempts in schizophrenic patients , 2001, European Psychiatry.

[66]  A. Erkanli,et al.  Evaluating the predictive validity of suicidal intent and medical lethality in youth. , 2012, Journal of consulting and clinical psychology.

[67]  J. Motto,et al.  An instrument for evaluating suicide potential: a preliminary study. , 1966, The American journal of psychiatry.

[68]  M. Silverman,et al.  Suicide risk assessment and risk formulation part II: Suicide risk formulation and the determination of levels of risk. , 2014, Suicide & life-threatening behavior.

[69]  I. Olkin,et al.  The case of the misleading funnel plot , 2006, BMJ : British Medical Journal.

[70]  K. Saunders,et al.  The sad truth about the SADPERSONS Scale: an evaluation of its clinical utility in self-harm patients , 2013, Emergency Medicine Journal.

[71]  D. Gunnell,et al.  Hospital Presenting Self-Harm and Risk of Fatal and Non-Fatal Repetition: Systematic Review and Meta-Analysis , 2014, PloS one.

[72]  IN Teens,et al.  MANIC-DEPRESSIVE ILLNESS , 1986, The Lancet.

[73]  D. Black,et al.  The Relationship Between DST Results and Suicidal Behavior , 2002, Annals of clinical psychiatry : official journal of the American Academy of Clinical Psychiatrists.

[74]  A. Nordström,et al.  CSF 5‐HIAA, suicide intent and hopelessness in the prediction of early suicide in male high‐risk suicide attempters , 2006, Acta psychiatrica Scandinavica.

[75]  J. Castro-Fornieles,et al.  Predictors of suicide attempt in early-onset, first-episode psychoses: a longitudinal 24-month follow-up study. , 2013, The Journal of clinical psychiatry.

[76]  S. Targum,et al.  The dexamethasone suppression test in suicidal patients with unipolar depression. , 1983, The American journal of psychiatry.

[77]  J. O. Roaldset,et al.  Predictive Validity of the MINI Suicidal Scale for Self-Harm in Acute Psychiatry: A Prospective Study of the First Year after Discharge , 2012, Archives of suicide research : official journal of the International Academy for Suicide Research.

[78]  Susan Mallett,et al.  QUADAS-2: A Revised Tool for the Quality Assessment of Diagnostic Accuracy Studies , 2011, Annals of Internal Medicine.

[79]  A. Beck,et al.  Prediction of eventual suicide in psychiatric inpatients by clinical ratings of hopelessness. , 1989, Journal of consulting and clinical psychology.

[80]  Constantine Gatsonis,et al.  Analysing and Presenting Results , 2010 .

[81]  R A Steer,et al.  Suicide ideation at its worst point: a predictor of eventual suicide in psychiatric outpatients. , 1999, Suicide & life-threatening behavior.

[82]  M. Daigle,et al.  Predictive Validity of the Suicide Probability Scale in a Male Inmate Population , 2010 .

[83]  D. Pallis,et al.  Estimating Suicide Risk Among Attempted Suicides , 1984, British Journal of Psychiatry.

[84]  M. Åsberg,et al.  Skin conductance habituation and cerebrospinal fluid 5-hydroxyindoleacetic acid in suicidal patients. , 1986, Archives of general psychiatry.

[85]  K. Petrie,et al.  Psychological predictors of future suicidal behaviour in hospitalized suicide attempters. , 1988, The British journal of clinical psychology.

[86]  J. Ioannidis,et al.  The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration , 2009, BMJ : British Medical Journal.

[87]  J. Pirkis,et al.  Letters, green cards, telephone calls and postcards: Systematic and meta-analytic review of brief contact interventions for reducing self-harm, suicide attempts and suicide , 2015, British Journal of Psychiatry.

[88]  D. Gunnell,et al.  Psychosocial interventions for self-harm in adults. , 2016, The Cochrane database of systematic reviews.

[89]  J. McCulloch,et al.  Further Suicidal Behaviour: The Development and Validation of Predictive Scales , 1970, British Journal of Psychiatry.

[90]  K. Hawton,et al.  Repetition of attempted suicide: The performance of the Edinburgh predictive scales in patients in Oxford , 1995 .

[91]  Theo Stijnen,et al.  Random effects meta‐analysis of event outcome in the framework of the generalized linear mixed model with applications in sparse data , 2010, Statistics in medicine.

[92]  L. Appleby,et al.  Suicide in mental health in-patients and within 3 months of discharge , 2006, British Journal of Psychiatry.

[93]  Peter Dalgaard,et al.  R Development Core Team (2010): R: A language and environment for statistical computing , 2010 .

[94]  M. Waern,et al.  Does The Suicide Assessment Scale Predict Risk Of Repetition? A Prospective Study Of Suicide Attempters At A Hospital Emergency Department , 2010, European Psychiatry.

[95]  A. Pokorny Prediction of suicide in psychiatric patients. Report of a prospective study. , 1983, Archives of general psychiatry.