Towards Ordinal Suicide Ideation Detection on Social Media

The rising ubiquity of social media presents a platform for individuals to express suicide ideation, instead of traditional, formal clinical settings. While neural methods for assessing suicide risk on social media have shown promise, a crippling limitation of existing solutions is that they ignore the inherent ordinal nature across fine-grain levels of suicide risk. To this end, we reformulate suicide risk assessment as an Ordinal Regression problem, over the Columbia-Suicide Severity Scale. We propose SISMO, a hierarchical attention model optimized to factor in the graded nature of increasing suicide risk levels, through soft probability distribution since not all wrong risk-levels are equally wrong. We establish the face value of SISMO for preliminary suicide risk assessment on real-world Reddit data annotated by clinical experts. We conclude by discussing the empirical, practical, and ethical considerations pertaining to SISMO in a larger picture, as a human-in-the-loop framework

[1]  A. Bruckman.  Studying the amateur artist: A perspective on disguising data collected in human subjects research on the Internet , 2002, Ethics and Information Technology.

[2]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[3]  Xiaohao He,et al.  Latent Suicide Risk Detection on Microblog via Suicide-Oriented Word Embeddings and Layered Attention , 2019, EMNLP.

[4]  Barbara Stanley,et al.  The Columbia-Suicide Severity Rating Scale: initial validity and internal consistency findings from three multisite studies with adolescents and adults. , 2011, The American journal of psychiatry.

[5]  Casey Fiesler,et al.  “Participant” Perceptions of Twitter Research Ethics , 2018 .

[6]  Munmun De Choudhury,et al.  A Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media , 2019, FAT.

[7]  Laura E. Barnes,et al.  Can Text Messages Identify Suicide Risk in Real Time? A Within-Subjects Pilot Examination of Temporally Sensitive Markers of Suicide Risk , 2020, Clinical psychological science : a journal of the Association for Psychological Science.

[8]  Fabio Crestani,et al.  Overview of eRisk 2019 Early Risk Prediction on the Internet , 2019, CLEF.

[9]  Christopher W. Drapeau,et al.  U.S.A. suicide 2016: Official final data , 2017 .

[10]  Eric P. Xing,et al.  Sparse Additive Generative Models of Text , 2011, ICML.

[11]  Mark Dredze,et al.  Ethical Research Protocols for Social Media Health Research , 2017, EthNLP@EACL.

[12]  P S BaumerEric,et al.  Who is the "Human" in Human-Centered Machine Learning , 2019 .

[13]  Mark Dredze,et al.  Discovering Shifts to Suicidal Ideation from Mental Health Content in Social Media , 2016, CHI.

[14]  A. Leenaars,et al.  Suicide Note Classification Using Natural Language Processing: A Content Analysis , 2010, Biomedical informatics insights.

[15]  Dirk Hovy,et al.  The Social Impact of Natural Language Processing , 2016, ACL.

[16]  Ramit Sawhney,et al.  PHASE: Learning Emotional Phase-aware Representations for Suicide Ideation Detection on Social Media , 2021, EACL.

[17]  Amit Marathe,et al.  Soft Labels for Ordinal Regression , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Catherine M McHugh,et al.  Association between suicidal ideation and suicide: meta-analyses of odds ratios, sensitivity, specificity and positive predictive value , 2019, BJPsych Open.

[19]  Kathryn P Linthicum,et al.  Machine learning in suicide science: Applications and ethics. , 2019, Behavioral sciences & the law.

[20]  Holly Hedegaard,et al.  Increase in Suicide Mortality in the United States, 1999-2018. , 2020, NCHS data brief.

[21]  Guodong Long,et al.  Suicidal Ideation Detection: A Review of Machine Learning Methods and Applications , 2019, IEEE Transactions on Computational Social Systems.

[22]  James C. Overholser.  Chapter 3 – Predisposing Factors in Suicide Attempts: Life Stressors , 2003 .

[23]  Swati Aggarwal,et al.  A Computational Approach to Feature Extraction for Identification of Suicidal Ideation in Tweets , 2018, ACL.

[24]  Eibe Frank,et al.  A Simple Approach to Ordinal Classification , 2001, ECML.

[25]  S. Hetrick,et al.  Social media and suicide prevention: a systematic review , 2016, Early intervention in psychiatry.

[26]  R. Bender,et al.  Ordinal Logistic Regression in Medical Research , 1997, Journal of the Royal College of Physicians of London.

[27]  Alex B. Fine,et al.  Natural Language Processing of Social Media as Screening for Suicide Risk , 2018, Biomedical informatics insights.

[28]  John Torous,et al.  An Adjuvant Role for Mobile Health in Psychiatry. , 2016, JAMA psychiatry.

[29]  Stevie Chancellor,et al.  Methods in predictive techniques for mental health status on social media: a critical review , 2020, npj Digital Medicine.

[30]  H. Sueki,et al.  The association of suicide-related Twitter use with suicidal behaviour: a cross-sectional study of young internet users in Japan. , 2015, Journal of affective disorders.

[31]  Ramit Sawhney,et al.  #suicidal - A Multipronged Approach to Identify and Explore Suicidal Ideation in Twitter , 2019, CIKM.

[32]  Douglas W. Oard,et al.  A Prioritization Model for Suicidality Risk Assessment , 2020, ACL.

[33]  G. Coombs,et al.  Ethical dilemmas posed by mobile health and machine learning in psychiatry research , 2020, Bulletin of the World Health Organization.

[34]  Sharath Chandra Guntuku,et al.  Suicide Risk Assessment with Multi-level Dual-Context Language and BERT , 2019, Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology.

[35]  Naoki Masuda,et al.  Suicide Ideation of Individuals in Online Social Networks , 2012, PloS one.

[36]  Arman Cohan,et al.  Longformer: The Long-Document Transformer , 2020, ArXiv.

[37]  Ramit Sawhney,et al.  A Time-Aware Transformer Based Model for Suicide Ideation Detection on Social Media , 2020, EMNLP.

[38]  Ramit Sawhney,et al.  SNAP-BATNET: Cascading Author Profiling and Social Network Graphs for Suicide Ideation Detection on Social Media , 2019, NAACL.

[39]  Jalal POOROLAJAL,et al.  Evaluating the High Risk Groups for Suicide: A Comparison of Logistic Regression, Support Vector Machine, Decision Tree and Artificial Neural Network , 2016, Iranian journal of public health.

[40]  Krishnaprasad Thirunarayan,et al.  Knowledge-aware Assessment of Severity of Suicide Risk for Early Intervention , 2019, WWW.

[41]  Eric Horvitz,et al.  Predicting Depression via Social Media , 2013, ICWSM.

[42]  Craig J Bryan,et al.  Advances in the assessment of suicide risk. , 2006, Journal of clinical psychology.

[43]  Evan M. Kleiman,et al.  Risk Factors for Suicidal Thoughts and Behaviors: A Meta-Analysis of 50 Years of Research , 2017, Psychological bulletin.

[44]  C. Ferguson,et al.  Social Media Use and Mental Health among Young Adults , 2018, Psychiatric Quarterly.

[45]  Wei Luo,et al.  An integrated framework for suicide risk prediction , 2013, KDD.

[46]  P. Resnik,et al.  CLPsych 2019 Shared Task: Predicting the Degree of Suicide Risk in Reddit Posts , 2019, Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology.

[47]  Joy L. Johnson,et al.  "You feel like you can't live anymore": suicide from the perspectives of Canadian men who experience depression. , 2012, Social science & medicine.