A Time-Aware Transformer Based Model for Suicide Ideation Detection on Social Media

Social media’s ubiquity fosters a space for users to exhibit suicidal thoughts outside of traditional clinical settings. Understanding the build-up of such ideation is critical for the identification of at-risk users and suicide prevention. Suicide ideation is often linked to a history of mental depression. The emotional spectrum of a user’s historical activity on social media can be indicative of their mental state over time. In this work, we focus on identifying suicidal intent in English tweets by augmenting linguistic models with historical context. We propose STATENet, a time-aware transformer based model for preliminary screening of suicidal risk on social media. STATENet outperforms competitive methods, demonstrating the utility of emotional and temporal contextual cues for suicide risk assessment. We discuss the empirical, qualitative, practical, and ethical aspects of STATENet for suicide ideation detection.

[1]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[2]  Philip Resnik,et al.  Expert, Crowdsourced, and Machine Assessment of Suicide Risk via Online Postings , 2018, CLPsych@NAACL-HTL.

[3]  Maria A Oquendo,et al.  Suicidal ideation and the subjective aspects of depression. , 2012, Journal of affective disorders.

[4]  D. Pratt,et al.  Does unstable mood increase risk of suicide? Theory, research and practice. , 2012, Journal of affective disorders.

[5]  Holly Hedegaard,et al.  Increase in Suicide Mortality in the United States, 1999-2018. , 2020, NCHS data brief.

[6]  Alex B. Fine,et al.  Natural Language Processing of Social Media as Screening for Suicide Risk , 2018, Biomedical informatics insights.

[7]  Rosane Nisenbaum,et al.  Elements of Affective Instability Associated with Suicidal Behaviour in Patients with Borderline Personality Disorder , 2008, Canadian journal of psychiatry. Revue canadienne de psychiatrie.

[8]  Changqin Quan,et al.  Examining Accumulated Emotional Traits in Suicide Blogs With an Emotion Topic Model , 2016, IEEE Journal of Biomedical and Health Informatics.

[9]  Mark Dredze,et al.  You Are What You Tweet: Analyzing Twitter for Public Health , 2011, ICWSM.

[10]  Mark Dredze,et al.  Quantifying Mental Health Signals in Twitter , 2014, CLPsych@ACL.

[11]  Kjetil Rödje,et al.  Utilization of health services in relation to mental health problems in adolescents: A population based survey , 2006, BMC public health.

[12]  Munmun De Choudhury,et al.  A Taxonomy of Ethical Tensions in Inferring Mental Health States from Social Media , 2019, FAT.

[13]  Ramit Sawhney,et al.  SNAP-BATNET: Cascading Author Profiling and Social Network Graphs for Suicide Ideation Detection on Social Media , 2019, NAACL.

[14]  Tineke Broer,et al.  Technology for Our Future? Exploring the Duty to Report and Processes of Subjectification Relating to Digitalized Suicide Prevention , 2020, Inf..

[15]  Xiaohao He,et al.  Latent Suicide Risk Detection on Microblog via Suicide-Oriented Word Embeddings and Layered Attention , 2019, EMNLP.

[16]  Naoki Masuda,et al.  Suicide Ideation of Individuals in Online Social Networks , 2012, PloS one.

[17]  Keith M. Harris,et al.  Is suicide assessment harmful to participants? Findings from a randomized controlled trial , 2017, International journal of mental health nursing.

[18]  Richard Socher,et al.  A Closer Look at Deep Learning Heuristics: Learning rate restarts, Warmup and Distillation , 2018, ICLR.

[19]  Mark Dredze,et al.  Discovering Shifts to Suicidal Ideation from Mental Health Content in Social Media , 2016, CHI.

[20]  E. Robins,et al.  Some clinical considerations in the prevention of suicide based on a study of 134 successful suicides. , 1959, American journal of public health and the nation's health.

[21]  Louis-Philippe Morency,et al.  A Machine Learning Approach to Identifying the Thought Markers of Suicidal Subjects: A Prospective Multicenter Trial , 2017, Suicide & life-threatening behavior.

[22]  Ramit Sawhney,et al.  #suicidal - A Multipronged Approach to Identify and Explore Suicidal Ideation in Twitter , 2019, CIKM.

[23]  Catherine M McHugh,et al.  Association between suicidal ideation and suicide: meta-analyses of odds ratios, sensitivity, specificity and positive predictive value , 2019, BJPsych Open.

[24]  James W. Pennebaker,et al.  Linguistic Inquiry and Word Count (LIWC2007) , 2007 .

[25]  Michael D. Barnes,et al.  Tracking suicide risk factors through Twitter in the US. , 2014, Crisis.

[26]  Elham Mohammadi,et al.  CLaC at CLPsych 2019: Fusion of Neural Features and Predicted Class Probabilities for Suicide Risk Assessment Based on Online Posts , 2019, Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology.

[27]  Christophe Giraud-Carrier,et al.  Validating Machine Learning Algorithms for Twitter Data Against Established Measures of Suicidality , 2016, JMIR mental health.

[28]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[29]  J. Henry,et al.  The Depression Anxiety Stress Scales (DASS): normative data and latent structure in a large non-clinical sample. , 2003, The British journal of clinical psychology.

[30]  A. Osman,et al.  The Suicide Probability Scale: Norms and Factor Structure , 1998, Psychological reports.

[31]  Jingcheng Du,et al.  Extracting psychiatric stressors for suicide from social media using deep learning , 2018, BMC Medical Informatics and Decision Making.

[32]  A. Cantor,et al.  Sample-size calculations for Cohen's kappa. , 1996 .

[33]  Patrick Ruch,et al.  A Baseline Approach for Early Detection of Signs of Anorexia and Self-harm in Reddit Posts , 2019, CLEF.

[34]  Louis-Philippe Morency,et al.  Adolescent Suicidal Risk Assessment in Clinician-Patient Interaction , 2017, IEEE Transactions on Affective Computing.

[35]  Sharath Chandra Guntuku,et al.  Suicide Risk Assessment with Multi-level Dual-Context Language and BERT , 2019, Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology.

[36]  Paul S F Yip,et al.  Predictive validity of the Chinese version of the Adult Suicidal Ideation Questionnaire: psychometric properties and its short version. , 2007, Psychological assessment.

[37]  Erik Cambria,et al.  Suicidal Ideation Detection: A Review of Machine Learning Methods and Applications , 2019, ArXiv.

[38]  Shen-Shyang Ho,et al.  A martingale framework for concept change detection in time-varying data streams , 2005, ICML.

[39]  Hongfei Lin,et al.  Detection of Suicide Ideation in Social Media Forums Using Deep Learning , 2019, Algorithms.

[40]  John Torous,et al.  An Adjuvant Role for Mobile Health in Psychiatry. , 2016, JAMA psychiatry.

[41]  C. Essau,et al.  Frequency and patterns of mental health services utilization among adolescents with anxiety and depressive disorders , 2005, Depression and anxiety.

[42]  Keith M. Harris,et al.  The ABC’s of Suicide Risk Assessment: Applying a Tripartite Approach to Individual Evaluations , 2015, PloS one.

[43]  H. Sueki,et al.  The association of suicide-related Twitter use with suicidal behaviour: a cross-sectional study of young internet users in Japan. , 2015, Journal of affective disorders.

[44]  Craig J Bryan,et al.  Advances in the assessment of suicide risk. , 2006, Journal of clinical psychology.

[45]  P. Resnik,et al.  CLPsych 2019 Shared Task: Predicting the Degree of Suicide Risk in Reddit Posts , 2019, Proceedings of the Sixth Workshop on Computational Linguistics and Clinical Psychology.

[46]  Fei Wang,et al.  Patient Subtyping via Time-Aware LSTM Networks , 2017, KDD.

[47]  Shirui Pan,et al.  Supervised Learning for Suicidal Ideation Detection in Online User Content , 2018, Complex..

[48]  Mark Dredze,et al.  Ethical Research Protocols for Social Media Health Research , 2017, EthNLP@EACL.

[49]  Tristan Henderson,et al.  Contextual Consent: Ethical Mining of Social Media for Health Research , 2017, ArXiv.

[50]  Richard Hans Robert Hahnloser,et al.  Digital selection and analogue amplification coexist in a cortex-inspired silicon circuit , 2000, Nature.

[51]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[52]  Iryna Gurevych,et al.  Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks , 2019, EMNLP.

[53]  Brandon E. Gibb,et al.  Trajectories of suicide ideation and nonsuicidal self-injury among adolescents in mainland China: Peer predictors, joint development, and risk for suicide attempts. , 2015, Journal of consulting and clinical psychology.

[54]  A. Leenaars,et al.  Suicide Note Classification Using Natural Language Processing: A Content Analysis , 2010, Biomedical informatics insights.

[55]  Swati Aggarwal,et al.  A Computational Approach to Feature Extraction for Identification of Suicidal Ideation in Tweets , 2018, ACL.

[56]  Stefan Wojcik and Adam Hughes,et al.  Sizing Up Twitter Users , 2019 .

[57]  K. van Heeringen,et al.  Understanding the suicidal brain , 2003, British Journal of Psychiatry.

[58]  Ramit Sawhney,et al.  Exploring and Learning Suicidal Ideation Connotations on Social Media with Deep Learning , 2018, WASSA@EMNLP.

[59]  Nicholas Tarrier,et al.  Suicide schema in schizophrenia: the effect of emotional reactivity, negative symptoms and schema elaboration. , 2007, Behaviour research and therapy.

[60]  Eric Horvitz,et al.  Predicting Depression via Social Media , 2013, ICWSM.

[61]  James C. Overholser Chapter 3 – Predisposing Factors in Suicide Attempts: Life Stressors , 2003 .

[62]  Sandra Bringay,et al.  Detection of suicide-related posts in Twitter data streams , 2018, IBM J. Res. Dev..

[63]  Fabio Crestani,et al.  Overview of eRisk at CLEF 2019: Early Risk Prediction on the Internet (extended overview) , 2019, CLEF.

[64]  Muhammad Abdul-Mageed,et al.  EmoNet: Fine-Grained Emotion Detection with Gated Recurrent Neural Networks , 2017, ACL.

[65]  Ramit Sawhney,et al.  Utilizing Temporal Psycholinguistic Cues for Suicidal Intent Estimation , 2020, ECIR.

[66]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[67]  Kyomin Jung,et al.  Contextual-CNN: A Novel Architecture Capturing Unified Meaning for Sentence Classification , 2018, 2018 IEEE International Conference on Big Data and Smart Computing (BigComp).

[68]  Ross B. Girshick,et al.  Focal Loss for Dense Object Detection , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Tingshao Zhu,et al.  Detecting Suicidal Ideation in Chinese Microblogs with Psychological Lexicons , 2014, 2014 IEEE 11th Intl Conf on Ubiquitous Intelligence and Computing and 2014 IEEE 11th Intl Conf on Autonomic and Trusted Computing and 2014 IEEE 14th Intl Conf on Scalable Computing and Communications and Its Associated Workshops.

[70]  Lucie Flek,et al.  Returning the N to NLP: Towards Contextually Personalized Classification Models , 2020, ACL.

[71]  Chern Li Liew,et al.  Hunting Suicide Notes in Web 2.0 - Preliminary Findings , 2007, Ninth IEEE International Symposium on Multimedia Workshops (ISMW 2007).

[72]  Casey Fiesler,et al.  “Participant” Perceptions of Twitter Research Ethics , 2018 .

[73]  A. Bruckman Studying the amateur artist: A perspective on disguising data collected in human subjects research on the Internet , 2002, Ethics and Information Technology.

[74]  Louis-Philippe Morency,et al.  Investigating the speech characteristics of suicidal adolescents , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[75]  Norberto Nuno Gomes de Andrade,et al.  Ethics and Artificial Intelligence: Suicide Prevention on Facebook , 2018, Philosophy & Technology.

[76]  Bernard J. Jansen,et al.  Developing an online hate classifier for multiple social media platforms , 2020, Human-centric Computing and Information Sciences.

[77]  Dirk Hovy,et al.  The Social Impact of Natural Language Processing , 2016, ACL.

[78]  Yang Song,et al.  Class-Balanced Loss Based on Effective Number of Samples , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[79]  R. Plutchik A GENERAL PSYCHOEVOLUTIONARY THEORY OF EMOTION , 1980 .

[80]  Krishnaprasad Thirunarayan,et al.  Knowledge-aware Assessment of Severity of Suicide Risk for Early Intervention , 2019, WWW.

[81]  Joy L. Johnson,et al.  "You feel like you can't live anymore": suicide from the perspectives of Canadian men who experience depression. , 2012, Social science & medicine.