Beyond LDA: Exploring Supervised Topic Modeling for Depression-Related Language in Twitter

Topic models can yield insight into how depressed and non-depressed individuals use language differently. In this paper, we explore the use of supervised topic models in the analysis of linguistic signal for detecting depression, providing promising results using several models.

[1]  Thang Nguyen,et al.  The University of Maryland CLPsych 2015 Shared Task System , 2015, CLPsych@HLT-NAACL.

[2]  Mark E. Glickman,et al.  Impact of Stigma on Veteran Treatment Seeking for Depression , 2014 .

[3]  David M. Blei,et al.  Supervised Topic Models , 2007, NIPS.

[4]  Proceedings of the Workshop on Computational Linguistics and Clinical Psychology: From Linguistic Signal to Clinical Reality, CLPsych@ACL 2014, Baltimore, Maryland, USA, June 27, 2004 , 2014, CLPsych@ACL.

[5]  Mark Dredze,et al.  Quantifying Mental Health Signals in Twitter , 2014, CLPsych@ACL.

[6]  S. Srivastava,et al.  The Big Five Trait taxonomy: History, measurement, and theoretical perspectives. , 1999 .

[7]  M. Katzman,et al.  Rates of detection of mood and anxiety disorders in primary care: a descriptive, cross-sectional study. , 2011, The primary care companion for CNS disorders.

[8]  Jordan L. Boyd-Graber,et al.  Tree-based Label Dependency Topic Models , 2013 .

[9]  Sanjeev Arora,et al.  A Practical Algorithm for Topic Modeling with Provable Guarantees , 2012, ICML.

[10]  Chong Wang,et al.  Simultaneous image classification and annotation , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  John D. Lafferty,et al.  A correlated topic model of Science , 2007, 0708.3601.

[12]  Alexander J. Smola,et al.  Nested Chinese Restaurant Franchise Process: Applications to User Tracking and Document Modeling , 2013, ICML.

[13]  Philip Resnik,et al.  Using Topic Modeling to Improve Prediction of Neuroticism and Depression in College Students , 2013, EMNLP.

[14]  Michael I. Jordan,et al.  Latent Dirichlet Allocation , 2001, J. Mach. Learn. Res..

[15]  Yair Neuman,et al.  Proactive screening for depression through metaphorical and automatic text analysis , 2012, Artif. Intell. Medicine.

[16]  Quentin Pleple,et al.  Interactive Topic Modeling , 2013 .

[17]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[18]  Mark Dredze,et al.  Shared Task : Depression and PTSD on Twitter , 2015 .

[19]  J. Pennebaker,et al.  Linguistic styles: language use as an individual difference. , 1999, Journal of personality and social psychology.

[20]  J. Pennebaker,et al.  Language use of depressed and depression-vulnerable college students , 2004 .

[21]  Eric Horvitz,et al.  Predicting postpartum changes in emotion and behavior via social media , 2013, CHI.

[22]  Jordan L. Boyd-Graber,et al.  Anchors Regularized: Adding Robustness and Extensibility to Scalable Topic-Modeling Algorithms , 2014, ACL.

[23]  Viet-An Nguyen,et al.  Lexical and Hierarchical Topic Regression , 2013, NIPS.

[24]  Noah A. Smith,et al.  Predicting Risk from Financial Reports with Regression , 2009, NAACL.

[25]  M. Furtado,et al.  Food for thought: understanding the value, variety and usage of management algorithms for major depressive disorder , 2014, Psychiatry Research.

[26]  Maarten Sap,et al.  Towards Assessing Changes in Degree of Depression through Facebook , 2014, CLPsych@ACL.

[27]  Ivan Titov,et al.  Modeling online reviews with multi-grain topic models , 2008, WWW.

[28]  F. Rudzicz.  Human Language Technologies : The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics , 2010 .

[29]  Justin Grimmer,et al.  A Bayesian Hierarchical Topic Model for Political Texts: Measuring Expressed Agendas in Senate Press Releases , 2010, Political Analysis.

[30]  Thang Nguyen,et al.  Is Your Anchor Going Up or Down? Fast and Accurate Supervised Topic Models , 2015, NAACL.