Sentiment analysis and affective computing for depression monitoring

Depression is one of the most common and disabling mental disorders that has a relevant impact on society. Semiautomatic and/or automatic health monitoring systems could be crucial and important to improve depression detection and follow-up. Sentiment Analysis refers to the use of natural language processing and text mining methodologies aiming to identify opinion or sentiment. Affective Computing is the study and development of systems and devices that can recognize, interpret, process, and simulate human affects. Sentiment Analysis and Affective Computing methodologies could provide effective tools and systems for an objective assessment and monitoring of psychological disorders and, in particular, of depression. In this paper, the application of sentiment analysis and affective computing methodologies to depression detection and monitoring are presented and discussed. Moreover, a preliminary design of an integrated multimodal system for depression monitoring, that includes sentiment analysis and affective computing techniques, is proposed. Specifically, the paper outlines the main issues and challenges relative to the design of such a system.

[1]  Roland Göcke,et al.  An approach for automatically measuring facial activity in depressed subjects , 2009, 2009 3rd International Conference on Affective Computing and Intelligent Interaction and Workshops.

[2]  Eric Horvitz,et al.  Predicting Depression via Social Media , 2013, ICWSM.

[3]  J. Morris,et al.  The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer's disease , 2011, Alzheimer's & Dementia.

[4]  P. Young,et al.  Emotion and personality , 1963 .

[5]  Kang Liu,et al.  Book Review: Sentiment Analysis: Mining Opinions, Sentiments, and Emotions by Bing Liu , 2015, CL.

[6]  Karina Lovell,et al.  Patient Health Questionnaire , 2013 .

[7]  Jefferson C Frisbee,et al.  Chronic stress impacts the cardiovascular system: animal models and clinical outcomes. , 2015, American journal of physiology. Heart and circulatory physiology.

[8]  Michael Wagner,et al.  Multimodal assistive technologies for depression diagnosis and monitoring , 2013, Journal on Multimodal User Interfaces.

[9]  Nathan Marz,et al.  Big Data: Principles and best practices of scalable realtime data systems , 2015 .

[10]  村松 公美子,et al.  Patient Health Questionnaire (PHQ-9, PHQ-15)日本語版およびGeneralized Anxiety Disorder-7日本語版 : up to date , 2014 .

[11]  Vadlamani Ravi,et al.  A survey on opinion mining and sentiment analysis: Tasks, approaches and applications , 2015, Knowl. Based Syst..

[12]  B. Park,et al.  Head movements during conversational speech in patients with schizophrenia , 2013, Therapeutic advances in psychopharmacology.

[13]  P. Ekman,et al.  EMFACS-7: Emotional Facial Action Coding System , 1983 .

[14]  Eun Yi Kim,et al.  Identifying depressive users in Twitter using multimodal analysis , 2016, 2016 International Conference on Big Data and Smart Computing (BigComp).

[15]  C. W. Hughes Emotion: Theory, Research and Experience , 1982 .

[16]  Vincenza Carchiolo,et al.  Using Twitter Data and Sentiment Analysis to Study Diseases Dynamics , 2015, ITBAM.

[17]  Mark Dredze,et al.  Measuring Post Traumatic Stress Disorder in Twitter , 2014, ICWSM.

[18]  Björn W. Schuller,et al.  AVEC 2014: 3D Dimensional Affect and Depression Recognition Challenge , 2014, AVEC '14.

[19]  Mika Kivimäki,et al.  Work Stress as a Risk Factor for Cardiovascular Disease , 2015, Current Cardiology Reports.

[20]  R. Plutchik,et al.  Emotion: Theory, Research, and Experience. Vol. 1. Theories of Emotion , 1981 .

[21]  Rivka Levitan,et al.  Speech vs. text: A comparative analysis of features for depression detection systems , 2016, 2016 IEEE Spoken Language Technology Workshop (SLT).

[22]  P. Ekman Unmasking The Face , 1975 .

[23]  Mario Cannataro,et al.  Sentiment Analysis and Affective Computing: Methods and Applications , 2015, BrainComp.

[24]  Hafiz Farooq Ahmad,et al.  Predicting Depression Levels Using Social Media Posts , 2017, 2017 IEEE 13th International Symposium on Autonomous Decentralized System (ISADS).

[25]  Byoung-Jun Park,et al.  Analysis of physiological signals for recognition of boredom, pain, and surprise emotions , 2015, Journal of Physiological Anthropology.

[26]  John Crowe,et al.  Objective Methods for Reliable Detection of Concealed Depression , 2015, Front. ICT.

[27]  Walaa Medhat,et al.  Sentiment analysis algorithms and applications: A survey , 2014 .

[28]  Jiebo Luo,et al.  Tackling Mental Health by Integrating Unobtrusive Multimodal Sensing , 2015, AAAI.

[29]  Kallirroi Georgila,et al.  SimSensei kiosk: a virtual human interviewer for healthcare decision support , 2014, AAMAS.

[30]  Mario Cannataro,et al.  Computational challenges for sentiment analysis in life sciences , 2016, 2016 International Conference on High Performance Computing & Simulation (HPCS).

[31]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[32]  Mitchell D. Wilkes,et al.  Evaluation of Voice Acoustics as Predictors of Clinical Depression Scores. , 2017, Journal of voice : official journal of the Voice Foundation.

[33]  Erik Cambria,et al.  Fusing audio, visual and textual clues for sentiment analysis from multimodal content , 2016, Neurocomputing.

[34]  David E. Goodrich,et al.  Mood disorder symptoms and elevated cardiovascular disease risk in patients with bipolar disorder. , 2012, Journal of affective disorders.

[35]  GeunSik Jo,et al.  Affective social network—happiness inducing social media platform , 2012, Multimedia Tools and Applications.

[36]  Gregory J. Park,et al.  Psychological Language on Twitter Predicts County-Level Heart Disease Mortality , 2015, Psychological science.

[37]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Mike Conway,et al.  Towards Automatically Classifying Depressive Symptoms from Twitter Data for Population Health , 2016, PEOPLES@COLING.

[39]  Weihui Dai,et al.  Emotion recognition and affective computing on vocal social media , 2015, Inf. Manag..

[40]  H. Christensen,et al.  Detecting suicidality on Twitter , 2015 .

[41]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.