Sequence Multi-task Learning to Forecast Mental Wellbeing from Sparse Self-reported Data

Smartphones have started to be used as self reporting tools for mental health state as they accompany individuals during their days and can therefore gather temporally fine grained data. However, the analysis of self reported mood data offers challenges related to non-homogeneity of mood assessment among individuals due to the complexity of the feeling and the reporting scales, as well as the noise and sparseness of the reports when collected in the wild. In this paper, we propose a new end-to-end ML model inspired by video frame prediction and machine translation, that forecasts future sequences of mood from previous self-reported moods collected in the real world using mobile devices. Contrary to traditional time series forecasting algorithms, our multi-task encoder-decoder recurrent neural network learns patterns from different users, allowing and improving the prediction for users with limited number of self-reports. Unlike traditional feature-based machine learning algorithms, the encoder-decoder architecture enables to forecast a sequence of future moods rather than one single step. Meanwhile, multi-task learning exploits some unique characteristics of the data (mood is bi-dimensional), achieving better results than when training single-task networks or other classifiers. Our experiments using a real-world dataset of 33,000 user-weeks revealed that (i) 3 weeks of sparsely reported mood is the optimal number to accurately forecast mood, (ii) multi-task learning models both dimensions of mood "valence and arousal" with higher accuracy than separate or traditional ML models, and (iii) mood variability, personality traits and day of the week play a key role in the performance of our model. We believe this work provides psychologists and developers of future mobile mental health applications with a ready-to-use and effective tool for early diagnosis of mental health issues at scale.

[1]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[2]  Mirco Musolesi,et al.  Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis , 2015, UbiComp.

[3]  Sebastian Ruder,et al.  An Overview of Multi-Task Learning in Deep Neural Networks , 2017, ArXiv.

[4]  R. Veenhoven,et al.  Healthy happiness: effects of happiness on physical health and the consequences for preventive health care , 2008 .

[5]  J. Russell,et al.  The relation between valence and arousal in subjective experience. , 2013, Psychological bulletin.

[6]  Martial Hebert,et al.  Improving Multi-Step Prediction of Learned Time Series Models , 2015, AAAI.

[7]  Nitish Srivastava,et al.  Unsupervised Learning of Video Representations using LSTMs , 2015, ICML.

[8]  Randal S. Olson,et al.  Data-driven advice for applying machine learning to bioinformatics problems , 2017, PSB.

[9]  Cecilia Mascolo,et al.  Mobile Sensing at the Service of Mental Well-being: a Large-scale Longitudinal Study , 2017, WWW.

[10]  Lei Zheng,et al.  DeepMood: Modeling Mobile Phone Typing Dynamics for Mood Detection , 2017, KDD.

[11]  Charles S. Areni,et al.  Memories of “Bad” Days Are More Biased Than Memories of “Good” Days: Past Saturdays Vary, but Past Mondays Are Always Blue , 2008 .

[12]  Steffen Nestler,et al.  Trait personality and state variability: Predicting individual differences in within- and cross-context fluctuations in affect, self-evaluations, and behavior in everyday life , 2017 .

[13]  G. A. Mendelsohn,et al.  Affect grid : A single-item scale of pleasure and arousal , 1989 .

[14]  Qiang Yang,et al.  An Overview of Multi-task Learning , 2018 .

[15]  Patrick Rabbitt,et al.  Think Fast, Feel Fine, Live Long , 2016, Psychological science.

[16]  Andrew T. Campbell,et al.  Bewell: A smartphone application to monitor, model and promote wellbeing , 2011, PervasiveHealth 2011.

[17]  Yoshihiko Suhara,et al.  DeepMood: Forecasting Depressed Mood Based on Self-Reported Histories via Recurrent Neural Networks , 2017, WWW.

[18]  Adrian Furnham,et al.  Personality, self-esteem, and demographic predictions of happiness and depression , 2003 .

[19]  Akane Sano,et al.  Personalized Multitask Learning for Predicting Tomorrow's Mood, Stress, and Health , 2020, IEEE Transactions on Affective Computing.

[20]  S. Gosling,et al.  A very brief measure of the Big-Five personality domains , 2003 .

[21]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[22]  Robert Li Kam Wa MoodScope: Building a Mood Sensor from Smartphone Usage Patterns , 2012 .

[23]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[24]  Peter Kuppens,et al.  Individual differences in the relationship between pleasure and arousal , 2008 .