Predicting Tomorrow's Mood, Health, and Stress Level using Personalized Multitask Learning and Domain Adaptation

Predicting a person’s mood tomorrow, from data collected unobtrusively using wearable sensors and smartphones, could have a number of beneficial clinical applications; however, this prediction is an extremely challenging problem. Past approaches often lack the accurate and reliable performance necessary for real-world applications. We posit that this is due to the inability of traditional, one-sizefits-all machine learning models to account for individual differences. To overcome this, we treat predicting tomorrow’s mood for a single person as one task, or problem domain. We then adopt Multitask Learning (MTL) and Domain Adaptation (DA) approaches to learn a model which is customized for each person, while still being able to benefit from data across the population. Empirical results on real-world, continuous monitoring data show that the new personalized models — a MTL deep neural network, and a Gaussian Process with DA — both significantly outperform their generic counterparts, providing substantial performance enhancements in automatic prediction of continuous levels of tomorrow’s reported mood, stress, and physical health based on data through today.

[1]  Rich Caruana,et al.  Multitask Learning , 1997, Machine-mediated learning.

[2]  R. Veenhoven,et al.  Healthy happiness: effects of happiness on physical health and the consequences for preventive health care , 2008 .

[3]  Akane Sano,et al.  Predicting students' happiness from physiology, phone, mobility, and behavioral data , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[4]  Andrew P. Smith,et al.  Psychological stress and susceptibility to the common cold. , 1991, The New England journal of medicine.

[5]  Loes Keijsers,et al.  Come rain or come shine: individual differences in how weather affects mood. , 2011, Emotion.

[6]  Alex Pentland,et al.  Daily Stress Recognition from Mobile Phone Data, Weather Conditions and Individual Traits , 2014, ACM Multimedia.

[7]  Oscar Mayora-Ibarra,et al.  Smartphone-Based Recognition of States and State Changes in Bipolar Disorder Patients , 2015, IEEE Journal of Biomedical and Health Informatics.

[8]  D. Asch,et al.  Wearable devices as facilitators, not drivers, of health behavior change. , 2015, JAMA.

[9]  David A. Clifton,et al.  Gaussian Processes for Personalized e-Health Monitoring With Wearable Sensors , 2013, IEEE Transactions on Biomedical Engineering.

[10]  Adrian Furnham,et al.  Personality, self-esteem, and demographic predictions of happiness and depression , 2003 .

[11]  Rosalind W. Picard,et al.  Multi-task Learning for Predicting Health , Stress , and Happiness , 2016 .

[12]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[13]  Akane Sano,et al.  Multi-task , Multi-Kernel Learning for Estimating Individual Wellbeing , 2015 .

[14]  T. Wills,et al.  Stress, social support, and the buffering hypothesis. , 1985, Psychological bulletin.

[15]  T. Partonen,et al.  Dopamine and circadian rhythms in seasonal affective disorder. , 1996, Medical hypotheses.

[16]  Yunxin Liu,et al.  MoodScope: building a mood sensor from smartphone usage patterns , 2013, MobiSys.

[17]  Maja Pantic,et al.  Gaussian Process Domain Experts for Model Adaptation in Facial Behavior Analysis , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[18]  Xun Wang,et al.  What a Nasty Day: Exploring Mood-Weather Relationship from Twitter , 2014, CIKM.

[19]  Akane Sano,et al.  Measuring college students' sleep, stress, mental health and wellbeing with wearable sensors and mobile phones , 2016 .

[20]  Akane Sano,et al.  Automatic identification of artifacts in electrodermal activity data , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  Mirco Musolesi,et al.  Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis , 2015, UbiComp.

[22]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[23]  P Salmon,et al.  Effects of physical exercise on anxiety, depression, and sensitivity to stress: a unifying theory. , 2001, Clinical psychology review.

[24]  Thomas G. Dietterich,et al.  To transfer or not to transfer , 2005, NIPS 2005.

[25]  S. Mineka,et al.  Temperament, personality, and the mood and anxiety disorders. , 1994, Journal of abnormal psychology.

[26]  Nuno Vasconcelos,et al.  Bayesian Model Adaptation for Crowd Counts , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[27]  Patrick Rabbitt,et al.  Think Fast, Feel Fine, Live Long , 2016, Psychological science.

[28]  John Brebner Personality Factors in Stress and Anxiety , 2018, Cross-Cultural Anxiety.