Joint Modeling of Heterogeneous Sensing Data for Depression Assessment via Multi-task Learning

Depression is a common mood disorder that causes severe medical problems and interferes negatively with daily life. Identifying human behavior patterns that are predictive or indicative of depressive disorder is important. Clinical diagnosis of depression relies on costly clinician assessment using survey instruments which may not objectively reflect the fluctuation of daily behavior. Self-administered surveys, such as the Quick Inventory of Depressive Symptomatology (QIDS) commonly used to monitor depression, may show disparities from clinical decision. Smartphones provide easy access to many behavioral parameters, and Fitbit wrist bands are becoming another important tool to assess variables such as heart rates and sleep efficiency that are complementary to smartphone sensors. However, data used to identify depression indicators have been limited to a single platform either iPhone, or Android, or Fitbit alone due to the variation in their methods of data collection. The present work represents a large-scale effort to collect and integrate data from mobile phones, wearable devices, and self reports in depression analysis by designing a new machine learning approach. This approach constructs sparse mappings from sensing variables collected by various tools to two separate targets: self-reported QIDS scores and clinical assessment of depression severity. We propose a so-called heterogeneous multi-task feature learning method that jointly builds inference models for related tasks but of different types including classification and regression tasks. The proposed method was evaluated using data collected from 103 college students and could predict the QIDS score with an R2 reaching 0.44 and depression severity with an F1-score as high as 0.77. By imposing appropriate regularizers, our approach identified strong depression indicators such as time staying at home and total time asleep.

[1]  Alex Pentland,et al.  Social sensing: obesity, unhealthy eating and exercise in face-to-face networks , 2010, Wireless Health.

[2]  Murat Dundar,et al.  An Improved Multi-task Learning Approach with Applications in Medical Diagnosis , 2008, ECML/PKDD.

[3]  Jieping Ye,et al.  Multi-Task Feature Learning Via Efficient l2, 1-Norm Minimization , 2009, UAI.

[4]  R. Spitzer,et al.  The PHQ-9 , 2001, Journal of General Internal Medicine.

[5]  Sethu Vijayakumar,et al.  Multi-task Gaussian Process Learning of Robot Inverse Dynamics , 2008, NIPS.

[6]  Cheng Soon Ong,et al.  Multivariate spearman's ρ for aggregating ranks using copulas , 2016 .

[7]  Alexander Russell,et al.  Multi-view Bi-clustering to Identify Smartphone Sensing Features Indicative of Depression , 2016, 2016 IEEE First International Conference on Connected Health: Applications, Systems and Engineering Technologies (CHASE).

[8]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[9]  Akane Sano,et al.  Multi-task , Multi-Kernel Learning for Estimating Individual Wellbeing , 2015 .

[10]  Jiebo Luo,et al.  Tackling Mental Health by Integrating Unobtrusive Multimodal Sensing , 2015, AAAI.

[11]  Lars Vedel Kessing,et al.  Supporting disease insight through data analysis: refinements of the monarca self-assessment system , 2013, UbiComp.

[12]  Bernadette A. Thomas,et al.  Years lived with disability (YLDs) for 1160 sequelae of 289 diseases and injuries 1990–2010: a systematic analysis for the Global Burden of Disease Study 2010 , 2012, The Lancet.

[13]  Akane Sano,et al.  Stress Recognition Using Wearable Sensors and Mobile Phones , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[14]  Oscar Mayora-Ibarra,et al.  Using smart phone mobility traces for the diagnosis of depressive and manic episodes in bipolar patients , 2014, AH.

[15]  Alex Pentland,et al.  Daily Stress Recognition from Mobile Phone Data, Weather Conditions and Individual Traits , 2014, ACM Multimedia.

[16]  Yoshihiko Suhara,et al.  DeepMood: Forecasting Depressed Mood Based on Self-Reported Histories via Recurrent Neural Networks , 2017, WWW.

[17]  Alex Pentland,et al.  Social sensing for epidemiological behavior change , 2010, UbiComp.

[18]  Andrew T. Campbell,et al.  Next-generation psychiatric assessment: Using smartphone sensors to monitor behavior and mental health. , 2015, Psychiatric rehabilitation journal.

[19]  Daniel Gatica-Perez,et al.  StressSense: detecting stress in unconstrained acoustic environments using smartphones , 2012, UbiComp.

[20]  Alex Pentland,et al.  Using Social Sensing to Understand the Links between Sleep, Mood, and Sociability , 2011, 2011 IEEE Third International Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third International Conference on Social Computing.

[21]  Andrew T. Campbell,et al.  BeWell: Sensing Sleep, Physical Activities and Social Interactions to Promote Wellbeing , 2014, Mobile Networks and Applications.

[22]  Alexander Russell,et al.  Fusing location data for depression prediction , 2017, 2017 IEEE SmartWorld, Ubiquitous Intelligence & Computing, Advanced & Trusted Computed, Scalable Computing & Communications, Cloud & Big Data Computing, Internet of People and Smart City Innovation (SmartWorld/SCALCOM/UIC/ATC/CBDCom/IOP/SCI).

[23]  Fanglin Chen,et al.  Unobtrusive sleep monitoring using smartphones , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[24]  Jieping Ye,et al.  Robust multi-task feature learning , 2012, KDD.

[25]  Daniel Gatica-Perez,et al.  GroupUs: Smartphone Proximity Data and Human Interaction Type Mining , 2011, 2011 15th Annual International Symposium on Wearable Computers.

[26]  Jinbo Bi,et al.  On Multiplicative Multitask Feature Learning , 2014, NIPS.

[27]  Roger W. Sinnott,et al.  Astronomical computing: 1. Computing under the open sky. 2. Virtues of the haversine. , 1984 .

[28]  Hojung Cha,et al.  Automatically characterizing places with opportunistic crowdsensing using smartphones , 2012, UbiComp.

[29]  Ming Yang,et al.  Multi-Task Learning with Gaussian Matrix Generalized Inverse Gaussian Model , 2013, ICML.

[30]  Maarten De Vos,et al.  Detecting Bipolar Depression From Geographic Location Data , 2016, IEEE Transactions on Biomedical Engineering.

[31]  Mirco Musolesi,et al.  Towards multi-modal anticipatory monitoring of depressive states through the analysis of human-smartphone interaction , 2016, UbiComp Adjunct.

[32]  Aurelie C. Lozano,et al.  Multi-level Lasso for Sparse Multi-task Regression , 2012, ICML.

[33]  Rui Wang,et al.  CrossCheck: toward passive sensing and detection of mental health changes in people with schizophrenia , 2016, UbiComp.

[34]  Onno Zoeter,et al.  Sparse Bayesian Multi-Task Learning , 2011, NIPS.

[35]  Konrad Paul Kording,et al.  Mobile Phone Sensor Correlates of Depressive Symptom Severity in Daily-Life Behavior: An Exploratory Study , 2015, Journal of medical Internet research.

[36]  Qian Xu,et al.  Probabilistic Multi-Task Feature Selection , 2010, NIPS.

[37]  Mirco Musolesi,et al.  Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis , 2015, UbiComp.

[38]  Daphne Koller,et al.  Learning a meta-level prior for feature relevance from multiple related tasks , 2007, ICML '07.

[39]  Hojung Cha,et al.  Mobility prediction-based smartphone energy optimization for everyday location monitoring , 2011, SenSys.

[40]  Yuwei Chen,et al.  Human Behavior Cognition Using Smartphone Sensors , 2013, Sensors.

[41]  Alexander Russell,et al.  Behavior vs. introspection: refining prediction of clinical depression via smartphone sensing data , 2016, 2016 IEEE Wireless Health (WH).

[42]  Lawrence Carin,et al.  Multi-Task Learning for Classification with Dirichlet Process Priors , 2007, J. Mach. Learn. Res..

[43]  Sung-Bae Cho,et al.  Activity Recognition Using Hierarchical Hidden Markov Models on a Smartphone with 3D Accelerometer , 2011, HAIS.

[44]  J. Gorman,et al.  Heart rate variability in depressive and anxiety disorders. , 2000, American heart journal.

[45]  Yunxin Liu,et al.  Can Your Smartphone Infer Your Mood ? , 2011 .

[46]  Ali Jalali,et al.  A Dirty Model for Multi-task Learning , 2010, NIPS.

[47]  Anton Schwaighofer,et al.  Learning Gaussian processes from multiple tasks , 2005, ICML.

[48]  P. Lukowicz,et al.  Towards smart phone based monitoring of bipolar disorder , 2012, mHealthSys '12.

[49]  Thomas P. Schmalzried,et al.  The accuracy of personal activity monitoring devices , 2017 .

[50]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[51]  Jean-Philippe Vert,et al.  Clustered Multi-Task Learning: A Convex Formulation , 2008, NIPS.

[52]  J. Markowitz,et al.  The 16-Item quick inventory of depressive symptomatology (QIDS), clinician rating (QIDS-C), and self-report (QIDS-SR): a psychometric evaluation in patients with chronic major depression , 2003, Biological Psychiatry.