Leveraging Collaborative-Filtering for Personalized Behavior Modeling

The prevalence of mobile phones and wearable devices enables the passive capturing and modeling of human behavior at an unprecedented resolution and scale. Past research has demonstrated the capability of mobile sensing to model aspects of physical health, mental health, education, and work performance, etc. However, most of the algorithms and models proposed in previous work follow a one-size-fits-all (i.e., population modeling) approach that looks for common behaviors amongst all users, disregarding the fact that individuals can behave very differently, resulting in reduced model performance. Further, black-box models are often used that do not allow for interpretability and human behavior understanding. We present a new method to address the problems of personalized behavior classification and interpretability, and apply it to depression detection among college students. Inspired by the idea of collaborative-filtering, our method is a type of memory-based learning algorithm. It leverages the relevance of mobile-sensed behavior features among individuals to calculate personalized relevance weights, which are used to impute missing data and select features according to a specific modeling goal (e.g., whether the student has depressive symptoms) in different time epochs, i.e., times of the day and days of the week. It then compiles features from epochs using majority voting to obtain the final prediction. We apply our algorithm on a depression detection dataset collected from first-year college students with low data-missing rates and show that our method outperforms the state-of-the-art machine learning model by 5.1% in accuracy and 5.5% in F1 score. We further verify the pipeline-level generalizability of our approach by achieving similar results on a second dataset, with an average improvement of 3.4% across performance metrics. Beyond achieving better classification performance, our novel approach is further able to generate personalized interpretations of the models for each individual. These interpretations are supported by existing depression-related literature and can potentially inspire automated and personalized depression intervention design in the future.

[1]  Daniella K. Villalba,et al.  Identifying Behavioral Phenotypes of Loneliness and Social Isolation with Passive Sensing: Statistical Analysis, Data Mining and Machine Learning of Smartphone and Fitbit Data , 2019, JMIR mHealth and uHealth.

[2]  Ognjen Rudovic,et al.  Physiological and behavioral profiling for nociceptive pain estimation using personalized multitask learning , 2017, ArXiv.

[3]  Anind K. Dey,et al.  Passively-sensed Behavioral Correlates of Discrimination Events in College Students , 2019, Proc. ACM Hum. Comput. Interact..

[4]  Björn W. Schuller,et al.  Personalized machine learning for robot perception of affect and engagement in autism therapy , 2018, Science Robotics.

[5]  Andrew T. Campbell,et al.  Next-generation psychiatric assessment: Using smartphone sensors to monitor behavior and mental health. , 2015, Psychiatric rehabilitation journal.

[6]  Eric P. Xing,et al.  Learning Sample-Specific Models with Low-Rank Personalized Regression , 2019, NeurIPS.

[7]  Chenglin Miao,et al.  Towards Personalized Learning in Mobile Sensing Systems , 2018, 2018 IEEE 38th International Conference on Distributed Computing Systems (ICDCS).

[8]  Denzil Ferreira,et al.  Detecting Drinking Episodes in Young Adults Using Smartphone-based Sensors , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[9]  Rui Wang,et al.  Tracking Depression Dynamics in College Students Using Mobile Phone and Wearable Sensing , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[10]  Yuhong Yang,et al.  Cross-validation for selecting a model selection procedure , 2015 .

[11]  Denzil Ferreira,et al.  AWARE: Mobile Context Instrumentation Framework , 2015, Front. ICT.

[12]  John Shawe-Taylor,et al.  Localized Lasso for High-Dimensional Regression , 2016, AISTATS.

[13]  Els Goetghebeur,et al.  Model evaluation based on the sampling distribution of estimated absolute prediction error , 2007 .

[14]  K. Demi̇rci̇,et al.  Relationship of Smartphone Use Severity with Sleep Quality, Depression, and Anxiety in University Students , 2015, Journal of behavioral addictions.

[15]  Tara N. Sainath,et al.  Convolutional, Long Short-Term Memory, fully connected Deep Neural Networks , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[16]  John Zimmerman,et al.  Toss 'n' turn: smartphone as sleep and sleep quality detector , 2014, CHI.

[17]  Yuan-Pang Wang,et al.  Response pattern of depressive symptoms among college students: What lies behind items of the Beck Depression Inventory-II? , 2018, Journal of affective disorders.

[18]  Sriram Chellappan,et al.  Associating Internet Usage with Depressive Behavior Among College Students , 2012, IEEE Technology and Society Magazine.

[19]  Rob J Hyndman,et al.  Sample Quantiles in Statistical Packages , 1996 .

[20]  Lars Vedel Kessing,et al.  Supporting disease insight through data analysis: refinements of the monarca self-assessment system , 2013, UbiComp.

[21]  D. Russell UCLA Loneliness Scale (Version 3): reliability, validity, and factor structure. , 1996, Journal of personality assessment.

[22]  Yiqiang Chen,et al.  Cross-People Mobile-Phone Based Activity Recognition , 2011, IJCAI.

[23]  R. Ryan,et al.  The benefits of being present: mindfulness and its role in psychological well-being. , 2003, Journal of personality and social psychology.

[24]  N Sitaram,et al.  Sleep and depression. , 1987, Psychopathology.

[25]  Antonio Lima,et al.  Interdependence and predictability of human mobility and social interactions , 2012, Pervasive Mob. Comput..

[26]  Ron Kohavi,et al.  Lazy Decision Trees , 1996, AAAI/IAAI, Vol. 1.

[27]  Konrad Paul Kording,et al.  Mobile Phone Sensor Correlates of Depressive Symptom Severity in Daily-Life Behavior: An Exploratory Study , 2015, Journal of medical Internet research.

[28]  Suchi Saria,et al.  A Framework for Individualizing Predictions of Disease Trajectories by Exploiting Multi-Resolution Structure , 2015, NIPS.

[29]  Shyam Visweswaran,et al.  Learning Instance-Specific Predictive Models , 2010, J. Mach. Learn. Res..

[30]  Nitesh V. Chawla,et al.  Differentiating Higher and Lower Job Performers in the Workplace Using Mobile Sensing , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[31]  R. H. Moorman,et al.  Individualism‐collectivism as an individual difference predictor of organizational citizenship behavior , 1995 .

[32]  Jin-Hyuk Hong,et al.  Toward Personalized Activity Recognition Systems With a Semipopulation Approach , 2016, IEEE Transactions on Human-Machine Systems.

[33]  Alexander Russell,et al.  Joint Modeling of Heterogeneous Sensing Data for Depression Assessment via Multi-task Learning , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[34]  Ye Xu,et al.  Enabling large-scale human activity inference on smartphones using community similarity networks (csn) , 2011, UbiComp '11.

[35]  David J. A. Dozois,et al.  A psychometric evaluation of the Beck Depression inventory-II , 1998 .

[36]  M. Whisman,et al.  Normative Data on the Beck Depression Inventory--Second Edition (BDI-II) in College Students. , 2015, Journal of clinical psychology.

[37]  Ashutosh Kumar Singh,et al.  Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: a systematic analysis for the Global Burden of Disease Study 2015 , 2016, Lancet.

[38]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[39]  Alexander Russell,et al.  Behavior vs. introspection: refining prediction of clinical depression via smartphone sensing data , 2016, 2016 IEEE Wireless Health (WH).

[40]  F. Wahle,et al.  Mobile Sensing and Support for People With Depression: A Pilot Trial in the Wild , 2016, JMIR mHealth and uHealth.

[41]  Tanzeem Choudhury,et al.  Towards Population Scale Activity Recognition: A Framework for Handling Data Diversity , 2012, AAAI.

[42]  James M. Keller,et al.  A fuzzy K-nearest neighbor algorithm , 1985, IEEE Transactions on Systems, Man, and Cybernetics.

[43]  Anind K. Dey,et al.  Leveraging Routine Behavior and Contextually-Filtered Features for Depression Detection among College Students , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[44]  Geoffrey I. Webb,et al.  Lazy Learning of Bayesian Rules , 2000, Machine Learning.

[45]  Andrew W. Moore,et al.  Locally Weighted Learning , 1997, Artificial Intelligence Review.

[46]  J. Weisz,et al.  Annual Research Review: Building a science of personalized intervention for youth mental health. , 2016, Journal of child psychology and psychiatry, and allied disciplines.

[47]  G. Arbanas Diagnostic and Statistical Manual of Mental Disorders (DSM-5) , 2015 .

[48]  Xu Sun,et al.  Large-Scale Personalized Human Activity Recognition Using Online Multitask Learning , 2013, IEEE Transactions on Knowledge and Data Engineering.

[49]  Gabriella M. Harari,et al.  Smartphone sensing methods for studying behavior in everyday life , 2017, Current Opinion in Behavioral Sciences.

[50]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[51]  R. Agarwal Fast Algorithms for Mining Association Rules , 1994, VLDB 1994.

[52]  Laura E. Barnes,et al.  Using Mobile Sensing to Test Clinical Models of Depression, Social Anxiety, State Affect, and Social Isolation Among College Students , 2017, Journal of medical Internet research.

[53]  Mirco Musolesi,et al.  Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis , 2015, UbiComp.

[54]  R. Spitzer,et al.  The PHQ-9: A new depression diagnostic and severity measure , 2002 .

[55]  B. Löwe,et al.  An ultra-brief screening scale for anxiety and depression: the PHQ-4. , 2009, Psychosomatics.

[56]  Konrad Paul Kording,et al.  Distributed under Creative Commons Cc-by 4.0 the Relationship between Mobile Phone Location Sensor Data and Depressive Symptom Severity , 2022 .

[57]  P. McLeod,et al.  Effects of Ethnic Group Cultural Differences on Cooperative and Competitive Behavior On a Group Task , 1991 .

[58]  Jonathan W. Roberti,et al.  Factor structure, concurrent validity, and internal consistency of the beck depression inventory—second edition in a sample of college students , 2004, Depression and anxiety.

[59]  M. Thase,et al.  Depression, sleep, and antidepressants. , 1998, The Journal of clinical psychiatry.

[60]  Toshi A Furukawa,et al.  Assessment of mood: guides for clinicians. , 2010, Journal of psychosomatic research.

[61]  Deborah Estrin,et al.  Leveraging Multi-Modal Sensing for Mobile Health: A Case Review in Chronic Pain , 2016, IEEE Journal of Selected Topics in Signal Processing.

[62]  Nitesh V. Chawla,et al.  The Tesserae Project: Large-Scale, Longitudinal, In Situ, Multimodal Sensing of Information Workers , 2019, CHI Extended Abstracts.

[63]  神田 信彦 Beck Depression Inventory-IIについての一考察 , 2004 .