Social Sensing: Assessing Social Functioning of Patients Living with Schizophrenia using Mobile Phone Sensing

Impaired social functioning is a symptom of mental illness (e.g., depression, schizophrenia) and a wide range of other conditions (e.g., cognitive decline in the elderly, dementia). Today, assessing social functioning relies on subjective evaluations and self assessments. We propose a different approach and collect detailed social functioning measures and objective mobile sensing data from N=55 outpatients living with schizophrenia to study new methods of passively accessing social functioning. We identify a number of behavioral patterns from sensing data, and discuss important correlations between social function sub-scales and mobile sensing features. We show we can accurately predict the social functioning of outpatients in our study including the following sub-scales: prosocial activities (MAE = 7.79, r = 0.53), which indicates engagement in common social activities; interpersonal behavior (MAE = 3.39, r = 0.57), which represents the number of friends and quality of communications; and employment/occupation (MAE = 2.17, r = 0.62), which relates to engagement in productive employment or a structured program of daily activity. Our work on automatically inferring social functioning opens the way to new forms of assessment and intervention across a number of areas including mental health and aging in place.

[1]  Eric R. Ziegel,et al.  Generalized Linear Models , 2002, Technometrics.

[2]  D. Ben-Zeev,et al.  Feasibility, acceptability, and preliminary efficacy of a smartphone intervention for schizophrenia. , 2014, Schizophrenia bulletin.

[3]  Edward C. Chao,et al.  Generalized Estimating Equations , 2003, Technometrics.

[4]  Nicholas Tarrier,et al.  Handbook of Social Functioning in Schizophrenia , 1998 .

[5]  R. Liberman,et al.  Social skills and relapse history in outpatient schizophrenics. , 1990, Psychiatry.

[6]  Emiliano Miluzzo,et al.  A survey of mobile phone sensing , 2010, IEEE Communications Magazine.

[7]  J. Teresi,et al.  Contribution of family, cognitive and clinical dimensions to long-term outcome in schizophrenia , 1992, Schizophrenia Research.

[8]  Fanglin Chen,et al.  Unobtrusive sleep monitoring using smartphones , 2013, 2013 7th International Conference on Pervasive Computing Technologies for Healthcare and Workshops.

[9]  Tanzeem Choudhury,et al.  In Situ Design for Mental Illness: Considering the Pathology of Bipolar Disorder in mHealth Design , 2015, MobileHCI.

[10]  H. Zou,et al.  Regularization and variable selection via the elastic net , 2005 .

[11]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[12]  Vincent W. S. Tseng,et al.  CrossCheck: Integrating Self-Report, Behavioral Sensing, and Smartphone Use to Identify Digital Indicators of Psychotic Relapse , 2017, Psychiatric rehabilitation journal.

[13]  Jun Soo Kwon,et al.  Longitudinal Patterns of Social Functioning and Conversion to Psychosis in Subjects at Ultra-High Risk , 2011, The Australian and New Zealand journal of psychiatry.

[14]  Laura M. Tully,et al.  Social impairment in schizophrenia: new approaches for treating a persistent problem , 2015, Current opinion in psychiatry.

[15]  Alexander J. Smola,et al.  Support Vector Regression Machines , 1996, NIPS.

[16]  Konrad Paul Kording,et al.  Mobile Phone Sensor Correlates of Depressive Symptom Severity in Daily-Life Behavior: An Exploratory Study , 2015, Journal of medical Internet research.

[17]  M M Weissman,et al.  The assessment of social adjustment. A review of techniques. , 1975, Archives of general psychiatry.

[18]  T. Trull,et al.  Ambulatory Assessment : An Innovative and Promising Approach for Clinical Psychology , 2009 .

[19]  Bernhard Schölkopf,et al.  Kernel Principal Component Analysis , 1997, ICANN.

[20]  Jean Addington,et al.  Neurocognitive and social functioning in schizophrenia: a 2.5 year follow-up study , 2000, Schizophrenia Research.

[21]  T C Chalmers,et al.  A method for assessing the quality of a randomized control trial. , 1981, Controlled clinical trials.

[22]  Anne Marie Piper,et al.  Everyday Experiences: Small Stories and Mental Illness on Instagram , 2019, CHI.

[23]  Matthew Chalmers,et al.  Pass the Ball: Enforced Turn-Taking in Activity Tracking , 2015, CHI.

[24]  D. Fulford,et al.  Social motivation in schizophrenia: How research on basic reward processes informs and limits our understanding. , 2018, Clinical psychology review.

[25]  Inbal Nahum-Shani,et al.  Finding Significant Stress Episodes in a Discontinuous Time Series of Rapidly Varying Mobile Sensor Data , 2016, CHI.

[26]  M. P. Matud,et al.  Psychological Distress and Social Functioning in Elderly Spanish People: A Gender Analysis , 2019, International journal of environmental research and public health.

[27]  A. El-Rabbany Introduction to GPS: The Global Positioning System , 2002 .

[28]  Philippa H. Gander,et al.  The Epidemiology of Morningness/Eveningness: Influence of Age, Gender, Ethnicity, and Socioeconomic Factors in Adults (30-49 Years) , 2006, Journal of biological rhythms.

[29]  Eric Baumer,et al.  Staccato social support in mobile health applications , 2014, CHI.

[30]  M. Birchwood,et al.  programmes with schizophrenic patients. new scale of social adjustment for use in family intervention The Social Functioning Scale. The development and validation of a , 2022 .

[31]  Mor Naaman,et al.  A Multi-site Investigation of Community Awareness Through Passive Location Sharing , 2018, CHI.

[32]  David L. Roberts,et al.  The functional significance of social cognition in schizophrenia: a review. , 2006, Schizophrenia bulletin.

[33]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[34]  Konrad Paul Kording,et al.  Distributed under Creative Commons Cc-by 4.0 the Relationship between Mobile Phone Location Sensor Data and Depressive Symptom Severity , 2022 .

[35]  R. Spitzer,et al.  Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary Care Evaluation of Mental Disorders. Patient Health Questionnaire. , 1999, JAMA.

[36]  Kristina Höök,et al.  CHI '12 Extended Abstracts on Human Factors in Computing Systems , 2012, CHI 2012.

[37]  Deborah Estrin,et al.  Leveraging Multi-Modal Sensing for Mobile Health: A Case Review in Chronic Pain , 2016, IEEE Journal of Selected Topics in Signal Processing.

[38]  Zheng Yao,et al.  The Channel Matters: Self-disclosure, Reciprocity and Social Support in Online Cancer Support Groups , 2019, CHI.

[39]  Andrew T. Campbell,et al.  Predicting Symptom Trajectories of Schizophrenia using Mobile Sensing , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[40]  Munmun De Choudhury,et al.  Modeling and Understanding Visual Attributes of Mental Health Disclosures in Social Media , 2017, CHI.

[41]  Nabil Alshurafa,et al.  WillSense: Adherence Barriers for Passive Sensing Systems That Track Eating Behavior , 2017, CHI Extended Abstracts.

[42]  N. Tarrier,et al.  Social functioning in schizophrenic patients , 1990, Social Psychiatry and Psychiatric Epidemiology.

[43]  Andrew T. Campbell,et al.  Mobile Behavioral Sensing for Outpatients and Inpatients With Schizophrenia. , 2016, Psychiatric services.

[44]  R. Spitzer,et al.  The PHQ-9 , 2001, Journal of General Internal Medicine.

[45]  R A Kane Assessing social function in the elderly. , 1987, Clinics in geriatric medicine.

[46]  Alanson P. Sample,et al.  IDSense: A Human Object Interaction Detection System Based on Passive UHF RFID , 2015, CHI.

[47]  Ping-Chun Hsieh,et al.  VisualLink: Strengthening the Connection between Hearing-impaired Elderly and their Family , 2017, CHI Extended Abstracts.

[48]  Mary Czerwinski,et al.  Pocket Skills: A Conversational Mobile Web App To Support Dialectical Behavioral Therapy , 2018, CHI.

[49]  Norman Ringel,et al.  Social functioning and neurocognitive deficits in outpatients with schizophrenia: a 2-year follow-up 1 This work was presented in part at the Winter Workshop on Schizophrenia, Davos, Switzerland, 7–13 February 1998. 1 , 1999, Schizophrenia Research.

[50]  Y. Benjamini,et al.  Adaptive linear step-up procedures that control the false discovery rate , 2006 .

[51]  M. Choudhury,et al.  "This Post Will Just Get Taken Down": Characterizing Removed Pro-Eating Disorder Social Media Content , 2016, CHI.

[52]  Frank Bentley,et al.  StoryPlace.Me: the path from studying elder communication to a public location-based video service , 2012, CHI Extended Abstracts.

[53]  M Bosc,et al.  Assessment of social functioning in depression. , 2000, Comprehensive psychiatry.

[54]  Mary Czerwinski,et al.  Under pressure: sensing stress of computer users , 2014, CHI.

[55]  John F. Canny,et al.  Balancing Accuracy and Fun: Designing Camera Based Mobile Games for Implicit Heart Rate Monitoring , 2015, CHI.

[56]  Namkee Park,et al.  In-Person Contact Begets Calling and Texting: Interpersonal Motives for Cell Phone Use, Face-to-Face Interaction, and Loneliness , 2010, Cyberpsychology Behav. Soc. Netw..

[57]  Tanzeem Choudhury,et al.  Passive and In-Situ assessment of mental and physical well-being using mobile sensors , 2011, UbiComp '11.

[58]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[59]  Rui Wang,et al.  Tracking Depression Dynamics in College Students Using Mobile Phone and Wearable Sensing , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[60]  Nathan Halko,et al.  Finding Structure with Randomness: Probabilistic Algorithms for Constructing Approximate Matrix Decompositions , 2009, SIAM Rev..

[61]  Munmun De Choudhury,et al.  Methodological Gaps in Predicting Mental Health States from Social Media: Triangulating Diagnostic Signals , 2019, CHI.

[62]  Jeffrey Nichols,et al.  Social media participation and performance at work: a longitudinal study , 2014, CHI.

[63]  John M. Carroll,et al.  A Safety Net: How Older Adults Build and Maintain Interpersonal Relationships , 2018, CHI Extended Abstracts.

[64]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[65]  Cameron Marlow,et al.  Social network activity and social well-being , 2010, CHI.

[66]  Romina Carrasco Designing Virtual Avatars to Empower Social Participation among Older Adults , 2017, CHI Extended Abstracts.

[67]  G. Arbanas Diagnostic and Statistical Manual of Mental Disorders (DSM-5) , 2015 .

[68]  Rui Wang,et al.  Correlates of Stress in the College Environment Uncovered by the Application of Penalized Generalized Estimating Equations to Mobile Sensing Data , 2018, JMIR mHealth and uHealth.

[69]  Roman Kotov,et al.  The 20-Year Longitudinal Trajectories of Social Functioning in Individuals With Psychotic Disorders. , 2017, The American journal of psychiatry.

[70]  Anne Marie Piper,et al.  The Social Lives of Individuals with Traumatic Brain Injury , 2017, CHI.

[71]  Gregory D. Abowd,et al.  The message center: enhancing elder communication , 2006, CHI Extended Abstracts.

[72]  Eric Turkheimer,et al.  Impaired social functioning and symptoms of personality disorders assessed by peer and self-report in a nonclinical population. , 2002, Journal of personality disorders.

[73]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[74]  R. Spitzer,et al.  The PHQ-9: A new depression diagnostic and severity measure , 2002 .

[75]  Ulrich Ebner-Priemer,et al.  Ambulatory assessment. , 2013, Annual review of clinical psychology.

[76]  Mirco Musolesi,et al.  Trajectories of depression: unobtrusive monitoring of depressive states by means of smartphone mobility traces analysis , 2015, UbiComp.

[77]  N Holmes,et al.  The Disability Assessment Schedule: a brief screening device for use with the mentally retarded , 1982, Psychological Medicine.

[78]  W. Eaton,et al.  Psychopathologic precursors and sociodemographic risk factors for the schizophrenia syndrome. , 1992, Archives of general psychiatry.

[79]  G. Strauss,et al.  Periods of recovery in deficit syndrome schizophrenia: a 20-year multi-follow-up longitudinal study. , 2010, Schizophrenia bulletin.

[80]  Gabriella M. Harari,et al.  Sensing sociability: Individual differences in young adults' conversation, calling, texting, and app use behaviors in daily life. , 2020, Journal of personality and social psychology.

[81]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[82]  S. Zeger,et al.  Longitudinal data analysis using generalized linear models , 1986 .

[83]  Nitesh V. Chawla,et al.  Differentiating Higher and Lower Job Performers in the Workplace Using Mobile Sensing , 2019, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[84]  Mary Czerwinski,et al.  3rd Symposium on Computing and Mental Health: Understanding, Engaging, and Delighting Users , 2018, CHI Extended Abstracts.

[85]  Michael F. Green,et al.  What are the functional consequences of neurocognitive deficits in schizophrenia? , 1996, The American journal of psychiatry.

[86]  Niall Turner,et al.  First-episode psychosis and disengagement from treatment: a systematic review. , 2014, Psychiatric services.

[87]  Michael F. Green,et al.  Social cognition in schizophrenia , 2015, Nature Reviews Neuroscience.

[88]  Munmun De Choudhury,et al.  Norms Matter: Contrasting Social Support Around Behavior Change in Online Weight Loss Communities , 2018, CHI.

[89]  Tianqi Chen,et al.  XGBoost: A Scalable Tree Boosting System , 2016, KDD.

[90]  James A. Landay,et al.  The Mobile Sensing Platform: An Embedded Activity Recognition System , 2008, IEEE Pervasive Computing.

[91]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[92]  Gierad Laput,et al.  StoryCubes: connecting elders in independent living through storytelling , 2012, CHI Extended Abstracts.

[93]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[94]  Michaeline Bresnahan,et al.  Race and risk of schizophrenia in a US birth cohort: another example of health disparity? , 2007, International journal of epidemiology.

[95]  Matthew Chalmers,et al.  An N-of-1 Evaluation Framework for Behaviour Change Applications , 2019, CHI Extended Abstracts.

[96]  T. Burns,et al.  Social functioning as an outcome measure in schizophrenia studies , 2007, Acta psychiatrica Scandinavica.

[97]  Rui Wang,et al.  CrossCheck: toward passive sensing and detection of mental health changes in people with schizophrenia , 2016, UbiComp.

[98]  Rui Wang,et al.  Sensing Behavioral Change over Time , 2018, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..

[99]  L. Cronbach Coefficient alpha and the internal structure of tests , 1951 .

[100]  Michael F. Green,et al.  Social Disconnection in Schizophrenia and the General Community , 2018, Schizophrenia bulletin.

[101]  Munmun De Choudhury,et al.  Multimodal Classification of Moderated Online Pro-Eating Disorder Content , 2017, CHI.