Mobile Phone-Based Unobtrusive Ecological Momentary Assessment of Day-to-Day Mood: An Explorative Study

Background Ecological momentary assessment (EMA) is a useful method to tap the dynamics of psychological and behavioral phenomena in real-world contexts. However, the response burden of (self-report) EMA limits its clinical utility. Objective The aim was to explore mobile phone-based unobtrusive EMA, in which mobile phone usage logs are considered as proxy measures of clinically relevant user states and contexts. Methods This was an uncontrolled explorative pilot study. Our study consisted of 6 weeks of EMA/unobtrusive EMA data collection in a Dutch student population (N=33), followed by a regression modeling analysis. Participants self-monitored their mood on their mobile phone (EMA) with a one-dimensional mood measure (1 to 10) and a two-dimensional circumplex measure (arousal/valence, –2 to 2). Meanwhile, with participants’ consent, a mobile phone app unobtrusively collected (meta) data from six smartphone sensor logs (unobtrusive EMA: calls/short message service (SMS) text messages, screen time, application usage, accelerometer, and phone camera events). Through forward stepwise regression (FSR), we built personalized regression models from the unobtrusive EMA variables to predict day-to-day variation in EMA mood ratings. The predictive performance of these models (ie, cross-validated mean squared error and percentage of correct predictions) was compared to naive benchmark regression models (the mean model and a lag-2 history model). Results A total of 27 participants (81%) provided a mean 35.5 days (SD 3.8) of valid EMA/unobtrusive EMA data. The FSR models accurately predicted 55% to 76% of EMA mood scores. However, the predictive performance of these models was significantly inferior to that of naive benchmark models. Conclusions Mobile phone-based unobtrusive EMA is a technically feasible and potentially powerful EMA variant. The method is young and positive findings may not replicate. At present, we do not recommend the application of FSR-based mood prediction in real-world clinical settings. Further psychometric studies and more advanced data mining techniques are needed to unlock unobtrusive EMA’s true potential.

[1]  Konrad Paul Kording,et al.  Mobile Phone Sensor Correlates of Depressive Symptom Severity in Daily-Life Behavior: An Exploratory Study , 2015, Journal of medical Internet research.

[2]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[3]  Dhavan V. Shah,et al.  A smartphone application to support recovery from alcoholism: a randomized clinical trial. , 2014, JAMA psychiatry.

[4]  N. Lane,et al.  MoodScope: building a mood sensor from smartphone usage patterns , 2013, MobiSys '13.

[5]  M. Berking,et al.  Can a One-Item Mood Scale Do the Trick? Predicting Relapse over 5.5-Years in Recurrent Depression , 2012, PloS one.

[6]  Pedro M. Domingos A few useful things to know about machine learning , 2012, Commun. ACM.

[7]  Alex Pentland,et al.  Social fMRI: Investigating and shaping social mechanisms in the real world , 2011, Pervasive Mob. Comput..

[8]  W. Thompson,et al.  Daily emotional dynamics in depressed youth: a cell phone ecological momentary assessment study. , 2011, Journal of experimental child psychology.

[9]  D. Mohr,et al.  Harnessing Context Sensing to Develop a Mobile Intervention for Depression , 2011, Journal of medical Internet research.

[10]  William N. Venables,et al.  Modern Applied Statistics with S , 2010 .

[11]  Michael Eid,et al.  Psychometric properties of a computerized mobile phone method for assessing mood in daily life. , 2010, Emotion.

[12]  T. Trull,et al.  Ecological momentary assessment of mood disorders and mood dysregulation. , 2009, Psychological assessment.

[13]  Shuqiao Yao,et al.  The cultural shaping of depression: somatic symptoms in China, psychological symptoms in North America? , 2008, Journal of abnormal psychology.

[14]  S. Shiffman,et al.  Ecological momentary assessment. , 2008, Annual review of clinical psychology.

[15]  M. Mimura,et al.  Validity of the Center for Epidemiologic Studies Depression Scale as a screening instrument of major depressive disorder among Japanese workers. , 2007, American journal of industrial medicine.

[16]  David L. Cassell,et al.  Stopping stepwise: Why stepwise and similar selection methods are bad, and what you should use , 2007 .

[17]  Amy L. Gentzler,et al.  Adult attachment and memory of emotional reactions to negative and positive events , 2006 .

[18]  D. Moskowitz,et al.  Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology. , 2006, Journal of psychiatry & neuroscience : JPN.

[19]  Peter C M Molenaar,et al.  Statistical Modeling of the Individual: Rationale and Application of Multivariate Stationary Time Series Analysis , 2005, Multivariate behavioral research.

[20]  S. Shiffman,et al.  Signaling does not adequately improve diary compliance , 2003, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[21]  J. Smyth,et al.  Ecological Momentary Assessment Research in Behavioral medicine , 2003 .

[22]  Frank E. Harrell,et al.  Regression Modeling Strategies: With Applications to Linear Models, Logistic Regression, and Survival Analysis , 2001 .

[23]  J. van Limbeek,et al.  Criterion validity of the Center for Epidemiologic Studies Depression scale (CES-D): results from a community-based sample of older subjects in The Netherlands. , 1997, Psychological medicine.

[24]  J. Russell A circumplex model of affect. , 1980 .

[25]  L. Radloff The CES-D Scale , 1977 .

[26]  H. Akaike A new look at the statistical model identification , 1974 .

[27]  David M. Allen,et al.  The Relationship Between Variable Selection and Data Agumentation and a Method for Prediction , 1974 .