Students' Experiences with Ecological Momentary Assessment Tools to Report on Emotional Well-being

Ecological Momentary Assessment (EMA) methods have emerged as an approach that enhances the ecological validity of data collected for the study of human behavior and experience. In particular, EMA methods are used to capture individuals' experiences (e.g., symptoms, affect, and behaviors) in real-world contexts and in near-real time. However, work investigating participants' experiences in EMA studies and in particular, how these experiences may influence the collected data, is limited. We conducted in-depth focus groups with 32 participants following an EMA study on mental well-being in college students. In doing so, we probed how the elicitation of high-quality, reflective responses is related to the design of EMA interactions. Through our study, we distilled three primary considerations for designing EMA interactions, based on observations of 1) response strategies to repeated questions, 2) the perceived burden of EMA prompts, and 3) challenges to the validity and robustness of EMA data. We present these considerations in the context of two microinteraction-based EMA approaches that we tested: lock-screen EMA and image-based question prompts. We conclude by characterizing design tensions in the presentation and delivery of EMA prompts, and outline directions for future work to address these tensions.

[1]  Deborah Estrin,et al.  AndWellness: an open mobile system for activity and experience sampling , 2010, Wireless Health.

[2]  D. Moskowitz,et al.  Ecological momentary assessment: what it is and why it is a method of the future in clinical psychopharmacology. , 2006, Journal of psychiatry & neuroscience : JPN.

[3]  Denzil Ferreira,et al.  AWARE: Mobile Context Instrumentation Framework , 2015, Front. ICT.

[4]  James Fogarty,et al.  Examining Unlock Journaling with Diaries and Reminders for In Situ Self-Report in Health and Wellness , 2016, CHI.

[5]  Fanglin Chen,et al.  StudentLife: assessing mental health, academic performance and behavioral trends of college students using smartphones , 2014, UbiComp.

[6]  James A. Landay,et al.  Increasing the breadth: applying sensors, inference and self-report in field studies with the MyExperience tool , 2007, MobiEval '07.

[7]  Michael S. Bernstein,et al.  Twitch crowdsourcing: crowd contributions in short bursts of time , 2014, CHI.

[8]  Andrew T. Campbell,et al.  BeWell: Sensing Sleep, Physical Activities and Social Interactions to Promote Wellbeing , 2014, Mobile Networks and Applications.

[9]  S. Nolen-Hoeksema,et al.  The influence of context on the implementation of adaptive emotion regulation strategies. , 2012, Behaviour research and therapy.

[10]  Michael D. Robinson,et al.  Episodic and semantic knowledge in emotional self-report: evidence for two judgment processes. , 2002, Journal of personality and social psychology.

[11]  Jon A. Krosnick,et al.  The Future of Survey Research: Challenges and Opportunities , 2015 .

[12]  John P. Pollak,et al.  PAM: a photographic affect meter for frequent, in situ measurement of affect , 2011, CHI.

[13]  Daniel McDuff,et al.  Wearable ESM: differences in the experience sampling method across wearable devices , 2016, MobileHCI.

[14]  Vicki G. Morwitz,et al.  The Effect of Measuring Intent on Brand-Level Purchase Behavior , 1996 .

[15]  Vicki G. Morwitz,et al.  Does Measuring Intent Change Behavior , 1993 .

[16]  Xia Zhou,et al.  SmartGPA: how smartphones can assess and predict academic performance of college students , 2015, GETMBL.

[17]  E. Diener,et al.  Experience Sampling: Promises and Pitfalls, Strengths and Weaknesses , 2003 .

[18]  Jakob E. Bardram,et al.  The MONARCA self-assessment system: a persuasive personal monitoring system for bipolar patients , 2012, IHI '12.

[19]  S. Shiffman,et al.  Ecological momentary assessment. , 2008, Annual review of clinical psychology.

[20]  D. Kahneman,et al.  Developments in the Measurement of Subjective Well-Being , 2006 .

[21]  Aditya Ponnada,et al.  μEMA: Microinteraction-based ecological momentary assessment (EMA) using a smartwatch , 2016, UbiComp.

[22]  Deborah Estrin,et al.  Center of excellence for mobile sensor data-to-knowledge (MD2K) , 2015, J. Am. Medical Informatics Assoc..

[23]  Sunny Consolvo,et al.  Using the Experience Sampling Method to Evaluate Ubicomp Applications , 2003, IEEE Pervasive Comput..

[24]  L. Wheeler,et al.  Self‐Recording of Everyday Life Events: Origins, Types, and Uses , 1991 .

[25]  B. Löwe,et al.  An ultra-brief screening scale for anxiety and depression: the PHQ-4. , 2009, Psychosomatics.

[26]  Ross A. Thompson,et al.  Emotion regulation: Conceptual foundations , 2007 .

[27]  J. Krosnick Response strategies for coping with the cognitive demands of attitude measures in surveys , 1991 .

[28]  Gillian R. Hayes,et al.  Estrellita , 2014, ACM Trans. Comput. Hum. Interact..

[29]  T. Heatherton,et al.  Cognitive neuroscience of self-regulation failure , 2011, Trends in Cognitive Sciences.

[30]  Andrew T. Campbell,et al.  Bewell: A smartphone application to monitor, model and promote wellbeing , 2011, PervasiveHealth 2011.

[31]  Daniel Ashbrook Enabling mobile microinteractions , 2010 .

[32]  James A. Landay,et al.  Conducting In Situ Evaluations for and With Ubiquitous Computing Technologies , 2007, Int. J. Hum. Comput. Interact..

[33]  Ling Bao,et al.  A context-aware experience sampling tool , 2003, CHI Extended Abstracts.

[34]  S. Merriam Qualitative research in practice : examples for discussion and analysis , 2002 .

[35]  Michael E. Labhard,et al.  Mobile Therapy: Case Study Evaluations of a Cell Phone Application for Emotional Self-Awareness , 2010, Journal of medical Internet research.

[36]  Daniel J. Wigdor,et al.  Slide to X: unlocking the potential of smartphone unlocking , 2014, CHI.

[37]  Rui Wang,et al.  Using Smartphones to Collect Behavioral Data in Psychological Science , 2016, Perspectives on psychological science : a journal of the Association for Psychological Science.

[38]  Aditya Ponnada,et al.  Microinteraction Ecological Momentary Assessment Response Rates , 2017, Proc. ACM Interact. Mob. Wearable Ubiquitous Technol..