Using Mobile-Technology-Based Ecological Momentary Assessment (EMA) Methods With Youth: A Systematic Review and Recommendations

Ecological momentary assessment (EMA) methods are increasingly used in social and health sciences, but the feasibility and best practices for using EMA with youth are not yet clear. We conducted a systematic review of studies that used self-report EMA methods with youth; the goal was to identify common approaches and challenges to implementation and develop recommendations for future research. We examined 54 peer-reviewed papers that reported on 24 unique studies. Papers were evaluated using a standardized, three-dimensional coding scheme focused on the following: (1) sample characteristics; (2) EMA data collection methods (sampling duration, frequency, hardware/software); (3) study implementation methods (technical/logistical challenges, training participants, compliance). Overall, the research suggests EMA can be successfully implemented with youth (age ∼ ≥7) from diverse backgrounds, but protocol adaptations may be necessary for younger children. Study design and implementation challenges and recommendations for research on youth are provided.

[1]  Lori N. Scott,et al.  Daily shame and hostile irritability in adolescent girls with borderline personality disorder symptoms. , 2015, Personality disorders.

[2]  Lei Zhang,et al.  Teenagers and Texting: Use of a Youth Ecological Momentary Assessment System in Trajectory Health Research With Latina Adolescents , 2014, JMIR mHealth and uHealth.

[3]  Nicole Brown,et al.  Piloting the use of experience sampling method to investigate the everyday social experiences of children with Asperger syndrome/high functioning autism , 2014, Developmental neurorehabilitation.

[4]  R. Dahl,et al.  Parental autonomy granting and child perceived control: effects on the everyday emotional experience of anxious youth. , 2016, Journal of child psychology and psychiatry, and allied disciplines.

[5]  K. Gil,et al.  Self‐Reported Pain and Disease Symptoms Persist in Juvenile Idiopathic Arthritis Despite Treatment Advances: An Electronic Diary Study , 2014, Arthritis & rheumatology.

[6]  M. Phillips,et al.  Healthy adolescents' neural response to reward: associations with puberty, positive affect, and depressive symptoms. , 2010, Journal of the American Academy of Child and Adolescent Psychiatry.

[7]  K. Gil,et al.  Emotion regulation predicts pain and functioning in children with juvenile idiopathic arthritis , 2012, Pediatric Rheumatology.

[8]  S. Shiffman,et al.  Capturing momentary, self-report data: A proposal for reporting guidelines , 2002, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[9]  Donald Hedeker,et al.  Momentary assessment of affect, physical feeling states, and physical activity in children. , 2014, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[10]  Kevin B. Johnson,et al.  Using mobile phones to measure adolescent diabetes adherence. , 2012, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[11]  Greg J Siegle,et al.  Emotional reactivity and regulation in anxious and nonanxious youth: a cell-phone ecological momentary assessment study. , 2012, Journal of child psychology and psychiatry, and allied disciplines.

[12]  Kristin E Heron,et al.  Is providing mobile interventions "just-in-time" helpful? an experimental proof of concept study of just-in-time intervention for stress management , 2016, 2016 IEEE Wireless Health (WH).

[13]  R. Dahl,et al.  Co-rumination and co-problem solving in the daily lives of adolescents with major depressive disorder. , 2014, Journal of the American Academy of Child and Adolescent Psychiatry.

[14]  Audie A Atienza,et al.  The Science of Real-Time Data Capture: Self-Reports in Health Research , 2007 .

[15]  J. Johnston,et al.  Toward Mapping Daily Challenges of Living with ADHD: Maternal and Child Perspectives Using Electronic Diaries , 2006, Journal of abnormal child psychology.

[16]  Stephen S. Intille,et al.  Using Ecological Momentary Assessment to Understand Where and With Whom Adults’ Physical and Sedentary Activity Occur , 2015, International Journal of Behavioral Medicine.

[17]  Sabine Schulze,et al.  The Science Of Real Time Data Capture Self Reports In Health Research , 2016 .

[18]  Genevieve Fridlund Dunton,et al.  Assessing the Social and Physical Contexts of Children's Leisure-Time Physical Activity: An Ecological Momentary Assessment Study , 2012, American journal of health promotion : AJHP.

[19]  W. Thompson,et al.  Daily emotional dynamics in depressed youth: a cell phone ecological momentary assessment study. , 2011, Journal of experimental child psychology.

[20]  Wendy Nilsen,et al.  Dynamic Models of Behavior for Just-in-Time Adaptive Interventions , 2014, IEEE Pervasive Computing.

[21]  F. Schmiedek,et al.  Cognitive benefits of last night's sleep: daily variations in children's sleep behavior are related to working memory fluctuations. , 2015, Journal of child psychology and psychiatry, and allied disciplines.

[22]  Genevieve F Dunton,et al.  Investigating the impact of a smart growth community on the contexts of children's physical activity using Ecological Momentary Assessment. , 2012, Health & place.

[23]  K. Gil,et al.  Brief Report: Daily Mood as a Mediator or Moderator of the Pain–Sleep Relationship in Children with Sickle Cell Disease , 2007 .

[24]  S. Reid,et al.  Coping, Daily Hassles and Behavior and Emotional Problems in Adolescents with High-Functioning Autism/Asperger’s Disorder , 2013, Journal of Autism and Developmental Disorders.

[25]  J. Smyth,et al.  Ecological Momentary Assessment Research in Behavioral medicine , 2003 .

[26]  E. Westling,et al.  Concurrent and predictive associations between early adolescent perceptions of peer affiliates and mood states collected in real time via ecological momentary assessment methodology. , 2013, Psychological assessment.

[27]  L. Goossens,et al.  Loneliness in the Daily Lives of Adolescents , 2015 .

[28]  Lena Sanci,et al.  Investigating the utility of mobile phones for collecting data about adolescent alcohol use and related mood, stress and coping behaviours: lessons and recommendations. , 2009, Drug and alcohol review.

[29]  R. Dahl,et al.  Measuring mood and complex behavior in natural environments: use of ecological momentary assessment in pediatric affective disorders. , 2003, Journal of child and adolescent psychopharmacology.

[30]  Eldin Dzubur,et al.  Momentary Assessment of Psychosocial Stressors, Context, and Asthma Symptoms in Hispanic Adolescents , 2016, Behavior modification.

[31]  Mirka Koro-Ljungberg,et al.  African-American Teenagers’ Stories of Attention Deficit/Hyperactivity Disorder , 2008 .

[32]  R. Cordier,et al.  A preliminary study on the reliability and validity of using experience sampling method in children with autism spectrum disorders , 2015, Developmental neurorehabilitation.

[33]  K. Gil,et al.  Emotion regulation predicts pain and functioning in children with juvenile idiopathic arthritis , 2012, Pediatric Rheumatology.

[34]  Stephen S. Intille,et al.  Children's perceptions of physical activity environments captured through ecological momentary assessment: a validation study. , 2012, Preventive medicine.

[35]  R. Rende,et al.  Capturing Rule Breaking Behavior between Siblings in Real Time and Everyday Settings. , 2009 .

[36]  L. Goossens,et al.  Loneliness, Affect, and Adolescents' Appraisals of Company : An Experience Sampling Method Study , 2014 .

[37]  M. Sliwinski Measurement-Burst Designs for Social Health Research , 2008 .

[38]  R. Dahl,et al.  The bidirectional association between daytime affect and nighttime sleep in youth with anxiety and depression. , 2011, Journal of pediatric psychology.

[39]  S. Reid,et al.  Feasibility and validity of ecological momentary assessment in adolescents with high-functioning autism and Asperger's disorder. , 2014, Journal of adolescence.

[40]  S. Booth,et al.  Emerging methods in family research , 2014 .

[41]  R. Hardeman,et al.  Latina adolescent sleep and mood: an ecological momentary assessment pilot study. , 2014, Journal of child and adolescent psychiatric nursing : official publication of the Association of Child and Adolescent Psychiatric Nurses, Inc.

[42]  R. Dahl,et al.  Caffeine consumption, sleep, and affect in the natural environments of depressed youth and healthy controls. , 2007, Journal of pediatric psychology.

[43]  C. Elliott,et al.  Assessment of children's distress during painful medical procedures. , 1983 .

[44]  K. Gil,et al.  Prospective Mediation Models of Sleep, Pain, and Daily Function in Children With Arthritis Using Ecological Momentary Assessment , 2016, The Clinical journal of pain.

[45]  W. Nilsen,et al.  Health behavior models in the age of mobile interventions: are our theories up to the task? , 2011, Translational behavioral medicine.

[46]  R. Engels,et al.  Associations between interpersonal relationships and negative affect in adolescents: An Experience Sampling Study on the Role of Trait Coping , 2016 .

[47]  Bambang Parmanto,et al.  The SmartCAT: an m-health platform for ecological momentary intervention in child anxiety treatment. , 2014, Telemedicine journal and e-health : the official journal of the American Telemedicine Association.

[48]  Joshua M. Smyth,et al.  Ecological Momentary Assessment (EMA) in Family Research , 2014 .

[49]  R. Dahl,et al.  Real-world affect and social context as predictors of treatment response in child and adolescent depression and anxiety: an ecological momentary assessment study. , 2012, Journal of child and adolescent psychopharmacology.

[50]  R. Dahl,et al.  Reduced reward anticipation in youth at high-risk for unipolar depression: A preliminary study , 2013, Developmental Cognitive Neuroscience.

[51]  Greg J Siegle,et al.  Pupillary reactivity to emotional information in child and adolescent depression: links to clinical and ecological measures. , 2007, The American journal of psychiatry.

[52]  D. Spruijt-Metz,et al.  Investigating Children's Physical Activity and Sedentary Behavior Using Ecological Momentary Assessment With Mobile Phones , 2011, Obesity.

[53]  N. Bolger,et al.  Intensive Longitudinal Methods: An Introduction to Diary and Experience Sampling Research , 2013 .

[54]  N. Niven,et al.  Health psychology. , 1982, Nursing times.

[55]  J. Smyth,et al.  Ecological momentary interventions: incorporating mobile technology into psychosocial and health behaviour treatments. , 2010, British journal of health psychology.

[56]  K. Zadnik,et al.  Comparison of the experience sampling method and questionnaires to assess visual activities in pre‐teen and adolescent children * , 2006, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[57]  R. Slatcher,et al.  Preschoolers' everyday conflict at home and diurnal cortisol patterns. , 2012, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[58]  E. Westling,et al.  Psychosocial Correlates of Physical and Sedentary Activities of Early Adolescent Youth , 2014, Health education & behavior : the official publication of the Society for Public Health Education.

[59]  Steven C Martino,et al.  Middle and high school students' exposure to alcohol- and smoking-related media: a pilot study using ecological momentary assessment. , 2013, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[60]  A. Hariri,et al.  Altered striatal activation predicting real-world positive affect in adolescent major depressive disorder. , 2009, The American journal of psychiatry.

[61]  L. Goossens,et al.  The Oxytocin Receptor Gene (OXTR) in Relation to State Levels of Loneliness in Adolescence: Evidence for Micro-Level Gene-Environment Interactions , 2013, PloS one.

[62]  S. Shiffman,et al.  Reactivity to ecological momentary assessment: an example using undergraduate problem drinkers. , 2002, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[63]  G. Dunton,et al.  Association of usual self-reported dietary intake with ecological momentary measures of affective and physical feeling states in children , 2015, Appetite.

[64]  Candice L Odgers,et al.  Witnessing substance use increases same-day antisocial behavior among at-risk adolescents: Gene–environment interaction in a 30-day ecological momentary assessment study , 2015, Development and Psychopathology.

[65]  William G Shadel,et al.  Using ecological momentary assessment to determine media use by individuals with and without major depressive disorder. , 2011, Archives of pediatrics & adolescent medicine.

[66]  S. Shiffman,et al.  Understanding recall of weekly pain from a momentary assessment perspective: absolute agreement, between- and within-person consistency, and judged change in weekly pain , 2004, Pain.

[67]  Ronald E. Dahl,et al.  Sad Kids, Sad Media? Applying Mood Management Theory to Depressed Adolescents' Use of Media , 2008, Media psychology.

[68]  S. Reid,et al.  Temporal mood changes associated with different levels of adolescent drinking: using mobile phones and experience sampling methods to explore motivations for adolescent alcohol use. , 2013, Drug and alcohol review.

[69]  Paul P Stork,et al.  A randomized trial of electronic versus paper pain diaries in children: impact on compliance, accuracy, and acceptability , 2004, Pain.

[70]  F. Schmiedek,et al.  The interplay between sleep behavior and affect in elementary school children's daily life. , 2016, Journal of experimental child psychology.

[71]  M. Mehl,et al.  Handbook of research methods for studying daily life , 2012 .

[72]  J. Mennis,et al.  Real-Time Readiness to Quit and Peer Smoking within a Text Message Intervention for Adolescent Smokers: Modeling Mechanisms of Change. , 2015, Journal of substance abuse treatment.

[73]  George C. Patton,et al.  A mobile phone program to track young people’s experiences of mood, stress and coping , 2009, Social Psychiatry and Psychiatric Epidemiology.

[74]  Y. Liao,et al.  A Systematic Review of Methods and Procedures Used in Ecological Momentary Assessments of Diet and Physical Activity Research in Youth: An Adapted STROBE Checklist for Reporting EMA Studies (CREMAS) , 2016, Journal of medical Internet research.

[75]  W Scott Comulada,et al.  Compliance to Cell Phone-Based EMA Among Latino Youth in Outpatient Treatment , 2015, Journal of ethnicity in substance abuse.

[76]  J. Mennis,et al.  The Dynamic Role of Urban Neighborhood Effects in a Text-Messaging Adolescent Smoking Intervention. , 2016, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[77]  K. Gil,et al.  Daily mood as a mediator or moderator of the pain-sleep relationship in children with sickle cell disease. , 2008, Journal of pediatric psychology.

[78]  Genevieve F Dunton,et al.  Physical and social contextual influences on children's leisure-time physical activity: an ecological momentary assessment study. , 2011, Journal of physical activity & health.

[79]  W. Rief,et al.  Loss of control eating and psychological maintenance in children: an ecological momentary assessment study. , 2009, Behaviour research and therapy.

[80]  Joseph E. Schwartz,et al.  Intensive momentary reporting of pain with an electronic diary: reactivity, compliance, and patient satisfaction , 2003, Pain.

[81]  Greg J Siegle,et al.  Peer acceptance and rejection through the eyes of youth: pupillary, eyetracking and ecological data from the Chatroom Interact task. , 2012, Social cognitive and affective neuroscience.

[82]  M. Csíkszentmihályi,et al.  Validity and Reliability of the Experience‐Sampling Method , 1987, The Journal of nervous and mental disease.