Real-time monitoring technology in single-case experimental design research: Opportunities and challenges.

Single-case experimental design (SCED) is a rigorous method of studying behavior and behavior change. A key characteristic of SCED is repeated, systematic assessment of outcome variables, which is critical to achieving high internal validity, collecting a sufficient number of observations to conduct adequately powered statistical analyses, capturing dynamic and fine-grained changes in outcomes, and tailoring interventions at the individual level. Recent advances in real-time monitoring technology, such as digital ecological momentary assessment, passive smartphone-based behavioral tracking, and physiological assessment with wearable biosensors, are extremely well-suited to conducting these repeated, systematic measurements. Here, we discuss the rationale for incorporating real-time data collection technologies within SCED and highlight how recent studies have paired SCED with real-time monitoring. We also present original data illustrating how real-time digital monitoring can provide an idiographic and granular view of behavior (in this case, suicidal ideation). Last, we discuss the challenges of, and offer our recommendations for, using real-time monitoring technologies in SCED research.

[1]  Phill Gagné,et al.  Augmenting Visual Analysis in Single-Case Research With Hierarchical Linear Modeling , 2013, Behavior modification.

[2]  John Torous,et al.  Creating boundaries to empower digital health technology , 2018, BJPsych Open.

[3]  Rosalind W. Picard,et al.  Digital phenotyping of suicidal thoughts , 2018, Depression and anxiety.

[4]  Marieke Wichers,et al.  Critical Slowing Down as a Personalized Early Warning Signal for Depression , 2016, Psychotherapy and Psychosomatics.

[5]  M. Nock,et al.  Advances in Scientific Possibilities Offered by Real-Time Monitoring Technology , 2017, Psychiatry.

[6]  John Torous,et al.  New Tools for New Research in Psychiatry: A Scalable and Customizable Platform to Empower Data Driven Smartphone Research , 2016, JMIR mental health.

[7]  D. Hurley,et al.  Objective measurements of sleep for non‐laboratory settings as alternatives to polysomnography – a systematic review , 2011, Journal of Sleep Research.

[8]  Chia-Yen Chen,et al.  Testing Causal Bidirectional Influences between Physical Activity and Depression using Mendelian Randomization , 2018, bioRxiv.

[9]  R. Steele,et al.  An evaluation of a personal electronic device to enhance self-monitoring adherence in a pediatric weight management program using a multiple baseline design. , 2011, Journal of pediatric psychology.

[10]  D Aldridge.  Single-Case Research Designs for the Clinician , 1991, Journal of the Royal Society of Medicine.

[11]  Tyler B. Wray,et al.  Using Ecological Momentary Assessment (EMA) to Assess Situation-Level Predictors of Alcohol Use and Alcohol-Related Consequences , 2014, Alcohol research : current reviews.

[12]  John Torous,et al.  Needed Innovation in Digital Health and Smartphone Applications for Mental Health: Transparency and Trust. , 2017, JAMA psychiatry.

[13]  Ulrich Ebner-Priemer,et al.  The Role of Ambulatory Assessment in Psychological Science , 2014, Current directions in psychological science.

[14]  Alan E. Kazdin,et al.  Single-Case Research Designs: Methods for Clinical and Applied Settings , 2010 .

[15]  Glenn Lawyer,et al.  Exploring the Idiographic Dynamics of Mood and Anxiety via Network Analysis , 2017, Journal of abnormal psychology.

[16]  Roger Vilardaga,et al.  The promise of mobile technologies and single case designs for the study of individuals in their natural environment. , 2014, Journal of contextual behavioral science.

[17]  Frederick J Muench,et al.  Ecological Momentary Assessment and Alcohol Use Disorder Treatment , 2014, Alcohol research : current reviews.

[18]  Alan E Kazdin,et al.  Single-case experimental designs. Evaluating interventions in research and clinical practice. , 2019, Behaviour research and therapy.

[19]  J. Os,et al.  Momentary assessment technology as a tool to help patients with depression help themselves , 2011, Acta psychiatrica Scandinavica.

[20]  Jonathan J. Evans,et al.  The Single-Case Reporting Guideline In BEhavioural Interventions (SCRIBE) 2016 Statement , 2016, Physical Therapy.

[21]  Peter M Yellowlees,et al.  To Use or Not? Evaluating ASPECTS of Smartphone Apps and Mobile Technology for Clinical Care in Psychiatry. , 2016, The Journal of clinical psychiatry.

[22]  N. Bolger,et al.  Diary methods: capturing life as it is lived. , 2003, Annual review of psychology.

[23]  A. Kazdin,et al.  Reactive self-monitoring: the effects of response desirability, goal setting, and feedback. , 1974, Journal of consulting and clinical psychology.

[24]  Andrew J. Callaway,et al.  Increasing walking among older people: A test of behaviour change techniques using factorial randomised N-of-1 trials , 2015, Psychology & health.

[25]  D. Ebert,et al.  Reactivity to smartphone-based ecological momentary assessment of depressive symptoms (MoodMonitor): protocol of a randomised controlled trial , 2016, BMC Psychiatry.

[26]  M. Sevick,et al.  Self-monitoring in weight loss: a systematic review of the literature. , 2011, Journal of the American Dietetic Association.

[27]  Wolfgang Viechtbauer,et al.  The experience sampling method as an mHealth tool to support self‐monitoring, self‐insight, and personalized health care in clinical practice , 2017, Depression and anxiety.

[28]  Virginia Pensabene,et al.  Assessment of the Fitbit Charge 2 for monitoring heart rate , 2018, PloS one.

[29]  M. Nock,et al.  A Functional Analysis of Two Transdiagnostic, Emotion-Focused Interventions on Nonsuicidal Self-Injury , 2017, Journal of consulting and clinical psychology.

[30]  S. Shiffman,et al.  Reactivity to ecological momentary assessment: an example using undergraduate problem drinkers. , 2002, Psychology of addictive behaviors : journal of the Society of Psychologists in Addictive Behaviors.

[31]  Andrew T. Campbell,et al.  Next-generation psychiatric assessment: Using smartphone sensors to monitor behavior and mental health. , 2015, Psychiatric rehabilitation journal.

[32]  E. Hamaker,et al.  No Time Like the Present , 2017 .

[33]  Jeff Huang,et al.  SleepCoacher: A Personalized Automated Self-Experimentation System for Sleep Recommendations , 2016, UIST.

[34]  John Torous,et al.  Utilizing a Personal Smartphone Custom App to Assess the Patient Health Questionnaire-9 (PHQ-9) Depressive Symptoms in Patients With Major Depressive Disorder , 2015, JMIR mental health.

[35]  Jesse Dallery,et al.  Internet-based contingency management to improve adherence with blood glucose testing recommendations for teens with type 1 diabetes. , 2010, Journal of applied behavior analysis.

[36]  Jonathan Rose,et al.  Patient Willingness to Consent to Mobile Phone Data Collection for Mental Health Apps: Structured Questionnaire , 2018, JMIR mental health.

[37]  Joseph E. Schwartz,et al.  Intensive momentary reporting of pain with an electronic diary: reactivity, compliance, and patient satisfaction , 2003, Pain.

[38]  Matthew K Nock,et al.  Examination of Real-Time Fluctuations in Suicidal Ideation and Its Risk Factors: Results From Two Ecological Momentary Assessment Studies , 2017, Journal of abnormal psychology.

[39]  A. Kazdin.  Mediators and mechanisms of change in psychotherapy research. , 2007, Annual review of clinical psychology.

[40]  C. Thiele,et al.  Diaries in clinical psychology and psychotherapy: a selective review , 2002 .

[41]  K. C. Fernandez,et al.  Development and initial implementation of the Dynamic Assessment Treatment Algorithm (DATA) , 2017, PloS one.

[42]  D. Kahneman,et al.  Duration neglect in retrospective evaluations of affective episodes. , 1993, Journal of personality and social psychology.

[43]  Justin D. Smith,et al.  Single-case experimental designs: a systematic review of published research and current standards. , 2012, Psychological methods.

[44]  Eva Ceulemans,et al.  Assessing Temporal Emotion Dynamics Using Networks , 2016, Assessment.

[45]  S. Shiffman,et al.  Ecological momentary assessment. , 2008, Annual review of clinical psychology.

[46]  M. Tremblay,et al.  A comparison of direct versus self-report measures for assessing physical activity in adults: a systematic review , 2008, The international journal of behavioral nutrition and physical activity.

[47]  R. Furberg,et al.  Systematic review of the validity and reliability of consumer-wearable activity trackers , 2015, International Journal of Behavioral Nutrition and Physical Activity.

[48]  Revealing the form and function of self-injurious thoughts and behaviors: A real-time ecological assessment study among adolescents and young adults , 2010 .

[49]  S. Epskamp,et al.  Dynamic networks of PTSD symptoms during conflict , 2018, Psychological Medicine.

[50]  D. Wetter,et al.  Evaluating reactivity to ecological momentary assessment during smoking cessation. , 2007, Experimental and clinical psychopharmacology.

[51]  Justin Presseau,et al.  Testing self-regulation interventions to increase walking using factorial randomized N-of-1 trials. , 2012, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[52]  Lucy Yardley,et al.  Opportunities and challenges for smartphone applications in supporting health behavior change , 2013 .

[53]  Aaron J Fisher,et al.  Enhancing the Personalization of Psychotherapy With Dynamic Assessment and Modeling , 2016, Assessment.

[54]  Matthew P. Normand.  Less Is More: Psychologists Can Learn More by Studying Fewer People , 2016, Front. Psychol..

[55]  Elizabeth M. Pratt,et al.  Motivational Text Message Intervention for Eating Disorders: A Single-Case Alternating Treatment Design Using Ecological Momentary Assessment. , 2016, Behavior therapy.

[56]  Robin K. Morgan,et al.  Single-participant research design. Bringing science to managed care. , 2001, The American psychologist.

[57]  Akane Sano,et al.  QuantifyMe: An Open-Source Automated Single-Case Experimental Design Platform † , 2018, Sensors.

[58]  J. D. Runyan,et al.  A Smartphone Ecological Momentary Assessment/Intervention “App” for Collecting Real-Time Data and Promoting Self-Awareness , 2013, PloS one.

[59]  M. Keshavan,et al.  New dimensions and new tools to realize the potential of RDoC: digital phenotyping via smartphones and connected devices , 2017, Translational Psychiatry.

[60]  Lucy Yardley,et al.  Opportunities and Challenges for Smartphone Applications in Supporting Health Behavior Change: Qualitative Study , 2013, Journal of medical Internet research.

[61]  Jesse Dallery,et al.  A web-based contingency management program with adolescent smokers. , 2008, Journal of applied behavior analysis.

[62]  Danielle E. McCarthy,et al.  An experimental investigation of reactivity to ecological momentary assessment frequency among adults trying to quit smoking. , 2015, Addiction.

[63]  Jonathan J. Evans,et al.  The Single-Case Reporting guideline In BEhavioural interventions (SCRIBE) 2016 statement. , 2016, Journal of school psychology.

[64]  Alan E. Kazdin,et al.  Single-Case Research Designs , 1982 .

[65]  K Ryon,et al.  Major Depressive Disorder , 2014 .

[66]  Helen Christensen,et al.  Using Mobile Phone Sensor Technology for Mental Health Research: Integrated Analysis to Identify Hidden Challenges and Potential Solutions , 2018, Journal of medical Internet research.