Challenges and solutions for N-of-1 design studies in health psychology

ABSTRACT Theories of behaviour change and health behaviour change interventions are most often evaluated in between-person designs. However, behaviour change theories apply to individuals not groups and behavioural interventions ultimately aim to achieve within-person rather than between-group change. Within-person methodology, such as N-of-1 (also known as single case design), can circumvent this issue, though has multiple design-specific challenges. This paper provides a conceptual review of the challenges and potential solutions for undertaking N-of-1 studies in health psychology. Key challenges identified include participant adherence to within-person protocols, carry-over and slow onset effects, suitability of behaviour change techniques for evaluation in N-of-1 experimental studies, optimal allocation sequencing and blinding, calculating power/sample size, and choosing the most suitable analysis approach. Key solutions include involving users in study design, employing recent technologies for unobtrusive data collection and problem solving by design. Within-person designs share common methodological requirements with conventional between-person designs but require specific methodological considerations. N-of-1 evaluation designs are appropriate for many though not all types of interventions. A greater understanding of patterns of behaviours and factors influencing behaviour change at the within-person level is required to progress health psychology into a precision science. Video abstract: Supplementary Material 1.

[1]  F. Sniehotta,et al.  Data-Prompted Interviews: Using Individual Ecological Data to Stimulate Narratives and Explore Meanings , 2015, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[2]  C. Depp,et al.  Ecological momentary assessment in aging research: a critical review. , 2009, Journal of psychiatric research.

[3]  Douglas G Altman,et al.  Meta-analyses involving cross-over trials: methodological issues. , 2002, International journal of epidemiology.

[4]  Scott M. Hofer,et al.  Longitudinal data analysis : a practical guide for researchers in aging, health, and social sciences , 2013 .

[5]  J. Walters,et al.  Compliance with an EMA monitoring protocol and its relationship with participant and smoking characteristics. , 2014, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[6]  J. Newsom Missing Data and Attrition , 2015 .

[7]  D. Johnston,et al.  Useful theories should apply to individuals. , 2013, British journal of health psychology.

[8]  D. Rubin INFERENCE AND MISSING DATA , 1975 .

[9]  S. Satya‐Murti Evidence-based Medicine: How to Practice and Teach EBM , 1997 .

[10]  James W. Pennebaker,et al.  Linguistic Inquiry and Word Count (LIWC2007) , 2007 .

[11]  Y. Benjamini,et al.  Controlling the false discovery rate: a practical and powerful approach to multiple testing , 1995 .

[12]  Jos Twisk,et al.  Attrition in longitudinal studies. How to deal with missing data. , 2002, Journal of clinical epidemiology.

[13]  Anthony Kent,et al.  Co-Designing for Care: Craft and Wearable Wellbeing , 2018 .

[14]  Xinlin Chen,et al.  A Comparison of Four Methods for the Analysis of N-of-1 Trials , 2014, PloS one.

[15]  Ciara Masterson,et al.  Statistical analysis of single-case data , 2017 .

[16]  S. Rauch,et al.  Harnessing Smartphone-Based Digital Phenotyping to Enhance Behavioral and Mental Health , 2016, Neuropsychopharmacology.

[17]  Stacey B. Daughters,et al.  ACT HEALTHY: A Combined Cognitive-Behavioral Depression and Medication Adherence Treatment for HIV-Infected Substance Users. , 2010, Cognitive and behavioral practice.

[18]  D. Johnston,et al.  A starter kit for undertaking n-of-1 trials , 2014 .

[19]  Jaakko Niklas Ravaja,et al.  A Personalised, Sensor-Based Smart Phone Intervention for Physical Activity and Diet: PRECIOUS N-of-1 Trial , 2016 .

[20]  J E Janosky,et al.  Use of the single subject design for practice based primary care research , 2005, Postgraduate Medical Journal.

[21]  K. Davidson,et al.  Personalizing Behavioral Interventions Through Single-Patient (N-of-1) Trials. , 2014, Social and personality psychology compass.

[22]  Hazel Doughty,et al.  StopWatch: The Preliminary Evaluation of a Smartwatch-Based System for Passive Detection of Cigarette Smoking , 2018, Nicotine & tobacco research : official journal of the Society for Research on Nicotine and Tobacco.

[23]  L. Hood,et al.  Predictive, personalized, preventive, participatory (P4) cancer medicine , 2011, Nature Reviews Clinical Oncology.

[24]  R. Senf Tactics of Scientific Research: Evaluating Experimental Data in Psychology , 1962 .

[25]  M. Munafo,et al.  Robust research needs many lines of evidence , 2018, Nature.

[26]  G H Guyatt,et al.  Users' guides to the medical literature: XXII: how to use articles about clinical decision rules. Evidence-Based Medicine Working Group. , 2000, JAMA.

[27]  M. Petticrew,et al.  Developing and evaluating complex interventions: the new Medical Research Council guidance , 2008, BMJ : British Medical Journal.

[28]  Juan Jimenez Garcia Beyond the numbers - a user-centered design approach for personal reflective healthcare technologies , 2014 .

[29]  D. Johnston,et al.  The state of the art and future opportunities for using longitudinal n-of-1 methods in health behaviour research: a systematic literature overview , 2017, Health psychology review.

[30]  Jesse Dallery,et al.  A New Frontier: Integrating Behavioral and Digital Technology to Promote Health Behavior , 2014, The Behavior Analyst.

[31]  D. Spruijt-Metz,et al.  Compliance With Mobile Ecological Momentary Assessment Protocols in Children and Adolescents: A Systematic Review and Meta-Analysis , 2017, Journal of medical Internet research.

[32]  Christopher H. Schmid,et al.  Single-patient (n-of-1) trials: a pragmatic clinical decision methodology for patient-centered comparative effectiveness research. , 2013, Journal of clinical epidemiology.

[33]  C. Abraham,et al.  The Behavior Change Technique Taxonomy (v1) of 93 Hierarchically Clustered Techniques: Building an International Consensus for the Reporting of Behavior Change Interventions , 2013, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[34]  C. Crick,et al.  Goal feedback from whom? A physical activity intervention using an N-of-1 RCT , 2018, Psychology & health.

[35]  Emma Garnett,et al.  ‘quantified lives and vital data: exploring health and technology through personal medical devices’. 2018. Editors: Lynch, Rebecca, Farrington, Conor (Eds.). Palgrave Macmillan , 2019, Anthropology and Medicine.

[36]  A. Rigby Cross‐over Trials in Clinical Research , 2003 .

[37]  N. Schork,et al.  The n-of-1 clinical trial: the ultimate strategy for individualizing medicine? , 2011, Personalized medicine.

[38]  Sunmoo Yoon,et al.  Using Behavioral Analytics to Increase Exercise: A Randomized N-of-1 Study. , 2018, American journal of preventive medicine.

[39]  J. Graham,et al.  Missing data analysis: making it work in the real world. , 2009, Annual review of psychology.

[40]  Jean-Philippe Laurenceau,et al.  Power analysis for intensive longitudinal studies. , 2012 .

[41]  D. Barlow,et al.  Single Case Experimental Designs: Strategies for Studying Behavior Change , 1976 .

[42]  C. Mascolo,et al.  A Context-Sensing Mobile Phone App (Q Sense) for Smoking Cessation: A Mixed-Methods Study , 2016, JMIR mHealth and uHealth.

[43]  Ken P Kleinman,et al.  Much Ado About Nothing , 2007, The American statistician.

[44]  J. Smit,et al.  Attrition in the Longitudinal Aging Study Amsterdam. The effect of differential inclusion in side studies. , 2002, Journal of clinical epidemiology.

[45]  E S Edgington,et al.  Randomized single-subject experimental designs. , 1996, Behaviour research and therapy.

[46]  K. Sainsbury,et al.  Challenges and proposed solutions for formative research to inform systematic intervention development in rare and unstudied conditions: The case example of Xeroderma Pigmentosum , 2017, British journal of health psychology.

[47]  Floor Sieverink,et al.  Clarifying the Concept of Adherence to eHealth Technology: Systematic Review on When Usage Becomes Adherence , 2017, Journal of medical Internet research.

[48]  Craig H. Kennedy,et al.  Single-Case Designs for Educational Research , 2004 .

[49]  P. Shrout,et al.  Mind the Gap? An Intensive Longitudinal Study of Between-Person and Within-Person Intention-Behavior Relations , 2016, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[50]  G. Dunton Sustaining Health-Protective Behaviors Such as Physical Activity and Healthy Eating. , 2018, JAMA.

[51]  Raechel A. Damarell,et al.  Participatory Research as One Piece of the Puzzle: A Systematic Review of Consumer Involvement in Design of Technology-Based Youth Mental Health and Well-Being Interventions , 2015, JMIR human factors.

[52]  M Alan Brookhart,et al.  Meta-analyses involving cross-over trials: methodological issues. , 2011, International journal of epidemiology.

[53]  Ying Kuen Cheung,et al.  Envisioning a future for precision health psychology: innovative applied statistical approaches to N-of-1 studies , 2017, Health psychology review.

[54]  J. Mckechnie,et al.  A series of n-of-1 studies examining the interrelationships between social cognitive theory constructs and physical activity behaviour within individuals , 2018, Psychology & health.

[55]  S. Shiffman,et al.  Ecological Momentary Assessment (Ema) in Behavioral Medicine , 1994 .

[56]  G. King,et al.  What to Do about Missing Values in Time‐Series Cross‐Section Data , 2010 .

[57]  Robin M. Hogarth,et al.  The challenge of representative design in psychology and economics , 2004 .

[58]  Robin Henderson,et al.  Dynamic modelling of n-of-1 data: powerful and flexible data analytics applied to individualised studies , 2017, Health psychology review.

[59]  G H Guyatt,et al.  The n-of-1 randomized controlled trial: clinical usefulness. Our three-year experience. , 1990, Annals of internal medicine.

[60]  Bart Verkuil,et al.  Changing Mental Health and Positive Psychological Well-Being Using Ecological Momentary Interventions: A Systematic Review and Meta-analysis , 2016, Journal of medical Internet research.

[61]  Nara L. Newcomer,et al.  User Centered Design , 2014, Encyclopedia of Database Systems.

[62]  F. Sniehotta,et al.  N-of-1 study of weight loss maintenance assessing predictors of physical activity, adherence to weight loss plan and weight change , 2017, Psychology & health.

[63]  G. Guyatt,et al.  A clinician's guide for conducting randomized trials in individual patients. , 1988, CMAJ : Canadian Medical Association journal = journal de l'Association medicale canadienne.

[64]  Mj Marina Toeters,et al.  Research through design , 2012 .

[65]  Leanne Togher,et al.  Rating the methodological quality of single-subject designs and n-of-1 trials: Introducing the Single-Case Experimental Design (SCED) Scale , 2008, Neuropsychological rehabilitation.

[66]  Justin Presseau,et al.  Testing self-regulation interventions to increase walking using factorial randomized N-of-1 trials. , 2012, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[67]  R. Kravitz,et al.  N-of-1 Trials in the Medical Literature: A Systematic Review , 2011, Medical care.

[68]  S. Murphy,et al.  The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. , 2007, American journal of preventive medicine.

[69]  P. Shrout,et al.  Using Smartphone-Based Support Groups to Promote Healthy Eating in Daily Life: A Randomised Trial. , 2017, Applied psychology. Health and well-being.

[70]  M. Wolery,et al.  The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education , 2005 .

[71]  Ulrich Ebner-Priemer,et al.  The Role of Ambulatory Assessment in Psychological Science , 2014, Current directions in psychological science.

[72]  Andrew J. Callaway,et al.  Increasing walking among older people: A test of behaviour change techniques using factorial randomised N-of-1 trials , 2015, Psychology & health.

[73]  Gary Charness,et al.  Journal of Economic Behavior & Organization , 2022 .

[74]  Frank R. Rusch,et al.  APPLYING QUALITY INDICATORS TO SINGLE-CASE RESEARCH DESIGNS USED IN SPECIAL EDUCATION: A SYSTEMATIC REVIEW , 2015 .

[75]  Leanne Togher,et al.  The design, conduct and report of single-case research: Resources to improve the quality of the neurorehabilitation literature , 2014, Neuropsychological rehabilitation.

[76]  N. Bolger,et al.  Intensive Longitudinal Methods: An Introduction to Diary and Experience Sampling Research , 2013 .

[77]  J. Schwartz,et al.  Does Stress Result in You Exercising Less? Or Does Exercising Result in You Being Less Stressed? Or Is It Both? Testing the Bi-directional Stress-Exercise Association at the Group and Person (N of 1) Level , 2017, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.