Optimizing behavioral health interventions with single-case designs: from development to dissemination

Over the past 70 years, single-case design (SCD) research has evolved to include a broad array of methodological and analytic advances. In this article, we describe some of these advances and discuss how SCDs can be used to optimize behavioral health interventions. Specifically, we discuss how parametric analysis, component analysis, and systematic replications can be used to optimize interventions. We also describe how SCDs can address other features of optimization, which include establishing generality and enabling personalized behavioral medicine. Throughout, we highlight how SCDs can be used during both the development and dissemination stages of behavioral health interventions.

[1]  Peter Sturmey,et al.  Component analyses using single-subject experimental designs: a review. , 2010, Journal of applied behavior analysis.

[2]  Jesse Dallery,et al.  Single-Case Experimental Designs to Evaluate Novel Technology-Based Health Interventions , 2013, Journal of medical Internet research.

[3]  D. Rivera,et al.  Using engineering control principles to inform the design of adaptive interventions: a conceptual introduction. , 2007, Drug and alcohol dependence.

[4]  S. Shiffman,et al.  Ecological momentary assessment. , 2008, Annual review of clinical psychology.

[5]  Jesse Dallery,et al.  Advances in the psychosocial treatment of addiction: the role of technology in the delivery of evidence-based psychosocial treatment. , 2012, The Psychiatric clinics of North America.

[6]  J S Bailey,et al.  Ritalin vs. response cost in the control of hyperactive children: a within-subject comparison. , 1982, Journal of applied behavior analysis.

[7]  A. Stone,et al.  Bringing the laboratory and clinic to the community: mobile technologies for health promotion and disease prevention. , 2013, Annual review of psychology.

[8]  B. Rounsaville,et al.  A Stage Model of Behavioral Therapies Research: Getting Started and Moving on From Stage I , 2006 .

[9]  R. Hubbard,et al.  Why P Values Are Not a Useful Measure of Evidence in Statistical Significance Testing , 2008 .

[10]  Wim Van Den Noortgate,et al.  The Aggregation of Single-Case Results Using Hierarchical Linear Models. , 2007 .

[11]  Matthew S. Goodwin,et al.  Telemetric monitoring in the behavior sciences , 2008, Behavior research methods.

[12]  K Rivet Amico,et al.  An information-motivation-behavioral skills model of adherence to antiretroviral therapy. , 2006, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[13]  G. Guyatt,et al.  Measurement of health status. Ascertaining the minimal clinically important difference. , 1989, Controlled clinical trials.

[14]  Eric Granholm,et al.  Examining a cognitive model of persecutory ideation in the daily life of people with schizophrenia: a computerized experience sampling study. , 2011, Schizophrenia bulletin.

[15]  Gregory P Hanley,et al.  Functional Assessment of Problem Behavior: Dispelling Myths, Overcoming Implementation Obstacles, and Developing New Lore , 2012, Behavior analysis in practice.

[16]  T. Liesegang,et al.  Evidence-based medicine: principles for applying the users' guides to patient care. Guyatt GH,*(1) Haynes RB, Jaeschke RZ, Cook DJ, Green L, Naylor CD, Wilson MC, Richardson WS for the Evidence-Based Medicine Working Group. JAMA 2000;284:1290-1296. , 2001, American journal of ophthalmology.

[17]  Alexis Wright,et al.  Clinimetrics corner: a closer look at the minimal clinically important difference (MCID) , 2012, The Journal of manual & manipulative therapy.

[18]  William V. Dube,et al.  APA Handbook of Behavior Analysis , 2011 .

[19]  John R. Nesselroade,et al.  Life-span developmental psychology;: Methodological issues , 1973 .

[20]  N. Schork,et al.  The n-of-1 clinical trial: the ultimate strategy for individualizing medicine? , 2011, Personalized medicine.

[21]  G. Guyatt,et al.  Users' Guides to the Medical Literature: XXV. Evidence-based medicine: principles for applying the Users' Guides to patient care. Evidence-Based Medicine Working Group. , 2000, JAMA.

[22]  Michael E Kelley,et al.  Visual aids and structured criteria for improving visual inspection and interpretation of single-case designs. , 2003, Journal of applied behavior analysis.

[23]  Charles Lambdin,et al.  Significance tests as sorcery: Science is empirical—significance tests are not , 2012 .

[24]  Robert H. Horner,et al.  Single-Case Intervention Research Design Standards , 2013 .

[25]  M. Wolery,et al.  The Use of Single-Subject Research to Identify Evidence-Based Practice in Special Education , 2005 .

[26]  S. Murphy,et al.  The multiphase optimization strategy (MOST) and the sequential multiple assignment randomized trial (SMART): new methods for more potent eHealth interventions. , 2007, American journal of preventive medicine.

[27]  J. Levin,et al.  Single-case research design and analysis : new directions for psychology and education , 1992 .

[28]  Christopher H. Schmid,et al.  Single-patient (n-of-1) trials: a pragmatic clinical decision methodology for patient-centered comparative effectiveness research. , 2013, Journal of clinical epidemiology.

[29]  Donald M. Baer,et al.  The Visual Analysis of Data, and Current Research into the Stimuli Controlling It , 2015 .

[30]  M. Dermer,et al.  Improving Descriptions of Single-Subject Experiments in Research Texts Written for Undergraduates , 1999 .

[31]  Christopher H Schmid,et al.  Individual (N-of-1) trials can be combined to give population comparative treatment effect estimates: methodologic considerations. , 2010, Journal of clinical epidemiology.

[32]  D H Barlow,et al.  Single-Case Experimental Designs: Uses in Applied Clinical Research , 1973 .

[33]  James E Pustejovsky,et al.  A d-statistic for single-case designs that is equivalent to the usual between-groups d-statistic , 2014, Neuropsychological rehabilitation.

[34]  R. Parrila,et al.  Examining the effectiveness of peer-mediated and video-modeling social skills interventions for children with autism spectrum disorders: A meta-analysis in single-case research using HLM , 2011 .

[35]  Jesse Dallery,et al.  A web-based contingency management program with adolescent smokers. , 2008, Journal of applied behavior analysis.

[36]  F. Butterfoss,et al.  Social Validation of Goals, Procedures, and Effects in Public Health , 2007, Health promotion practice.

[37]  W. Nilsen,et al.  Health behavior models in the age of mobile interventions: are our theories up to the task? , 2011, Translational behavioral medicine.

[38]  M. Sidman.  Tactics of Scientific Research , 1960 .

[39]  Jesse Dallery,et al.  Contingency Management in the 21st Century: Technological Innovations to Promote Smoking Cessation , 2011, Substance use & misuse.

[40]  Jacob Cohen.  The earth is round (p < .05) , 1994 .

[41]  Bradley E. Huitema,et al.  Autocorrelation in applied behavior analysis: A myth. , 1985 .

[42]  Stanley R. Aeschleman,et al.  Single-subject research designs: Some misconceptions. , 1991 .

[43]  Shawna L. Mercer,et al.  Study designs for effectiveness and translation research :identifying trade-offs. , 2007, American journal of preventive medicine.

[44]  W. Shadish,et al.  A standardized mean difference effect size for single case designs , 2012, Research synthesis methods.

[45]  Stephen D. A. Hupp,et al.  Sequential evaluation of behavioral treatments and methylphenidate dosage for children with attention deficit hyperactivity disorder. , 2003, Journal of applied behavior analysis.

[46]  D P Hartmann,et al.  The changing criterion design. , 1976, Journal of applied behavior analysis.

[47]  Rumen Manolov,et al.  Choosing among techniques for quantifying single-case intervention effectiveness. , 2011, Behavior therapy.

[48]  H. S. Pennypacker,et al.  Generality and generalization of research findings. , 2013 .

[49]  D M Baer,et al.  Social validity assessments: is current practice state of the art? , 1991, Journal of applied behavior analysis.

[50]  Alan E. Kazdin,et al.  Single-Case Research Designs: Methods for Clinical and Applied Settings , 2010 .

[51]  James M. Johnston,et al.  Strategies and tactics of behavioral research, 3rd ed. , 2009 .

[52]  G H Guyatt,et al.  N of 1 randomized trials for investigating new drugs. , 1990, Controlled clinical trials.

[53]  Ben A. Williams,et al.  Perils of Evidence-Based Medicine , 2010, Perspectives in biology and medicine.

[54]  Jesse Dallery,et al.  Delay discounting predicts cigarette smoking in a laboratory model of abstinence reinforcement , 2007, Psychopharmacology.

[55]  Richard I. Parker,et al.  Phase Contrasts for Multiphase Single Case Intervention Designs. , 2006 .

[56]  Lee L. Mason.  An Analysis of Effect Sizes for Single-Subject Research: A Statistical Comparison of Five Judgemental Aids. , 2010 .

[57]  Jesse Dallery,et al.  Internet-based contingency management to improve adherence with blood glucose testing recommendations for teens with type 1 diabetes. , 2010, Journal of applied behavior analysis.

[58]  S T Higgins,et al.  Sustained cocaine abstinence in methadone maintenance patients through voucher-based reinforcement therapy. , 1996, Archives of general psychiatry.

[59]  Jesse Dallery,et al.  Internet-based contingency management increases walking in sedentary adults. , 2013, Journal of applied behavior analysis.

[60]  B. Gorman,et al.  Design and Analysis of Single-Case Research , 1996 .

[61]  J. Cooper,et al.  Applied behavior analysis in education , 1982 .

[62]  S T Higgins,et al.  Increasing opiate abstinence through voucher-based reinforcement therapy. , 1996, Drug and alcohol dependence.

[63]  Jesse Dallery,et al.  An Internet-based abstinence reinforcement treatment for cigarette smoking. , 2007, Drug and alcohol dependence.

[64]  M. E. Boyle.  Single Case Experimental Designs: Strategies for Studying Behavior Change , 1983 .

[65]  Kimberly J. Vannest,et al.  Effect Size in Single-Case Research: A Review of Nine Nonoverlap Techniques , 2011, Behavior modification.

[66]  M. Wolf,et al.  Social validity: the case for subjective measurement or how applied behavior analysis is finding its heart. , 1978, Journal of applied behavior analysis.

[67]  Kyong-Mee Chung,et al.  Consistent visual analyses of intrasubject data. , 2010, Journal of applied behavior analysis.

[68]  Linda M. Collins,et al.  Replication in Prevention Science , 2011, Prevention Science.

[69]  Roger O. Smith,et al.  Single Subject Designs: Current Methodologies and Future Directions , 2010 .

[70]  Todd R. Risley.  CHAPTER 8 – Strategies for Analyzing Behavioral Change Over Time , 1973 .

[71]  S. Sanders,et al.  Component analysis of a behavioral treatment program for chronic low-back pain , 1983 .

[72]  Richard I. Parker,et al.  Impact of the Picture Exchange Communication System: Effects on Communication and Collateral Effects on Maladaptive Behaviors , 2009, Augmentative and alternative communication.

[73]  Robin K. Morgan,et al.  Single-participant research design. Bringing science to managed care. , 2001, The American psychologist.

[74]  N. Blampied,et al.  Single-case research designs and the scientist-practitioner ideal in applied psychology. , 2013 .

[75]  Leanne Togher,et al.  Rating the methodological quality of single-subject designs and n-of-1 trials: Introducing the Single-Case Experimental Design (SCED) Scale , 2008, Neuropsychological rehabilitation.

[76]  G. Guyatt,et al.  Users' guides to the medical literature. , 1993, JAMA.

[77]  Audie A Atienza,et al.  Mobile health technology evaluation: the mHealth evidence workshop. , 2013, American journal of preventive medicine.

[78]  E. Mash,et al.  Assessing social validity in clinical treatment research: issues and procedures. , 1999, Journal of consulting and clinical psychology.

[79]  William R. Jenson,et al.  Statistical reform: Evidence‐based practice, meta‐analyses, and single subject designs , 2007 .

[80]  Jung A Kim.  The Creative Destruction of Medicine: How the Digital Revolution Will Create Better Health Care , 2011 .

[81]  S C Hayes,et al.  Single case experimental design and empirical clinical practice. , 1981, Journal of consulting and clinical psychology.

[82]  Alexander C. Wagenaar,et al.  The Value of Interrupted Time-Series Experiments for Community Intervention Research , 2000, Prevention Science.

[83]  Leland Wilkinson,et al.  Statistical Methods in Psychology Journals Guidelines and Explanations , 2005 .

[84]  Amy P Abernethy,et al.  Rapid, responsive, relevant (R3) research: a call for a rapid learning health research enterprise , 2013, Clinical and Translational Medicine.

[85]  Kimberly J. Vannest,et al.  Effective Intervention for Behavior With a Daily Behavior Report Card: A Meta-Analysis , 2010 .

[86]  Vijay N. Nair,et al.  A strategy for optimizing and evaluating behavioral interventions , 2005, Annals of behavioral medicine : a publication of the Society of Behavioral Medicine.

[87]  R. Kravitz,et al.  Marketing therapeutic precision: Potential facilitators and barriers to adoption of n-of-1 trials. , 2009, Contemporary clinical trials.