Developing Optimized Adaptive Interventions in Education

Hedges (2018) encourages us to consider asking new scientific questions concerning the optimization of adaptive interventions in education. In this commentary, we have expanded on this (albeit briefly) by providing concrete examples of scientific questions and associated experimental designs to optimize adaptive interventions, and commenting on some of the ways such designs might challenge us to think differently. A great deal of methodological work remains to be done. For example, we have only begun to consider experimental design and analysis methods for developing "cluster-level adaptive interventions" (NeCamp, Kilbourne, & Almirall, 2017), or to extend methods for comparing the marginal mean trajectories between the adaptive interventions embedded in a SMART (Lu et al., 2016) to accommodate random effects. These methodological advances, among others, will propel educational research concerning the construction of more complex, yet meaningful, interventions that are necessary for improving student and teacher outcomes.

[1]  Ree Dawson,et al.  Dynamic treatment regimes: practical design considerations , 2004, Clinical trials.

[2]  Susan A Murphy,et al.  Examining clinical judgment in an adaptive intervention design: The fast track program. , 2006, Journal of consulting and clinical psychology.

[3]  S. Murphy,et al.  An experimental design for the development of adaptive treatment strategies , 2005, Statistics in medicine.

[4]  D. Almirall,et al.  A SMART data analysis method for constructing adaptive treatment strategies for substance use disorders , 2017, Addiction.

[5]  L. Fuchs,et al.  Critique of the National Evaluation of Response to Intervention: A Case for Simpler Frameworks , 2017 .

[6]  Stanley L. Deno,et al.  Developments in Curriculum-Based Measurement , 2003 .

[7]  Daniel Almirall,et al.  Adaptive Interventions in Child and Adolescent Mental Health , 2016, Journal of clinical child and adolescent psychology : the official journal for the Society of Clinical Child and Adolescent Psychology, American Psychological Association, Division 53.

[8]  John J Dziak,et al.  Factorial experiments: efficient tools for evaluation of intervention components. , 2014, American journal of preventive medicine.

[9]  Linda M. Collins,et al.  Optimization of Multicomponent Behavioral and Biobehavioral Interventions for the Prevention and Treatment of HIV/AIDS , 2015, AIDS and Behavior.

[10]  Tristram Smith,et al.  Discrete Trial Training in the Treatment of Autism , 2001 .

[11]  Daniel Almirall,et al.  Comparing cluster-level dynamic treatment regimens using sequential, multiple assignment, randomized trials: Regression estimation and sample size considerations , 2016, Statistical methods in medical research.

[12]  Inbal Nahum-Shani,et al.  Comparing dynamic treatment regimes using repeated‐measures outcomes: modeling considerations in SMART studies , 2016, Statistics in medicine.

[13]  Elizabeth A. Stormshak,et al.  An Adaptive Approach to Family-Centered Intervention in Schools: Linking Intervention Engagement to Academic Outcomes in Middle and High School , 2009, Prevention Science.

[14]  Tristram H. Smith,et al.  Forest for the Trees: Evidence-Based Practices in ASD , 2016 .

[15]  Tristram H. Smith,et al.  Early and intensive behavioral intervention in autism. , 2003 .

[16]  S. Murphy,et al.  Experimental design and primary data analysis methods for comparing adaptive interventions. , 2012, Psychological methods.

[17]  Anne W. Todd,et al.  A Randomized, Wait-List Controlled Effectiveness Trial Assessing School-Wide Positive Behavior Support in Elementary Schools , 2009 .

[18]  M. Kosorok,et al.  Adaptive Treatment Strategies in Practice: Planning Trials and Analyzing Data for Personalized Medicine , 2015 .

[19]  Susan A. Murphy,et al.  A Conceptual Framework for Adaptive Preventive Interventions , 2004, Prevention Science.

[20]  L. Hedges.  Challenges in Building Usable Knowledge in Education , 2018 .

[21]  C. Lord,et al.  Caregiver-Mediated Intervention for Low-Resourced Preschoolers With Autism: An RCT , 2014, Pediatrics.

[22]  Inbal Nahum-Shani,et al.  Optimization of behavioral dynamic treatment regimens based on the sequential, multiple assignment, randomized trial (SMART) , 2014, Clinical trials.

[23]  Jessica R. Toste,et al.  Effective Classroom Instruction: Implications of Child Characteristics by Reading Instruction Interactions on First Graders’ Word Reading Achievement , 2011, Journal of research on educational effectiveness.

[24]  S. Murphy,et al.  Designing a pilot sequential multiple assignment randomized trial for developing an adaptive treatment strategy , 2012, Statistics in medicine.