The Effectiveness of Direct Instruction Curricula: A Meta-Analysis of a Half Century of Research

Quantitative mixed models were used to examine literature published from 1966 through 2016 on the effectiveness of Direct Instruction. Analyses were based on 328 studies involving 413 study designs and almost 4,000 effects. Results are reported for the total set and subareas regarding reading, math, language, spelling, and multiple or other academic subjects; ability measures; affective outcomes; teacher and parent views; and single-subject designs. All of the estimated effects were positive and all were statistically significant except results from metaregressions involving affective outcomes. Characteristics of the publications, methodology, and sample were not systematically related to effect estimates. Effects showed little decline during maintenance, and effects for academic subjects were greater when students had more exposure to the programs. Estimated effects were educationally significant, moderate to large when using the traditional psychological benchmarks, and similar in magnitude to effect sizes that reflect performance gaps between more and less advantaged students.

[1]  W. A. T. White,et al.  A Meta-Analysis of the Effects of Direct Instruction in Special Education. , 1988 .

[2]  Tx Station.  Stata Statistical Software: Release 7. , 2001 .

[3]  S. Engelmann,et al.  The Direct Instruction Follow Through Model: Design and Outcomes. , 1988 .

[4]  Russell Gersten,et al.  Measuring Implementation of a Structured Educational Model in an Urban School District: An Observational Approach , 1982 .

[5]  Russell Gersten,et al.  A Multifaceted Study of Change in Seven Inner-City Schools , 1986, The Elementary School Journal.

[6]  John Hattie,et al.  Visible Learning: A Synthesis of Over 800 Meta-Analyses Relating to Achievement , 2008 .

[7]  Siegfried Engelmann,et al.  Research on Direct Instruction: 25 Years beyond DISTAR. , 1996 .

[8]  P. Lachenbruch.  Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[9]  Flint Simonsen,et al.  Best Practices in Spelling Instruction: A Research Summary. , 2001 .

[10]  Nancy E. Marchand-Martella,et al.  Direct Instruction Mathematics Programs: An Overview and Research Summary. , 2004 .

[11]  Nancy E. Marchand-Martella,et al.  An Analysis of "Corrective Reading" Research. , 2005 .

[12]  Russell Gersten,et al.  A Follow-up of Follow Through: The Later Effects of the Direct Instruction Model on Children in Fifth and Sixth Grades , 1982 .

[13]  George Farkas,et al.  Which Instructional Practices Most Help First-Grade Students With and Without Mathematics Difficulties? , 2015, Educational evaluation and policy analysis.

[14]  J. Stockard.  Promoting Reading Achievement and Countering the “Fourth-Grade Slump”: The Impact of Direct Instruction on Reading Achievement in Fifth Grade , 2010 .

[15]  Michael R. Vitale,et al.  Adapting a Multiple-Baseline Design Rationale for Evaluating Instructional Interventions: Implications for the Adoption of Direct Instruction Reading Curricula for Evidence-Based Reform. , 2012 .

[16]  Geoffrey D. Borman,et al.  Comprehensive School Reform and Achievement: A Meta-Analysis , 2003 .

[17]  Linda A. Meyer.  Long-Term Academic Effects of the Direct Instruction Project Follow Through , 1984, The Elementary School Journal.

[18]  Nicole C. Ralston,et al.  The Influence of Fidelity of Implementation on the Reading Outcomes of Middle School Students Experiencing Reading Difficulties , 2011 .

[19]  L. Delbeke.  Quasi-experimentation - design and analysis issues for field settings - cook,td, campbell,dt , 1980 .

[20]  M. Lipsey,et al.  Performance Trajectories and Performance Gaps as Achievement Effect-Size Benchmarks for Educational Interventions , 2008 .

[22]  Mary M. Kennedy,et al.  Findings from the Follow Through Planned Variation Study , 1978 .

[23]  M. S. Patel,et al.  An introduction to meta-analysis. , 1989, Health Policy.

[24]  Mark W. Lipsey,et al.  Translating the Statistical Representation of the Effects of Education Interventions Into More Readily Interpretable Forms , 2012 .

[25]  M. Vitale,et al.  Broadening the Institutional Value of Direct Instruction Implemented in a Low-SES Elementary School: Implications for Scale-Up and School Reform. , 2008 .

[26]  Carl Bereiter,et al.  Teaching disadvantaged children in the preschool , 1966 .

[27]  M. Kennedy.  How Does Professional Development Improve Teaching? , 2016 .

[28]  S. Raudenbush,et al.  A multivariate mixed linear model for meta-analysis. , 1996 .

[29]  C. Bereiter,et al.  A constructive look at follow through results , 1981 .

[30]  S. Ross,et al.  Using School Reform Models to Improve Reading Achievement: A Longitudinal Study of Direct Instruction and Success For All in an Urban District , 2004 .

[31]  Reginald S. Lee,et al.  Multilevel Modeling: A Review of Methodological Issues and Applications , 2009 .

[32]  Nancy E. Marchand-Martella,et al.  An Analysis of the Reading Mastery Program: Effective Components and Research Review. , 2002 .

[33]  A. Sockloff,et al.  Statistical power analysis for the behavioral sciences: (revised edition), by Jacob Cohen. New York: Academic Press, 1977, xv + 474 pp., $24.50. , 1978 .

[34]  W. Shadish,et al.  Experimental and Quasi-Experimental Designs for Generalized Causal Inference , 2001 .

[35]  Siegfried Engelmann,et al.  Inferred Functions of Performance and Learning , 2003 .

[36]  Douglas Carnine,et al.  Theory of instruction : principles and applications , 1982 .

[37]  Implementing Research-Based Reading Programs in the Fort Worth Independent School District , 2002 .

[38]  Joshua R. Polanin,et al.  Estimating the Difference Between Published and Unpublished Effect Sizes , 2016 .

[39]  Jean Stockard,et al.  Direct Instruction and First Grade Reading Achievement: The Role of Technical Support and Time of Implementation. , 2011 .

[40]  W. Huitt,et al.  Direct Approach to Instruction , 2009 .

[41]  L. Hedges,et al.  The Handbook of Research Synthesis and Meta-Analysis , 2009 .

[42]  Nancy E. Marchand-Martella,et al.  Special Education and Direct Instruction: An Effective Combination. , 2005 .

[43]  D. Francis,et al.  Increasing the Reading Achievement of At-Risk Children Through Direct Instruction: Evaluation of the Rodeo Institute for Teacher Excellence (RITE) , 2002 .

[44]  J. Stockard,et al.  The Threshold and Inclusive Approaches to Determining “Best Available Evidence” , 2017 .

[45]  T. Cook,et al.  Quasi-experimentation: Design & analysis issues for field settings , 1979 .

[46]  J. Stockard.  Merging the accountability and scientific research requirements of the No Child Left Behind Act: using cohort control groups , 2013 .

[47]  Martha Abele Mac Iver,et al.  The Impact of Direct Instruction on Elementary Students' Reading Achievement in an Urban School District , 2002 .

[48]  K. Popper,et al.  Conjectures and refutations;: The growth of scientific knowledge , 1972 .

[49]  Stephen W. Raudenbush,et al.  Analyzing effect sizes: Random-effects models. , 2009 .

[50]  Lin Zhang.  Is Inquiry-Based Science Teaching Worth the Effort? , 2016 .