The Active Ingredient in Reading Comprehension Strategy Intervention for Struggling Readers: A Bayesian Network Meta-analysis

Based on 52 studies with samples mostly from English-speaking countries, the current study used Bayesian network meta-analysis to investigate the intervention effectiveness of different reading comprehension strategy combinations on reading comprehension among students with reading difficulties in 3rd through 12th grade. We focused on commonly researched strategies: main idea, inference, text structure, retell, prediction, self-monitoring, and graphic organizers. Results showed (1) instruction of more strategies did not necessarily have stronger effects on reading comprehension; (2) there was no single reading comprehension strategy that produced the strongest effect; (3) main idea, text structure, and retell, taught together as the primary strategies, seemed the most effective; and (4) the effects of strategies only held when background knowledge instruction was included. These findings suggest strategy instruction among students with reading difficulties follows an ingredient-interaction model—that is, no single strategy works the best. It is not “the more we teach, the better outcomes to expect.” Instead, different strategy combinations may produce different effects on reading comprehension. Main idea, text structure, and retell together may best optimize the cognitive load during reading comprehension. Background knowledge instruction should be combined with strategy instruction to facilitate knowledge retrieval as to reduce the cognitive load of using strategies.

[1]  W. Wang,et al.  A meta-analytic review of cognition and reading difficulties: Individual differences, moderation, and language mediation mechanisms. , 2022, Psychological Bulletin.

[2]  Elizabeth A. Swanson,et al.  A Meta-Analysis of the Effects of Reading Comprehension Interventions on the Reading Comprehension Outcomes of Struggling Readers in Third Through 12th Grades , 2021, Exceptional Children.

[3]  Daniel M. McNeish,et al.  Understanding the Dynamics of Dosage Response: A Nonlinear Meta-Analysis of Recent Reading Interventions , 2021, Review of Educational Research.

[4]  P. Cuijpers,et al.  Doing Meta-Analysis with R , 2021 .

[5]  Nathan H. Clemens,et al.  Commercially Developed Tests of Reading Comprehension: Gold Standard or Fool’s Gold? , 2021 .

[6]  S. Vaughn,et al.  Current State of the Evidence: Examining the Effects of Orton-Gillingham Reading Interventions for Students With or at Risk for Word-Level Reading Disabilities , 2021, Exceptional children.

[7]  H. Chu,et al.  Prior Choices of Between-Study Heterogeneity in Contemporary Bayesian Network Meta-analyses: an Empirical Study , 2021, Journal of General Internal Medicine.

[8]  T. Furukawa,et al.  Adjunctive Psychotherapy for Bipolar Disorder: A Systematic Review and Component Network Meta-analysis. , 2020, JAMA psychiatry.

[9]  Annette M. O'Connor,et al.  How to Conduct a Bayesian Network Meta-Analysis , 2020, Frontiers in Veterinary Science.

[10]  S. Vaughn,et al.  The Effects of a Paraphrasing and Text Structure Intervention on the Main Idea Generation and Reading Comprehension of Students with Reading Disabilities in Grades 4 and 5 , 2019, Scientific studies of reading : the official journal of the Society for the Scientific Study of Reading.

[11]  Andrea L. Beerwinkle,et al.  Supplementing teacher knowledge using web-based Intelligent Tutoring System for the Text Structure Strategy to improve content area reading comprehension with fourth- and fifth-grade struggling readers. , 2020, Dyslexia.

[12]  S. Vaughn,et al.  A Review of Summarizing and Main Idea Interventions for Struggling Readers in Grades 3 Through 12: 1978–2016 , 2019 .

[13]  Gerta Rücker,et al.  Network meta‐analysis of multicomponent interventions , 2019, Biometrical journal. Biometrische Zeitschrift.

[14]  M. Barnes,et al.  The Effects of Inference Instruction on the Reading Comprehension of English Learners With Reading Comprehension Difficulties , 2019, Remedial and Special Education.

[15]  S. Vaughn,et al.  The Relationship Between Study Quality and the Effects of Supplemental Reading Interventions: A Meta-Analysis , 2018, Exceptional children.

[16]  Michael P. Kaschak,et al.  Examining the Efficacy of Targeted Component Interventions on Language and Literacy for Third and Fourth Graders Who are at Risk of Comprehension Difficulties , 2018, Scientific studies of reading : the official journal of the Society for the Scientific Study of Reading.

[17]  M. Lambert,et al.  Identifying and discriminating expository text structures: An experiment with 4th and 5th grade struggling readers , 2018 .

[18]  Amy M. Elleman,et al.  Evaluating a Multidimensional Reading Comprehension Program and Reconsidering the Lowly Reputation of Tests of Near‐Transfer , 2018 .

[19]  Peng Peng,et al.  A Meta-Analysis on the Relation Between Reading and Working Memory , 2018, Psychological bulletin.

[20]  H. Abadzi.  Improving Arab Students’ Academic Achievement: The Crucial Role of Rapid Reading and Grammar Mastery in the Early Grades , 2017 .

[21]  Sharon Vaughn,et al.  The Effects of Reading Fluency Interventions on the Reading Fluency and Reading Comprehension Performance of Elementary Students With Learning Disabilities: A Synthesis of the Research from 2001 to 2014 , 2017, Journal of learning disabilities.

[22]  M. Barnes,et al.  Executive Function, Self-Regulated Learning, and Reading Comprehension: A Training Study , 2017, Journal of learning disabilities.

[23]  Young-Suk Kim,et al.  Why the Simple View of Reading Is Not Simplistic: Unpacking Component Skills of Reading Using a Direct and Indirect Effect Model of Reading (DIER) , 2017 .

[24]  Eleni Morfidi,et al.  Using concept mapping to improve poor readers’ understanding of expository text , 2017, Education and Information Technologies.

[25]  Giuseppe Biondi-Zoccai,et al.  A Bayesian network meta-analysis for binary outcome: how to do it , 2016, Statistical methods in medical research.

[26]  S. Vaughn,et al.  Meta-Analyses of the Effects of Tier 2 Type Reading Interventions in Grades K-3 , 2016, Educational psychology review.

[27]  Johannes B Reitsma,et al.  GetReal in network meta‐analysis: a review of the methodology , 2016, Research synthesis methods.

[28]  Jessica A. Brown,et al.  The Effects of Text Structure Instruction on Expository Reading Comprehension: A Meta-Analysis , 2016 .

[29]  Alison G. Boardman,et al.  Relationship Between Implementation of Collaborative Strategic Reading and Student Outcomes for Adolescents With Disabilities , 2016, Journal of learning disabilities.

[30]  Ying Wang,et al.  The impact of visual-spatial attention on reading and spelling in Chinese children , 2016 .

[31]  Colby Hall.  Inference Instruction for Struggling Readers: a Synthesis of Intervention Research , 2016 .

[32]  D. Fuchs,et al.  A Meta-Analysis of Working Memory Deficits in Children With Learning Difficulties , 2016, Journal of learning disabilities.

[33]  I. J. P. Howard.  Meta-Analysis withR , 2015 .

[34]  S. Vaughn,et al.  The Effects of an Intensive Reading Intervention for Ninth Graders with very Low Reading Comprehension , 2015 .

[35]  C. Espin,et al.  The Reading Fluency and Comprehension of Fifth- and Sixth-Grade Struggling Readers Across Brief Tests of Various Intervention Approaches , 2015 .

[36]  S. Vaughn,et al.  Team‐Based Learning for Students with High‐Incidence Disabilities in High School Social Studies Classrooms , 2015 .

[37]  Rebecca M. Turner,et al.  Predictive distributions were developed for the extent of heterogeneity in meta-analyses of continuous outcome data , 2015, Journal of clinical epidemiology.

[38]  Annemarie H. Hindman,et al.  Understanding the Active Ingredients in an Effective Preschool Vocabulary Intervention: An Exploratory Study of Teacher and Child Talk During Book Reading , 2014 .

[39]  Jennifer A. Brown,et al.  Effects of a Narrative Intervention on Story Retelling in At-Risk Young Children , 2014 .

[40]  S. Gori,et al.  Perceptual learning as a possible new approach for remediation and prevention of developmental dyslexia , 2014, Vision Research.

[41]  John William McKenna,et al.  Measuring Fidelity to Improve Intervention Effectiveness , 2014 .

[42]  Martin Brunner,et al.  Forty years on: childhood intelligence predicts health in middle adulthood. , 2014, Health psychology : official journal of the Division of Health Psychology, American Psychological Association.

[43]  P. Broek,et al.  A Cognitive View of Reading Comprehension: Implications for Reading Difficulties , 2014 .

[44]  Richard K Wagner,et al.  Specific Reading Comprehension Disability: Major Problem, Myth, or Misnomer? , 2014, Learning disabilities research & practice : a publication of the Division for Learning Disabilities, Council for Exceptional Children.

[45]  J. Glutting,et al.  Knowledge, writing, and language outcomes for a reading comprehension and writing intervention , 2013 .

[46]  Nicky J Welton,et al.  Automating network meta‐analysis , 2012, Research synthesis methods.

[47]  Deborah K. Reed,et al.  Retell as an Indicator of Reading Comprehension , 2012, Scientific studies of reading : the official journal of the Society for the Scientific Study of Reading.

[48]  Sharon Vaughn,et al.  Collaborative Models of Instruction: The Empirical Foundations of Inclusion and Co-Teaching. , 2012 .

[49]  Akira Miyake,et al.  Predicting word reading and comprehension with executive function and speed measures across development: a latent variable analysis. , 2012, Journal of experimental psychology. General.

[50]  S. Graham,et al.  Writing to Read: A Meta-Analysis of the Impact of Writing and Writing Instruction on Reading. , 2011 .

[51]  Alison G. Boardman,et al.  Efficacy of Collaborative Strategic Reading With Middle School Students* , 2011 .

[52]  Karen H. Douglas,et al.  The Effectiveness of Electronic Text and Pictorial Graphic Organizers to Improve Comprehension Related to Functional Skills , 2011 .

[53]  Michael N. Faggella-Luby,et al.  RTI in a Middle School: Findings and Practical Implications of a Tier 2 Reading Comprehension Study , 2011 .

[54]  Georgia Salanti,et al.  Graphical methods and numerical summaries for presenting results from multiple-treatment meta-analysis: an overview and tutorial. , 2011, Journal of clinical epidemiology.

[55]  T. Scruggs,et al.  Reading Comprehension Strategy Instruction and Attribution Retraining for Secondary Students With Learning and Other Mild Disabilities , 2011, Journal of learning disabilities.

[56]  Sarah A. Hezlett,et al.  Fact and Fiction in Cognitive Ability Testing for Admissions and Hiring Decisions , 2010 .

[57]  Charles Hulme,et al.  Ameliorating Children’s Reading-Comprehension Difficulties , 2010, Psychological science.

[58]  Therese D. Pigott,et al.  How Many Studies Do You Need? , 2010 .

[59]  S Dias,et al.  Checking consistency in mixed treatment comparison meta‐analysis , 2010, Statistics in medicine.

[60]  C. Cornoldi,et al.  Role of working memory in explaining the performance of individuals with specific reading comprehension difficulties: A meta-analysis , 2009 .

[61]  S. Vaughn,et al.  Response to Intervention: Preventing and Remediating Academic Difficulties. , 2009, Child development perspectives.

[62]  S. Vaughn,et al.  A Synthesis of Reading Interventions and Effects on Reading Comprehension Outcomes for Older Struggling Readers , 2009, Review of educational research.

[63]  Donald L. Compton,et al.  The Impact of Vocabulary Instruction on Passage-Level Comprehension of School-Age Children: A Meta-Analysis , 2009 .

[64]  Amy E Barth,et al.  Response to Intervention with Older Students with Reading Difficulties. , 2008, Learning and individual differences.

[65]  Randy G. Floyd,et al.  Differential Competencies Contributing to Children's Comprehension of Narrative and Expository Texts , 2008 .

[66]  D. McNamara.  Reading comprehension strategies : theories, interventions, and technologies , 2007 .

[67]  L. Siegel,et al.  Perspectives on dyslexia. , 2006, Paediatrics & child health.

[68]  Sharon Vaughn,et al.  Improving the Reading Comprehension of Middle School Students With Disabilities Through Computer-Assisted Collaborative Strategic Reading , 2006 .

[69]  Jason L. Anthony,et al.  Development of Phonological Awareness , 2005 .

[70]  Maria Elena Arguelles,et al.  Collaborative Strategic Reading , 2004 .

[71]  William J. Therrien,et al.  Fluency and Comprehension Gains as a Result of Repeated Reading , 2004 .

[72]  J. Oakhill,et al.  Children's Reading Comprehension Ability: Concurrent Prediction by Working Memory, Verbal Ability, and Component Skills. , 2004 .

[73]  L. Fuchs,et al.  Teaching Reading Comprehension Strategies to Students With Learning Disabilities: A Review of Research , 2001 .

[74]  Lynn S. Fuchs,et al.  Peer-Assisted Learning Strategies in Reading , 2001 .

[75]  T. Conway,et al.  Intensive Remedial Instruction for Children with Severe Reading Disabilities , 2001, Journal of learning disabilities.

[76]  Mina C. Johnson-Glenberg,et al.  Training reading comprehension in adequate decoders/poor comprehenders: Verbal versus visual strategies , 2000 .

[77]  Sharon Vaughn,et al.  Fluency and Comprehension Interventions for Third-Grade Students , 2000 .

[78]  Asha K. Jitendra,et al.  Enhancing Main Idea Comprehension for Students with Learning Problems , 2000 .

[79]  Andrew Gelman,et al.  General methods for monitoring convergence of iterative simulations , 1998 .

[80]  Miriam Alfassi,et al.  Reading for Meaning: The Efficacy of Reciprocal Teaching in Fostering Reading Comprehension in High School Students in Remedial Reading Classes , 1998 .

[81]  Jeffrey P. Bakken,et al.  READING COMPREHENSION OF EXPOSITORY SCIENCE MATERIAL AND STUDENTS WITH LEARNING DISABILITIES: A COMPARISON OF STRATEGIES , 1997 .

[82]  G. Smith,et al.  Bias in meta-analysis detected by a simple, graphical test , 1997, BMJ.

[83]  E. Vidal-Abarca,et al.  Is Attribution Retraining Necessary? Use of Self-Regulation Procedures for Enhancing the Reading Comprehension Strategies of Children with Learning Disabilities , 1997, Journal of learning disabilities.

[84]  M. Lovett,et al.  Text Comprehension Training for Disabled Readers: An Evaluation of Reciprocal Teaching and Text Analysis Training Programs , 1996, Brain and Language.

[85]  Joanna P. Williams,et al.  An Instructional Program in Comprehension of Narrative Themes for Adolescents with Learning Disabilities , 1994 .

[86]  M Gajria,et al.  The Effects of Summarization Instruction on Text Comprehension of Students with Learning Disabilities , 1992, Exceptional children.

[87]  M. Mastropieri,et al.  Reading Comprehension Instruction: Summarization and Self-Monitoring Training for Students with Learning Disabilities , 1991, Exceptional children.

[88]  Michael Pressley,et al.  Reciprocal Teaching Improves Standardized Reading-Comprehension Performance in Poor Comprehenders , 1990, The Elementary School Journal.

[89]  Peter Afflerbach,et al.  The influence of prior knowledge on expert readers' main idea construction strategies. , 1990 .

[90]  E. Balajthy,et al.  DEVELOPMENT OF DISABLED READERS’ METACOMPREHENSION ABILITY THROUGH SUMMARIZATION TRAINING USING EXPOSITORY TEXT: RESULTS OF THREE STUDIES , 1990 .

[91]  Michael Pressley,et al.  Strategies That Improve Children's Memory and Comprehension of Text , 1989, The Elementary School Journal.

[92]  Robert J. Stevens.  Effects of strategy training on the identification of the main idea of expository passages , 1988 .

[93]  T. Lovitt,et al.  The Effectiveness of Textbook Adaptations in Life Science for High School Students with Learning Disabilities , 1988, Journal of learning disabilities.

[94]  M. Stein,et al.  Improving Reading Comprehension by Using Paragraph Restatements , 1987, Exceptional children.

[95]  R. Wagner,et al.  The nature of phonological processing and its causal role in the acquisition of reading skills. , 1987 .

[96]  B C Holmes,et al.  The Effects of a Strategy and Sequenced Materials on the Inferential-Comprehension of Disabled Readers , 1985, Journal of learning disabilities.