Examining the structure of reading comprehension: do literal, inferential, and evaluative comprehension truly exist?

Although the recent identification of the five critical components of early literacy has been a catalyst for modifications to the content of materials used to provide reading instruction and the tools used to examine student’s acquisition of early literacy skills, these skills have not received equal attention from test developers and publishers. In particular, a review of early literacy available measures for screening and monitoring students reveals a dearth of tools for examining different facets of reading comprehension. The purposes of this study were twofold: (a) to examine the relative difficulty of items written to assess literal, inferential, and evaluative comprehension, and (b) to compare single factor and bifactor models of reading comprehension to determine if items written to assess students’ literal, inferential, and evaluative comprehension abilities comprise unique measurement factors. Data from approximately 2,400 fifth grade students collected in the fall, winter, and spring of fifth grader were used to examine these questions. Findings indicated that (a) the relative difficulty of item types may be curvilinear, with literal items being significantly less challenging than inferential and evaluative items, and (b) literal, inferential, and evaluative comprehension measurement factors explained unique portions of variance in addition to a general reading comprehension factor. Instructional implications of the findings are discussed.

[1]  L. Fuchs,et al.  Teaching Reading Comprehension Strategies to Students With Learning Disabilities: A Review of Research , 2001 .

[2]  Passage Dependency: Four Diagnostic Oral Reading Tests. , 1977 .

[3]  W. Kintsch,et al.  Strategies of discourse comprehension , 1983 .

[4]  Stanford E. Taylor,et al.  EDL core vocabularies in reading, mathematics, science and social studies , 1989 .

[5]  P. Tun,et al.  Age differences in processing expository and narrative text. , 1989, Journal of gerontology.

[6]  Catherine Snow,et al.  Reading for Understanding: Toward an R&D Program in Reading Comprehension , 2002 .

[7]  Danielle S. McNamara Reading comprehension strategies : theories, interventions, and technologies , 2007 .

[8]  Morton Ann Gernsbacher,et al.  Managing Mental Representations During Narrative Comprehension , 2004, Discourse processes.

[9]  Charles K. Kinzer,et al.  Effective Literacy Instruction, K-8 , 1998 .

[10]  R. M. Wilson,et al.  Book Reviews: Harold L. Herber, Teaching Reading in Content Areas (Second Edition). Englewood Cliffs, N.J.: Prentice Hall, 1978. , 1979 .

[11]  G. Tindal,et al.  They Read, but How Well Do They Understand? , 2009 .

[12]  P. David Pearson,et al.  Two Steps Forward, Three Steps Back: The Stormy History of Reading Comprehension Assessment , 1998 .

[13]  P. David Pearson Handbook of reading research. , 1990 .

[14]  B. Davey Factors Affecting the Difficulty of Reading Comprehension Items for Successful and Unsuccessful Readers , 1988 .

[15]  Julie Alonzo,et al.  Examining the Technical Adequacy of Reading Comprehension Measures in a Progress Monitoring Assessment System. Technical Report # 41. , 2007 .

[16]  M. Masson,et al.  Working memory and individual differences in comprehension and memory of text. , 1983 .

[17]  Beth A. Harn,et al.  Measuring the Dimensions of Alphabetic Principle on the Reading Development of First Graders , 2008, Journal of learning disabilities.

[18]  Kirsten Risden,et al.  Inferential Questioning: Effects on Comprehension of Narrative Texts as a Function of Grade and Timing , 2001 .

[19]  L. Siegel,et al.  The role of question type and reading ability in reading comprehension , 1994 .

[20]  André A. Rupp,et al.  How assessing reading comprehension with multiple-choice questions shapes the construct: a cognitive processing perspective , 2006 .

[21]  S. Baker,et al.  Making Sense of Nonsense Word Fluency: Determining Adequate Progress in Early First–Grade Reading , 2008 .

[22]  Carrie Thomas Beck,et al.  Using Nonsense Word Fluency to Predict Reading Proficiency in Kindergarten Through Second Grade for English Learners and Native English Speakers , 2008 .

[23]  Deborah C. Simmons,et al.  The Importance and Decision-Making Utility of a Continuum of Fluency-Based Indicators of Foundational Reading Skills for Third-Grade High-Stakes Outcomes , 2001 .

[24]  Huub van den Bergh,et al.  On the Construct Validity of Multiple- Choice Items for Reading Comprehension , 1990 .

[25]  William H. Rupley,et al.  Content, domain, and word knowledge: Relationship to comprehension of narrative and expository text , 1996 .

[26]  Russell Gersten,et al.  Story Grammar: An Approach for Promoting At-Risk Secondary Students' Comprehension of Literature , 1990, The Elementary School Journal.

[27]  Israel Chikalanga,et al.  A suggested taxonomy of inferences for the reading teacher , 1992 .

[28]  E. Fox The Role of Reader Characteristics in Processing and Learning From Informational Text , 2009 .

[29]  C. Perfetti,et al.  Linguistic complexity and text comprehension : readability issues reconsidered , 1989 .

[30]  Jane Oakhill,et al.  Issues of causality in children’s reading comprehension , 2007 .

[31]  S. Deno,et al.  Curriculum-Based Measurement: The Emerging Alternative , 1985, Exceptional children.

[32]  S. McCormick Disabled Readers' Erroneous Responses to Inferential Comprehension Questions: Description and Analysis. , 1992 .

[33]  Randy G. Floyd,et al.  Differential Competencies Contributing to Children's Comprehension of Narrative and Expository Texts , 2008 .

[34]  P. David Pearson,et al.  Moving From the Old to the New: Research on Reading Comprehension Instruction , 1991 .

[35]  S. Jay Samuels,et al.  Toward a theory of automatic information processing in reading , 1974 .

[36]  Robert F. Lorch,et al.  The effects of readers’ goals on inference generation and memory for texts , 2001, Memory & cognition.

[37]  Philip M. McCarthy,et al.  Using temporal cohesion to predict temporal coherence in narrative and expository texts , 2007, Behavior research methods.

[38]  Catherine E. Snow,et al.  Preventing reading difficulties in young children , 1998 .

[39]  Theodore J. Christ,et al.  Curriculum-based measurement of oral reading: Passage equivalence and probe-set development , 2009 .

[40]  W. Hunter,et al.  Which Comprehension? Artifacts in the Measurement of Reading Comprehension , 1980 .

[41]  Karl Koenke,et al.  Teaching Reading in the Content Areas. , 1978 .

[42]  Ann Grafstein,et al.  The linguistic assumptions underlying readability formulae , 2001 .

[43]  Edward J. Kameenui,et al.  What Reading Research Tells Us about Children with Diverse Learning Needs: Bases and Basics. The LEA Series on Special Education and Disability. , 1998 .

[44]  Julie Alonzo,et al.  Grade‐Level Invariance of a Theoretical Causal Structure Predicting Reading Comprehension With Vocabulary and Oral Reading Fluency , 2005 .

[45]  Donald Hedeker,et al.  Full-Information Item Bifactor Analysis of Graded Response Data , 2007 .

[46]  Keith Zvoch A Longitudinal Examination of the Academic Year and Summer Learning Rates of Full- and Half-Day Kindergartners , 2009 .

[47]  Steven A. Stahl,et al.  Children's reading comprehension and assessment , 2005 .

[48]  T. Trabasso,et al.  Constructing inferences during narrative text comprehension. , 1994 .

[49]  P. David Pearson,et al.  The Assessment of Reading Comprehension: A Review of Practices—Past, Present, and Future , 2005 .

[50]  Mack D. Burke,et al.  Use of Story-Mapping to Increase the Story-Grammar Text Comprehension of Elementary Students with Learning Disabilities , 2004 .

[51]  Mark S. Seidenberg,et al.  PSYCHOLOGICAL SCIENCE IN THE PUBLIC INTEREST HOW PSYCHOLOGICAL SCIENCE INFORMS THE TEACHING OF READING , 2022 .

[52]  E. Ryan,et al.  Metacognitive Differences Between Skilled and Less Skilled Readers: Remediating Deficits Through Story Grammar and Attribution Training. , 1984 .

[53]  M. Daneman,et al.  A new tool for measuring and understanding individual differences in the component processes of reading comprehension , 2001 .

[54]  Mary DeKonty Applegate,et al.  Levels of Thinking Required by Comprehension Questions in Informal Reading Inventories. , 2002 .

[55]  Hillel Goelman Selective attention in language comprehension: Children's processing of expository and narrative discourse∗ , 1982 .

[56]  S. West,et al.  A Comparison of Bifactor and Second-Order Models of Quality of Life , 2006, Multivariate behavioral research.

[57]  Richard Beach,et al.  The Effects of Text Structure Instruction on Middle-Grade Students' Comprehension and Production of Expository Text. , 1984 .

[58]  Jason M Nelson,et al.  Passageless Comprehension on the Nelson-Denny Reading Test: Well Above Chance for University Students , 2010, Journal of learning disabilities.

[59]  Joshua Lawrence,et al.  English vocabulary trajectories of students whose parents speak a language other than English: steep trajectories and sharp summer setback , 2012 .

[60]  Charles A. Perfetti,et al.  The Acquisition of Reading Comprehension Skill , 2008 .

[61]  Rolf A. Zwaan,et al.  The influence of language proficiency and comprehension skill on situation‐model construction , 1996 .

[62]  A. Bus,et al.  Phonological awareness and early reading : A meta-analysis of experimental training studies , 1999 .

[63]  Edward J. Kameenui,et al.  Direct Instruction Reading , 1979 .

[64]  Charles Hulme,et al.  The science of reading: A handbook. , 2005 .

[65]  Jay R. Campbell Single Instrument, Multiple Measures: Considering the Use of Multiple Item Formats to Assess Reading Comprehension , 2005 .

[66]  Arthur C. Graesser,et al.  The psychology of science text comprehension , 2014 .

[67]  Donald Hedeker,et al.  Full-information item bi-factor analysis , 1992 .

[68]  Janet S. Twyman,et al.  Teaching Reading Comprehension , 1978 .

[69]  J. Oakhill,et al.  Levels of Comprehension Monitoring and Working Memory in Good and Poor Comprehenders , 2005 .

[70]  Julie Alonzo,et al.  Examining the Technical Adequacy of Second-Grade Reading Comprehension Measures in a Progress Monitoring Assessment System. Technical Report # 08-08. , 2008 .

[71]  Charles A. Perfetti,et al.  Comprehending written language: a blueprint of the reader , 2000 .

[72]  Kate Nation,et al.  Children's Reading Comprehension Difficulties , 2008 .

[73]  Jack M Fletcher,et al.  Form effects on the estimation of students' oral reading fluency using DIBELS. , 2008, Journal of school psychology.

[74]  M. Barnes,et al.  Comprehension skill, inference-making ability, and their relation to knowledge , 2001, Memory & cognition.

[75]  Marilyn Jager Adams,et al.  Beginning To Read: Thinking and Learning about Print. , 1991 .

[76]  Joseph P. Magliano,et al.  Chapter 9 Toward a Comprehensive Model of Comprehension , 2009 .

[77]  Carrie Thomas Beck,et al.  Reading Fluency as a Predictor of Reading Proficiency in Low-Performing, High-Poverty Schools , 2008 .

[78]  W. Kintsch The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[79]  A. O'connell,et al.  Growing readers : A hierarchical linear model of children's reading growth during the first 2 years of school , 2006 .

[80]  Rollanda E. O'Connor,et al.  The Role of Working Memory and Fluency Practice on the Reading Comprehension of Students Who Are Dysfluent Readers , 2009, Journal of learning disabilities.

[81]  Lisa A. Lenhart,et al.  Reading and learning to read , 1987 .

[82]  Cynthia H. Brock,et al.  Teaching reading to every child , 1978 .

[83]  David Watson,et al.  Parsing the general and specific components of depression and anxiety with bifactor modeling , 2008, Depression and anxiety.

[84]  Julie Alonzo,et al.  easyCBM[R] Reading Criterion Related Validity Evidence: Washington State Test 2009-2010. Technical Report #1101. , 2011 .

[85]  J. Jaap Tuinman,et al.  Determining the Passage Dependency of Comprehension Questions in 5 Major Tests. , 1973 .

[86]  J. Oakhill,et al.  Children's Reading Comprehension Ability: Concurrent Prediction by Working Memory, Verbal Ability, and Component Skills. , 2004 .

[87]  Dolores Durkin,et al.  Teaching them to read , 1970 .

[88]  R. Freedle,et al.  Does the text matter in a multiple-choice test of comprehension? the case for the construct validity of TOEFL's minitalks , 1999 .

[89]  Examining Readability Estimates’ Predictions of Students’ Oral Reading Rate: Spache, Lexile, and Forcast , 2010 .

[90]  Julie Alonzo,et al.  Alternate Form and Test-Retest Reliability of easyCBM Reading Measures. Technical Report # 0906. , 2009 .

[91]  H. Bozdogan,et al.  Akaike's Information Criterion and Recent Developments in Information Complexity. , 2000, Journal of mathematical psychology.

[92]  Rolf A. Zwaan,et al.  Constructing Multidimensional Situation Models During Reading , 1998 .

[93]  Julie Alonzo,et al.  Technical Adequacy of the easyCBM Reading Measures (Grades 3-7), 2009-2010 Version. Technical Report #1005. , 2010 .

[94]  Colin M. Brown,et al.  The neurocognition of language , 2000 .

[95]  David T. Burkam,et al.  Social-Class Differences in Summer Learning Between Kindergarten and First Grade: Model Specification and Estimation , 2004 .