Comparing comprehension measured by multiple-choice and open-ended questions.

This study compared the nature of text comprehension as measured by multiple-choice format and open-ended format questions. Participants read a short text while explaining preselected sentences. After reading the text, participants answered open-ended and multiple-choice versions of the same questions based on their memory of the text content. The results indicated that performance on open-ended questions was correlated with the quality of self-explanations, but performance on multiple-choice questions was correlated with the level of prior knowledge related to the text. These results suggest that open-ended and multiple-choice format questions measure different aspects of comprehension processes. The results are discussed in terms of dual process theories of text comprehension.

[1]  Joseph P. Magliano,et al.  Assessing Reading Skill With a Think-Aloud Procedure and Latent Semantic Analysis , 2003 .

[2]  A. Collins,et al.  A schema-theoretic view of reading , 1977 .

[3]  Richard C. Anderson.  How to Construct Achievement Tests to Assess Comprehension , 1972 .

[4]  Henry L. Roediger,et al.  Test format and corrective feedback modify the effect of testing on long-term retention , 2007 .

[5]  Danielle S. McNamara,et al.  Learning from texts: Effects of prior knowledge and text coherence , 1996 .

[6]  R. Brooke Lea,et al.  Have We Been Searching for Meaning in All the Wrong Places? Defining the "Search After Meaning" Principle in Comprehension , 2005 .

[7]  Danielle S. McNamara,et al.  Improving Adolescent Students' Reading Comprehension with Istart , 2006 .

[8]  Jeffrey D. Karpicke,et al.  Test-Enhanced Learning , 2006, Psychological science.

[9]  C Sadler,et al.  Good question? , 1991, Nursing times.

[10]  Danielle S. McNamara,et al.  Self-Explanation Reading Training: Effects for Low-Knowledge Readers , 2004 .

[11]  M. Singer,et al.  Retrieving text inferences: Controlled and automatic influences , 2004, Memory & Cognition.

[12]  Susan R. Goldman,et al.  Answering questions from oceanography texts: Learner, task, and text characteristics , 1988 .

[13]  Edward J. O'Brien,et al.  What is readily available during reading? A memory‐based view of text processing , 1998 .

[14]  D. McNamara,et al.  The effect of metacomprehension judgment task on comprehension monitoring and metacognitive accuracy , 2012, Metacognition and Learning.

[15]  Walter Kintsch,et al.  Comprehension: A Paradigm for Cognition , 1998 .

[16]  Michelene T. H. Chi,et al.  Eliciting Self-Explanations Improves Understanding , 1994, Cogn. Sci..

[17]  John D. Bransford,et al.  Levels of processing versus transfer appropriate processing , 1977 .

[18]  W. Kintsch.  The role of knowledge in discourse comprehension: a construction-integration model. , 1988, Psychological review.

[19]  P. van den Broek,et al.  Integrating Memory-Based and Constructionist Processes in Accounts of Reading Comprehension , 2005 .

[20]  D. McNamara.  SERT: Self-Explanation Reading Training , 2004 .

[21]  Danielle S. McNAMARA and Joseph P. Magliano,et al.  Self-Explanation and Metacognition: The Dynamics of Reading , 2009 .

[22]  Leo G. M. Noordman,et al.  Readers' knowledge and the control of inferences in reading , 1992 .

[23]  Christine Bastin,et al.  The contribution of recollection and familiarity to recognition memory: a study of the effects of test format and aging. , 2003, Neuropsychology.

[24]  Harry Singer,et al.  Theoretical models and processes of reading , 1976 .

[25]  Richard C. Anderson,et al.  Learning to read in American schools : basal readers and content texts , 1984 .

[26]  Robert T Knight,et al.  The contribution of recollection and familiarity to yes–no and forced-choice recognition tests in healthy subjects and amnesics , 2000, Neuropsychologia.

[27]  Jerome L. Myers,et al.  Processing discourse roles in scripted narratives: The influences of context and world knowledge , 2004 .

[28]  Walter Kintsch,et al.  Information accretion and reduction in text processing: Inferences , 1993 .

[29]  Larry L. Jacoby,et al.  Dissociating Automatic and Consciously Controlled Effects of Study/Test Compatibility , 1996 .

[30]  Ryszard S. Michalski,et al.  Learning and Cognition , 1995, WOCFAI.

[31]  A. Yonelinas.  The Nature of Recollection and Familiarity: A Review of 30 Years of Research , 2002 .

[32]  Danielle S. McNamara,et al.  A multidimensional framework to evaluate reading assessment tools. , 2007 .

[33]  Timothy P. McNamara,et al.  Transfer-appropriate processing (TAP) , 2000 .

[34]  W. Kintsch,et al.  Are Good Texts Always Better? Interactions of Text Coherence, Background Knowledge, and Levels of Understanding in Learning From Text , 1996 .

[35]  Danielle S. McNamara,et al.  Influence of Question Format and Text Availability on the Assessment of Expository Text Comprehension , 2007 .

[36]  J. Aggleton,et al.  Amnesia and recognition memory: A re-analysis of psychometric data , 1996, Neuropsychologia.