The testing effect with authentic educational materials: A cautionary note

Abstract Despite considerable evidence that testing benefits subsequent retrieval of information, it remains uncertain whether this effect extends to topically related information with authentic classroom materials. In the current study we first profile the way in which quizzing is used in the classroom through a survey of introductory psychology instructors. The survey results indicate that, instructors frequently use related but different questions on quizzes and tests unlike many laboratory experiments that use identical questions. In two subsequent experiments, participants studied information from a college biology textbook, were quizzed twice, and given a final test. The items on the final test were either identical to or were related but different than the quiz items. Experiment 1 showed that testing produced the typical robust testing effect for repeated items, but there was no significant effect of testing for topically related items. In Experiment 2, participants could use their quizzes to guide restudy, and there was still no positive effect of testing for topically related information.

[1]  Mark A McDaniel,et al.  Both multiple-choice and short-answer quizzes enhance later exam performance in middle and high school classes. , 2014, Journal of experimental psychology. Applied.

[2]  I. Clark.  Formative Assessment: Assessment Is for Self-regulated Learning , 2012, Educational Psychology Review.

[3]  Jeffrey D. Karpicke,et al.  The Power of Testing Memory Basic Research and Implications for Educational Practice , 2006 .

[4]  Endel Tulving,et al.  The effects of presentation and recall of material in free-recall learning , 1967 .

[5]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[6]  Benjamin S. Bloom,et al.  A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives , 2000 .

[7]  Andrew C Butler,et al.  Repeated testing produces superior transfer of learning relative to repeated studying. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[8]  Harold Pashler,et al.  Using tests to enhance 8th grade students' retention of U.S. history facts , 2009 .

[9]  M. McDaniel,et al.  Test-enhanced learning in the classroom: long-term improvements from quizzing. , 2011, Journal of experimental psychology. Applied.

[10]  Doug Rohrer,et al.  Tests enhance the transfer of learning. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[11]  Henry L. Roediger,et al.  Test format and corrective feedback modify the effect of testing on long-term retention , 2007 .

[12]  Kevin C. Almeroth,et al.  Clickers in college classrooms: Fostering learning with questioning methods in large lecture classes , 2009 .

[13]  Keith B. Lyle,et al.  Retrieving Essential Material at the End of Lectures Improves Performance on Statistics Exams , 2011 .

[14]  Arnold L. Glass,et al.  The effect of distributed questioning with varied examples on exam performance on inference questions , 2009 .

[15]  Kathleen B McDermott,et al.  Retrieval-induced facilitation: initially nontested material can benefit from prior testing of related material. , 2006, Journal of experimental psychology. General.

[16]  Mark A. McDaniel,et al.  Using quizzes to enhance summative-assessment performance in a web-based class: An experimental study , 2012 .

[17]  Karee E. Dunn,et al.  A Critical Review of Research on Formative Assessment: The Limited Scientific Evidence of the Impact of Formative Assessment in Education , 2009 .

[18]  Jonathan W. Kelly,et al.  Tests enhance retention and transfer of spatial learning , 2012, Psychonomic bulletin & review.

[19]  Richard J. Stiggins,et al.  Classroom assessment for student learning : doing it right -- using it well , 2006 .

[20]  Henry L. Roediger,et al.  Examining the Testing Effect with Open-and Closed-book Tests , 2022 .

[21]  Susan M. Barnett,et al.  When and where do we apply what we learn? A taxonomy for far transfer. , 2002, Psychological bulletin.

[22]  Jeffrey D. Karpicke.  Retrieval-Based Learning , 2012 .

[23]  Henry L. Roediger,et al.  Testing improves long-term retention in a simulated classroom setting , 2007 .

[24]  Mark A. McDaniel,et al.  Quizzing in Middle-School Science: Successful Transfer Performance on Classroom Exams , 2013 .

[25]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[26]  Shana K. Carpenter.  Testing Enhances the Transfer of Learning , 2012 .

[27]  Thomas A. Angelo,et al.  Classroom Assessment Techniques: A Handbook for College Teachers. Second Edition. , 1993 .

[28]  Mark A. McDaniel,et al.  Test-Enhanced Learning in a Middle School Science Classroom: The Effects of Quiz Frequency and Placement. , 2011 .

[29]  Henry L. Roediger,et al.  Ten benefits of testing and their applications to educational practice. , 2011 .

[30]  John A. Glover,et al.  The "testing" phenomenon: Not gone but nearly forgotten. , 1989 .

[31]  Jeffrey D. Karpicke,et al.  Test-Enhanced Learning , 2006, Psychological science.

[32]  Mark A. McDaniel,et al.  Altering memory representations through retrieval. , 1985 .

[33]  M. McDaniel,et al.  The negative cascade of incongruent generative study-test processing in memory and metacomprehension , 2007, Memory & cognition.

[34]  Mark A. McDaniel,et al.  Tests and test feedback as learning sources , 1991 .

[35]  M. McDaniel,et al.  Testing the testing effect in the classroom , 2007 .