Transfer of Test-Enhanced Learning: Meta-Analytic Review and Synthesis

Attempting recall of information from memory, as occurs when taking a practice test, is one of the most potent training techniques known to learning science. However, does testing yield learning that transfers to different contexts? In the present article, we report the findings of the first comprehensive meta-analytic review into that question. Our review encompassed 192 transfer effect sizes extracted from 122 experiments and 67 published and unpublished articles (N = 10,382) that together comprise more than 40 years of research. A random-effects model revealed that testing can yield transferrable learning as measured relative to a nontesting reexposure control condition (d = 0.40, 95% CI [0.31, 0.50]). That transfer of learning is greatest across test formats, to application and inference questions, to problems involving medical diagnoses, and to mediator and related word cues; it is weakest to rearranged stimulus-response items, to untested materials seen during initial study, and to problems involving worked examples. Moderator analyses further indicated that response congruency and elaborated retrieval practice, as well as initial test performance, strongly influence the likelihood of positive transfer. In two assessments for publication bias using PET-PEESE and various selection methods, the moderator effect sizes were minimally affected. However, the intercept predictions were substantially reduced, often indicating no positive transfer when none of the aforementioned moderators are present. Overall, our results motivate a three-factor framework for transfer of test-enhanced learning and have practical implications for the effective use of practice testing in educational and other training contexts.

[1]  Jeffrey D. Karpicke,et al.  The Power of Testing Memory Basic Research and Implications for Educational Practice , 2006 .

[2]  B. Bloom Taxonomy of educational objectives , 1956 .

[3]  E. Bjork,et al.  Optimizing multiple-choice tests as tools for learning , 2014, Memory & Cognition.

[4]  Henry L. Roediger,et al.  Test format and corrective feedback modify the effect of testing on long-term retention , 2007 .

[5]  Does Testing Increase Spontaneous Mediation in Learning Semantically Related Paired Associates? , 2017, Journal of experimental psychology. Learning, memory, and cognition.

[6]  S. Cormier,et al.  Transfer of learning: Contemporary research and applications. , 1987 .

[7]  Carol M Woods,et al.  Publication bias in research synthesis: sensitivity analysis using a priori weight functions. , 2005, Psychological methods.

[8]  Mark A. McDaniel,et al.  Quizzing in Middle-School Science: Successful Transfer Performance on Classroom Exams , 2013 .

[9]  Christopher N. Wahlheim,et al.  Memory consequences of looking back to notice change: Retroactive and proactive facilitation. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[10]  Danielle S. McNamara,et al.  Learning from texts: Effects of prior knowledge and text coherence , 1996 .

[11]  H. Roediger,et al.  Inexpensive techniques to improve education: Applying cognitive psychology to enhance educational practice , 2012 .

[12]  Gino Camp,et al.  A Short-Term Testing Effect in Cross-Language Recognition , 2012, Psychological science.

[13]  Jonathan W. Kelly,et al.  Retrieval enhances route knowledge acquisition, but only when movement errors are prevented. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[14]  L. E. Bourne,et al.  Some tests of an identical elements model of basic arithmetic skills. , 1996, Journal of experimental psychology. Learning, memory, and cognition.

[15]  Apa Publications,et al.  Reporting standards for research in psychology: why do we need them? What might they be? , 2008, The American psychologist.

[16]  D. Lakens,et al.  On the reproducibility of meta-analyses: six practical recommendations , 2016, BMC psychology.

[17]  Harold Pashler,et al.  Retrieval practice: the lack of transfer to deductive inferences , 2015, Psychonomic bulletin & review.

[18]  Cristina D. Zepeda,et al.  Beyond the Rainbow: Retrieval Practice Leads to Better Spelling than does Rainbow Writing , 2015, Educational Psychology Review.

[19]  M. McDaniel,et al.  Testing the testing effect in the classroom , 2007 .

[20]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement , 2009, BMJ.

[21]  Charlotte Ringsted,et al.  The effect of testing on skills learning , 2009, Medical education.

[22]  Aubteen Darabi,et al.  Acquisition of troubleshooting skills in a computer simulation: Worked example vs. conventional problem solving instructional strategies , 2007, Comput. Hum. Behav..

[23]  L. E. Bourne,et al.  On the cognitive structure of basic arithmetic skills: Operation, order, and symbol transfer effects. , 1994 .

[24]  Jeffrey D. Karpicke,et al.  The Testing Effect Is Alive and Well with Complex Materials , 2015 .

[25]  Charles P. Thompson,et al.  Recall facilitates subsequent recognition. , 1980 .

[26]  Gavriel Salomon,et al.  T RANSFER OF LEARNING , 1992 .

[27]  J. A. McGeoch The Psychology of Human Learning--An Introduction. , 1944 .

[28]  R. Schmidt,et al.  New Conceptualizations of Practice: Common Principles in Three Paradigms Suggest New Concepts for Training , 1992 .

[29]  Steven C. Pan,et al.  Does testing with feedback improve adult spelling skills relative to copying and reading? , 2015, Journal of experimental psychology. Applied.

[30]  Elizabeth Tipton,et al.  Robust variance estimation with dependent effect sizes: practical considerations including a software tutorial in Stata and spss , 2014, Research synthesis methods.

[31]  H. Ebbinghaus Über das Gedächtniss: Untersuchungen zur experimentellen Psychologie , 1885 .

[32]  C. Bray Transfer of learning. , 1928 .

[33]  Edwina E. Abott ON THE ANALYSIS OF THE FACTOR OF RECALL IN THE LEARNING PROCESS , 1909 .

[34]  Katherine A. Rawson,et al.  Why Testing Improves Memory: Mediator Effectiveness Hypothesis , 2010, Science.

[35]  R. Sternberg,et al.  Transfer on Trial: Intelligence, Cognition and Instruction , 1993 .

[36]  Genna Angello,et al.  Multiple-Choice Tests Exonerated, at Least of Some Charges , 2012, Psychological science.

[37]  Stephen W. Raudenbush,et al.  Analyzing effect sizes: Random-effects models. , 2009 .

[38]  J. K. Chan,et al.  When does Retrieval Induce Forgetting and When does it Induce Facilitation? Implications for Retrieval Inhibition, Testing Effect, and Text Processing , 2009 .

[39]  Susan M. Barnett,et al.  When and where do we apply what we learn? A taxonomy for far transfer. , 2002, Psychological bulletin.

[40]  E. Delosh,et al.  Testing effects in mixed- versus pure-list designs , 2014, Memory & cognition.

[41]  R. Bjork,et al.  Why Tests Appear to Prevent Forgetting: A Distribution-Based Bifurcation Model. , 2011 .

[42]  E. Delosh,et al.  Mnemonic benefits of retrieval practice at short retention intervals , 2015, Memory.

[43]  Tamara van Gog,et al.  A Test of the Testing Effect: Acquiring Problem-Solving Skills From Worked Examples , 2012, Cogn. Sci..

[44]  Shana K. Carpenter,et al.  Impoverished cue support enhances subsequent retention: Support for the elaborative retrieval explanation of the testing effect , 2006, Memory & cognition.

[45]  Lisa Geraci,et al.  Superiority of variable to repeated practice in transfer on anagram solution , 2008, Psychonomic bulletin & review.

[46]  Harold Pashler,et al.  Testing beyond words: Using tests to enhance visuospatial map learning , 2007, Psychonomic bulletin & review.

[47]  Elizabeth Ligon Bjork,et al.  Multiple-choice testing as a desirable difficulty in the classroom , 2014 .

[48]  R. W. Bruce,et al.  Conditions of transfer of training. , 1933 .

[49]  John R. Anderson,et al.  The Transfer of Cognitive Skill , 1989 .

[50]  John Dunlosky,et al.  The Power of Successive Relearning: Improving Performance on Course Exams and Long-Term Retention , 2013 .

[51]  Jonathan W. Kelly,et al.  Tests enhance retention and transfer of spatial learning , 2012, Psychonomic bulletin & review.

[52]  Maria Grigoriadou,et al.  Exploring the effect of background knowledge and text cohesion on learning from texts in computer science , 2013 .

[53]  Peter P. J. L. Verkoeijen,et al.  Spacing and Testing Effects: A Deeply Critical, Lengthy, and At Times Discursive Review of the Literature , 2010 .

[54]  Arthur C. Graesser,et al.  Organizing Instruction and Study to Improve Student Learning. IES Practice Guide. NCER 2007-2004. , 2007 .

[55]  Ashley N. D. Meyer,et al.  Taking the testing effect beyond the college freshman: benefits for lifelong learning. , 2013, Psychology and aging.

[56]  W. Runquist,et al.  Some effects of remembering on forgetting , 1983, Memory & cognition.

[57]  Paul W. Foos,et al.  Using Tests as Learning Opportunities. , 1988 .

[58]  E. Delosh,et al.  Testing effects for common versus proper names , 2011, Memory.

[59]  Michael C. Mozer,et al.  Using Testing to Enhance Learning: A Comparison of Two Hypotheses , 1997 .

[60]  Philippe C. Duchastel,et al.  Retention of prose following testing with different types of tests , 1981 .

[61]  Jack L. Vevea,et al.  A general linear model for estimating effect size in the presence of publication bias , 1995 .

[62]  C. K. Cheng Effect of Multiple-choice Testing on Memory Retention – Cue-target Symmetry , 2014 .

[63]  Timothy C. Rickard,et al.  Testing enhances learning across a range of episodic memory abilities , 2015 .

[64]  Hannah R Rothstein,et al.  A basic introduction to fixed‐effect and random‐effects models for meta‐analysis , 2010, Research synthesis methods.

[65]  R. Bjork,et al.  Testing facilitates the regulation of subsequent study , 2014 .

[66]  Henry L. Roediger,et al.  Ten benefits of testing and their applications to educational practice. , 2011 .

[67]  Jeffrey D. Karpicke,et al.  Retrieval practice with short-answer, multiple-choice, and hybrid tests , 2014, Memory.

[68]  Lisa K. Fazio,et al.  The Optimal Learning Strategy Depends on Learning Goals and Processes: Retrieval Practice Versus Worked Examples , 2019, Journal of Educational Psychology.

[69]  Doug Rohrer,et al.  Tests enhance the transfer of learning. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[70]  Remy M. J. P. Rikers,et al.  The testing effect for mediator final test cues and related final test cues in online and laboratory experiments , 2016, BMC Psychology.

[71]  G. Avci Transfer of the Testing Effect: Just How Powerful Is It? , 2011 .

[72]  Jeffrey D. Karpicke,et al.  Retrieval-Based Learning: An Episodic Context Account , 2014 .

[73]  Richard C. Anderson,et al.  Conditions under which feedback facilitates learning from programmed lessons. , 1972 .

[74]  M. McDaniel,et al.  Make It Stick , 2014 .

[75]  Shana K. Carpenter,et al.  The effects of tests on learning and forgetting , 2008, Memory & cognition.

[76]  Shana K. Carpenter,et al.  Semantic information activated during retrieval contributes to later retention: Support for the mediator effectiveness hypothesis of the testing effect. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[77]  Kathleen B McDermott,et al.  Retrieval-induced facilitation: initially nontested material can benefit from prior testing of related material. , 2006, Journal of experimental psychology. General.

[78]  Steven C. Pan,et al.  Testing with Feedback Yields Potent, but Piecewise, Learning of History and Biology Facts. , 2016 .

[79]  Robert A Bjork,et al.  When does testing enhance retention? A distribution-based interpretation of retrieval as a memory modifier. , 2011, Journal of experimental psychology. Learning, memory, and cognition.

[80]  H. Spencer The Principles of Psychology - Vol. I , 2016 .

[81]  Neil W Mulligan,et al.  Negative and positive testing effects in terms of item-specific and relational information. , 2015, Journal of experimental psychology. Learning, memory, and cognition.

[82]  Richard C. Anderson,et al.  On asking people questions about what they are reading , 1975 .

[83]  R. Mayer,et al.  Eight Ways to Promote Generative Learning , 2016 .

[84]  R. Mayer,et al.  Multimedia Learning: Frontmatter , 2001 .

[85]  Steven C. Pan,et al.  A dual memory theory of the testing effect , 2018, Psychonomic bulletin & review.

[86]  Jeffrey D. Karpicke Retrieval-Based Learning , 2012 .

[87]  Mark A McDaniel,et al.  The JOIs of text comprehension: Supplementing retrieval practice to enhance inference performance. , 2016, Journal of experimental psychology. Applied.

[88]  N G HANAWALT,et al.  The effect of recall upon recognition. , 1961, Journal of experimental psychology.

[89]  Li Jing,et al.  The Advantage Effect of Retrieval Practice on Memory Retention and Transfer: Based on Explanation of Cognitive Load Theory , 2013 .

[90]  Kathleen B. McDermott,et al.  Test-potentiated learning: distinguishing between direct and indirect effects of tests. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[91]  Mark A. McDaniel,et al.  Altering memory representations through retrieval. , 1985 .

[92]  W. Estes Role of response availability in the effects of cued-recall tests on memory. , 1979 .

[93]  Mark A. McDaniel,et al.  The testing effect with authentic educational materials: A cautionary note , 2014 .

[94]  J. K. Chan,et al.  Long-term effects of testing on the recall of nontested materials , 2010, Memory.

[95]  Olusola O. Adesope,et al.  Rethinking the Use of Tests: A Meta-Analysis of Practice Testing , 2017 .

[96]  M. McDaniel,et al.  The Read-Recite-Review Study Strategy , 2009, Psychological science.

[97]  M. McDaniel,et al.  Multiple-Choice and Short-Answer Quizzing on Equal Footing in the Classroom , 2019, The Cambridge Handbook of Cognition and Education.

[98]  A. C. Butler,et al.  The critical role of retrieval practice in long-term retention , 2011, Trends in Cognitive Sciences.

[99]  Elizabeth Tipton,et al.  Robust variance estimation in meta‐regression with dependent effect size estimates , 2010, Research synthesis methods.

[100]  Monica H. Lamm,et al.  A Classroom Study on the Relationship Between Student Achievement and Retrieval-Enhanced Learning , 2016 .

[101]  Jason R. Finley,et al.  Benefits from retrieval practice are greater for students with lower working memory capacity , 2017, Memory.

[102]  R. W. Kulhavy,et al.  Feedback in written instruction: The place of response certitude , 1989 .

[103]  Edward Vul,et al.  What types of learning are enhanced by a cued recall test? , 2006, Psychonomic bulletin & review.

[104]  Allan Collins,et al.  A spreading-activation theory of semantic processing , 1975 .

[105]  C. Osgood The similarity paradox in human learning; a resolution. , 1949, Psychological review.

[106]  E. Hirshman,et al.  Investigations of the testing effect. , 1996 .

[107]  R. Shiffrin,et al.  Search of associative memory. , 1981 .

[108]  Tyler A. Kummer,et al.  Teaching to the Test…or Testing to Teach: Exams Requiring Higher Order Thinking Skills Encourage Greater Conceptual Understanding , 2014 .

[109]  Cheryl I. Johnson,et al.  A Testing Effect with Multimedia Learning , 2009 .

[110]  Andrew C. Butler,et al.  Explanation Feedback Is Better Than Correct Answer Feedback for Promoting Transfer of Learning , 2013 .

[111]  W. Dunlap,et al.  Meta-Analysis of Experiments With Matched Groups or Repeated Measures Designs , 1996 .

[112]  H. Pashler,et al.  The Value of Standardized Testing , 2015 .

[113]  J. F. Voss,et al.  Retention of Prose Materials as a Function of Postacquisition Testing. , 1975 .

[114]  Andrew C Butler,et al.  Repeated testing produces superior transfer of learning relative to repeated studying. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[115]  Douglas P Larsen,et al.  The importance of seeing the patient: test-enhanced learning with standardized patients and written tests improves clinical application of knowledge , 2013, Advances in health sciences education : theory and practice.

[116]  Jeffrey D. Karpicke,et al.  The effect of type and timing of feedback on learning from multiple-choice tests. , 2007, Journal of experimental psychology. Applied.

[117]  Mark A. McDaniel,et al.  Tests and test feedback as learning sources , 1991 .

[118]  Christopher A. Rowland The effect of testing versus restudy on retention: a meta-analytic review of the testing effect. , 2014, Psychological bulletin.

[119]  N. Bies-Hernandez Examining the Testing Effect using the Dual-Process Signal Detection Model , 2013 .

[120]  Jeffrey D. Karpicke,et al.  Retrieval-based learning: The need for guided retrieval in elementary school children , 2014 .

[121]  F. N. Dempster,et al.  Distributing and Managing the Conditions of Encoding and Practice , 1996 .

[122]  Edward L. Thorndike,et al.  Elements of Psychology , 1893 .

[123]  Richard C. Anderson,et al.  Delay-retention effect with multiple-choice tests , 1972 .

[124]  Juana M. Ortega-Tudela,et al.  Further evidence that concept mapping is not better than repeated retrieval as a tool for learning from texts , 2015 .

[125]  Mark A. McDaniel,et al.  Using quizzes to enhance summative-assessment performance in a web-based class: An experimental study , 2012 .

[126]  Jeffrey D. Karpicke,et al.  Retrieval Practice Produces More Learning than Elaborative Studying with Concept Mapping , 2011, Science.

[127]  D. Perkins,et al.  Rocky Roads to Transfer: Rethinking Mechanism of a Neglected Phenomenon , 1989 .

[128]  R. Haskell Transfer of Learning: Cognition, Instruction, and Reasoning , 2000 .

[129]  Christiaan Hamaker The Effects of Adjunct Questions on Prose Learning , 1986 .

[130]  H Stanislaw,et al.  Calculation of signal detection theory measures , 1999, Behavior research methods, instruments, & computers : a journal of the Psychonomic Society, Inc.

[131]  David Hartman Learning, Remembering, Believing: Enhancing Human Performance , 2010 .

[132]  John D. Bransford,et al.  Levels of processing versus transfer appropriate processing , 1977 .

[133]  Shana K. Carpenter,et al.  Enhancing learning and retarding forgetting: Choices and consequences , 2007, Psychonomic bulletin & review.

[134]  Gerdien G. van Eersel,et al.  The Testing Effect and Far Transfer: The Role of Exposure to Key Information , 2016, Front. Psychol..

[135]  K. Holyoak,et al.  Analogical problem solving , 1980, Cognitive Psychology.

[136]  G. Glass,et al.  Meta-analysis in social research , 1981 .

[137]  Tamara van Gog,et al.  Testing After Worked Example Study Does Not Enhance Delayed Problem-Solving Performance Compared to Restudy , 2015 .

[138]  H. Pashler,et al.  When does feedback facilitate learning of words? , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[139]  W. Popham Classroom Assessment: What Teachers Need to Know , 1995 .

[140]  R. Bjork,et al.  Testing facilitates the regulation of subsequent study time , 2014 .

[141]  Robert A. Bjork,et al.  A new theory of disuse and an old theory of stimulus fluctuation , 1992 .

[142]  L. E. Bourne,et al.  SOME TESTS OF AN IDENTICAL ELEMENTS MODEL OF BASIC ARITHMETIC SKILLS , 1996 .

[143]  Patrice M. Bain,et al.  The Value of Applied Research: Retrieval Practice Improves Classroom Learning and Recommendations from a Teacher, a Principal, and a Scientist , 2012 .

[144]  W. Kintsch,et al.  Differential effects of study and test trials on long-term recognition and recall , 1971 .

[145]  Jennifer Wiley,et al.  Testing the limits of testing effects using completion tests , 2011, Memory.

[146]  Edward Leonard Kelly Transfer of Training: An Analytic Study , 1962 .

[147]  Mary T. Veltre,et al.  Transfer-appropriate processing in the testing effect , 2015, Memory.

[148]  Synthesizing Results from Replication Studies Using Robust Variance Estimation: Corrections When the Number of Studies Is Small. , 2014 .

[149]  M. Chodorow,et al.  The Usefulness of Retrieval Practice and Review-Only Practice for Answering Conceptually Related Test Questions , 2009, The Journal of general psychology.

[150]  C. Judd,et al.  The relation of special training and general intelligence , 1908 .

[151]  Henry L. Roediger,et al.  Retrieval modes produce dissociations in memory for surface information. , 1987 .

[152]  Steven C. Pan,et al.  Does Retrieval Practice Enhance Learning and Transfer Relative to Restudy for Term-Definition Facts? , 2017, Journal of experimental psychology. Applied.

[153]  John Dunlosky,et al.  When Is Practice Testing Most Effective for Improving the Durability and Efficiency of Student Learning? , 2012 .

[154]  T. Stanley Limitations of PET-PEESE and Other Meta-Analysis Methods , 2017 .

[155]  John Sweller,et al.  Not New, but Nearly Forgotten: the Testing Effect Decreases or even Disappears as the Complexity of Learning Materials Increases , 2015 .

[156]  Shana K. Carpenter,et al.  Cue strength as a moderator of the testing effect: the benefits of elaborative retrieval. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[157]  Heather Carnahan,et al.  Test‐enhanced learning and its effect on comprehension and diagnostic accuracy , 2014, Medical education.

[158]  L. Hedges Estimation of effect size from a series of independent experiments. , 1982 .

[159]  Harold Pashler,et al.  Effects of testing on learning of functions , 2011, Psychonomic bulletin & review.

[160]  S. Brookhart Making the Most of Multiple Choice. , 2015 .

[161]  Katherine A. Rawson,et al.  The interim test effect: Testing prior material can facilitate the learning of new material , 2011, Psychonomic bulletin & review.

[162]  Hristos Doucouliagos,et al.  Meta‐regression approximations to reduce publication selection bias , 2014, Research synthesis methods.

[163]  Steven C. Pan,et al.  Does test-enhanced learning transfer for triple associates? , 2016, Memory & cognition.

[164]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[165]  Shana K. Carpenter Testing Enhances the Transfer of Learning , 2012 .

[166]  W. Balch,et al.  Practice versus Review Exams and Final Exam Performance , 1998 .

[167]  فيصل أحمد عبد الفتاح تصنيف التعلم و التدريس و التقييم : مراجعة لتصنيف بلوم للأهداف التعليمية = Taxonomy for Learning , Teaching and Assessing , A : A Revision of Bloom's Taxonomy of Educational Objectives , 2014 .

[168]  Bert Reynvoet,et al.  Mechanisms of masked priming: a meta-analysis. , 2009, Psychological bulletin.

[169]  Henry L. Roediger,et al.  Testing improves long-term retention in a simulated classroom setting , 2007 .

[170]  John Dunlosky,et al.  Improving Students’ Learning With Effective Learning Techniques: Promising Directions From Cognitive and Educational Psychology , 2012 .

[171]  Steven C. Pan,et al.  Sleep and motor learning: Is there room for consolidation? , 2015, Psychological bulletin.

[172]  Aaron S Benjamin,et al.  The reminding effect: presentation of associates enhances memory for related words in a list. , 2014, Journal of experimental psychology. General.

[173]  G. Āllport Personality: A Psychological Interpretation , 1938 .

[174]  H. Pashler,et al.  The influence of retrieval on retention , 1992, Memory & cognition.

[175]  Alice F. Healy,et al.  The Procedural Reinstatement Principle: Studies on Training, Retention, and Transfer. , 2005 .

[176]  James W. Pellegrino,et al.  The importance of constructive comprehension processes in learning from tests , 2013 .

[177]  David N. Rapp,et al.  Retrieval (sometimes) enhances learning: Performance pressure reduces the benefits of retrieval practice , 2014 .

[178]  George Mandler,et al.  Appearance and Reality: Does a Recognition Test Really Improve Subsequent Recall and Recognition?. , 1981 .

[179]  P. Lachenbruch Statistical Power Analysis for the Behavioral Sciences (2nd ed.) , 1989 .

[180]  W. James,et al.  The Principles of Psychology. , 1983 .

[181]  J. Mestre Transfer of learning from a modern multidisciplinary perspective , 2005 .

[182]  Jeffrey D. Karpicke,et al.  Learning with retrieval-based concept mapping. , 2014 .

[183]  Neil W Mulligan,et al.  The negative testing effect and multifactor account. , 2013, Journal of experimental psychology. Learning, memory, and cognition.

[184]  C. St-Onge,et al.  The benefits of testing for learning on later performance , 2014, Advances in Health Sciences Education.

[185]  D. P. Hartmann,et al.  Meta-analysis: Techniques, applications, and functions. , 1983 .

[186]  Keith J. Holyoak,et al.  The cognitive basis of knowledge transfer. , 1987 .

[187]  J. Sweller,et al.  High Element Interactivity Information During Problem Solving may Lead to Failure to Obtain the Testing Effect , 2015 .

[188]  D. Detterman The case for the prosecution: Transfer as an epiphenomenon. , 1996 .

[189]  Katherine A. Rawson,et al.  Does the benefit of testing depend on lag, and if so, why? Evaluating the elaborative retrieval hypothesis , 2014, Memory & Cognition.

[190]  Christopher N. Wahlheim,et al.  Test-enhanced learning of natural concepts: effects on recognition memory, classification, and metacognition. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[191]  Kalif E. Vaughn,et al.  Effects of criterion level on associative memory: Evidence for associative asymmetry , 2014 .

[192]  John Dunlosky,et al.  Optimizing schedules of retrieval practice for durable and efficient learning: how much is enough? , 2011, Journal of experimental psychology. General.

[193]  L. T. Frase,et al.  Effect of question location, pacing, and mode upon retention of prose material. , 1968, Journal of educational psychology.

[194]  Henry L. Roediger,et al.  Generalizing test-enhanced learning from the laboratory to the classroom , 2007, Psychonomic bulletin & review.

[195]  Yiyi Liu,et al.  When does the test-study-test sequence optimize learning and retention? , 2015, Journal of experimental psychology. Applied.

[196]  Luke G. Eglington,et al.  Retrieval Practice Benefits Deductive Inference , 2018 .

[197]  John R. Anderson ACT: A simple theory of complex cognition. , 1996 .

[198]  Sue Morris,et al.  The testing effect, collaborative learning, and retrieval-induced facilitation in a classroom setting , 2009 .

[199]  C. Ringsted,et al.  The testing effect on skills learning might last 6 months , 2010, Advances in health sciences education : theory and practice.

[200]  D. Moher,et al.  Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement , 2009, BMJ : British Medical Journal.

[201]  C. Ringsted,et al.  Test‐enhanced learning may be a gender‐related phenomenon explained by changes in cortisol level , 2011, Medical education.

[202]  Mark A McDaniel,et al.  Both multiple-choice and short-answer quizzes enhance later exam performance in middle and high school classes. , 2014, Journal of experimental psychology. Applied.

[203]  Harry H. Wylie An experimental study of transfer of response in the white rat , 1919 .

[204]  Philippe C. Duchastel,et al.  Testing versus review: Effects on retention. , 1982 .

[205]  Mark J. Huff,et al.  The costs and benefits of testing and guessing on recognition memory. , 2016, Journal of experimental psychology. Learning, memory, and cognition.

[206]  N. Laubscher,et al.  Normalizing the Noncentral $t$ and $F$ Distributions , 1960 .

[207]  Richard P. DeShon,et al.  Combining effect size estimates in meta-analysis with repeated measures and independent-groups designs. , 2002, Psychological methods.

[208]  Douglas P. Larsen,et al.  Comparative effects of test‐enhanced learning and self‐explanation on long‐term retention , 2013, Medical education.