The Power of Testing Memory Basic Research and Implications for Educational Practice

A powerful way of improving one's memory for material is to be tested on that material. Tests enhance later retention more than additional study of the material, even when tests are given without feedback. This surprising phenomenon is called the testing effect, and although it has been studied by cognitive psychologists sporadically over the years, today there is a renewed effort to learn why testing is effective and to apply testing in educational settings. In this article, we selectively review laboratory studies that reveal the power of testing in improving retention and then turn to studies that demonstrate the basic effects in educational settings. We also consider the related concepts of dynamic testing and formative assessment as other means of using tests to improve learning. Finally, we consider some negative consequences of testing that may occur in certain circumstances, though these negative effects are often small and do not cancel out the large positive effects of testing. Frequent testing in the classroom may boost educational achievement at all levels of education.

[1]  M. McDaniel,et al.  Testing the testing effect in the classroom , 2007 .

[2]  Henry L. Roediger,et al.  Testing improves long-term retention in a simulated classroom setting , 2007 .

[3]  Henry L. Roediger,et al.  Test format and corrective feedback modify the effect of testing on long-term retention , 2007 .

[4]  M. McDaniel,et al.  The negative cascade of incongruent generative study-test processing in memory and metacomprehension , 2007, Memory & cognition.

[5]  Kathleen B McDermott,et al.  Retrieval-induced facilitation: initially nontested material can benefit from prior testing of related material. , 2006, Journal of experimental psychology. General.

[6]  Henry L. Roediger,et al.  When additional multiple‐choice lures aid versus hinder later memory , 2006 .

[7]  Asher Koriat,et al.  Illusions of competence during study can be remedied by manipulations that enhance learners’ sensitivity to retrieval conditions at test , 2006, Memory & cognition.

[8]  David A Balota,et al.  Does expanded retrieval produce benefits over equal-interval spacing? Explorations of spacing effects in healthy aging and early stage Alzheimer's disease. , 2006, Psychology and aging.

[9]  Shana K. Carpenter,et al.  Impoverished cue support enhances subsequent retention: Support for the elaborative retrieval explanation of the testing effect , 2006, Memory & cognition.

[10]  K. McDermott.  Paradoxical effects of testing: Repeated retrieval attempts enhance the likelihood of later accurate and false recall , 2006, Memory & cognition.

[11]  Jay McTighe,et al.  Seven Practices for Effective Learning , 2005 .

[12]  Dylan Wiliam,et al.  Classroom Assessment: Minute by Minute, Day by Day In classrooms that use assessment to support learning, teachers continually adapt instruction to meet student needs. , 2005 .

[13]  Matthew G. Rhodes,et al.  Modes of cognitive control in recognition and source memory: Depth of retrieval , 2005, Psychonomic bulletin & review.

[14]  Elizabeth J Marsh,et al.  The Positive and Negative Consequences of Multiple-choice Testing , 2022 .

[15]  Shana K. Carpenter,et al.  Application of the Testing and Spacing Effects to Name Learning , 2005 .

[16]  Matthew G. Rhodes,et al.  Age Differences in Depth of Retrieval: Memory for Foils. , 2005 .

[17]  R. Bjork,et al.  Illusions of competence in monitoring one's knowledge during study. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[18]  M. Ewers,et al.  Different rates of forgetting following study versus test trials , 2003, Memory.

[19]  Harold Pashler,et al.  Is temporal spacing of tests helpful even when it inflates error rates? , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[20]  Michael C. Anderson.  Rethinking interference theory: Executive control and the mechanisms of forgetting. , 2003 .

[21]  T. Schack,et al.  Dynamic testing , 2003 .

[22]  Frank C. Leeming,et al.  The Exam-A-Day Procedure Improves Performance in Psychology Classes , 2002 .

[23]  R. Sternberg,et al.  Assessing intellectual potential in rural Tanzanian school children , 2002 .

[24]  Robert J. Sternberg,et al.  Dynamic Testing: The Nature and Measurement of Learning Potential , 2001 .

[25]  William L. Cull,et al.  Untangling the benefits of multiple study opportunities and repeated testing for cued recall , 2000 .

[26]  Alan S. Brown,et al.  The negative suggestion effect: Pondering incorrect alternatives may be hazardous to your knowledge. , 1999 .

[27]  Michael C. Anderson,et al.  Integration as a general boundary condition on retrieval-induced forgetting , 1999 .

[28]  R. Bjork,et al.  The mismeasure of memory: when retrieval fluency is misleading as a metamnemonic index. , 1998, Journal of experimental psychology. General.

[29]  P. Black,et al.  Assessment and Classroom Learning , 1998 .

[30]  C. Steele.  A threat in the air. How stereotypes shape intellectual identity and performance. , 1997, The American psychologist.

[31]  William L. Cull,et al.  Expanding understanding of the expanding-pattern-of-retrieval mnemonic: Toward confidence in applicability , 1996 .

[32]  E. Hirshman,et al.  Investigations of the testing effect. , 1996 .

[33]  J. Wixted,et al.  Analyzing the dynamics of free recall: An integrative review of the empirical literature , 1994, Psychonomic bulletin & review.

[34]  Roderick Hunt,et al.  The Enigma of Organization and Distinctiveness , 1993 .

[35]  Thomas C. Toppino,et al.  Generality of the Negative Suggestion Effect in Objective Tests. , 1993 .

[36]  H. Pashler,et al.  The influence of retrieval on retention , 1992, Memory & cognition.

[37]  T. O. Nelson,et al.  Importance of the kind of cue for judgments of learning (JOL) and the delayed-JOL effect , 1992, Memory & cognition.

[38]  R. Schmidt,et al.  New Conceptualizations of Practice: Common Principles in Three Paradigms Suggest New Concepts for Training , 1992 .

[39]  Henry L. Roediger,et al.  Disparate Effects of Repeated Testing: Reconciling Ballard's (1913) and Bartlett's (1932) Results , 1992 .

[40]  James A. Kulik,et al.  Effects of Frequent Classroom Testing. , 1991 .

[41]  L. Jacoby.  A process dissociation framework: Separating automatic from intentional uses of memory , 1991 .

[42]  Mark A. McDaniel,et al.  Tests and test feedback as learning sources , 1991 .

[43]  Larry L. Jacoby,et al.  Reading student essays may be hazardous to your spelling: Effects of reading incorrectly and correctly spelled words. , 1990 .

[44]  H L Roediger,et al.  Implicit memory. Retention without remembering. , 1990, The American psychologist.

[45]  Thomas C. Toppino,et al.  Learning from Tests: The Case of True-False Examinations , 1989 .

[46]  M. McDaniel,et al.  Altering memory through recall: The effects of cue-guided retrieval processing , 1989, Memory & cognition.

[47]  T. Blaxton.  Investigating dissociations among memory measures: Support for a transfer-appropriate processing framework. , 1989 .

[48]  M. McDaniel,et al.  Material-appropriate processing: A contextualist approach to reading and studying strategies , 1989 .

[49]  T. Crooks.  The Impact of Classroom Evaluation Practices on Students , 1988 .

[50]  Alan S. Brown.  Encountering Misspellings and Spelling Performance: Why Wrong Isn't Right. , 1988 .

[51]  N. J. Slamecka,et al.  Normal forgetting of verbal lists as a function of prior testing. , 1988 .

[52]  W. Runquist.  Changes in the rate of forgetting produced by recall tests. , 1986 .

[53]  Christiaan Hamaker.  The Effects of Adjunct Questions on Prose Learning , 1986 .

[54]  P. Rees,et al.  Do medical students learn from multiple choice examinations? , 1986, Medical education.

[55]  Ian Begg,et al.  On believing what we remember. , 1985 .

[56]  Mark A. McDaniel,et al.  Altering memory representations through retrieval. , 1985 .

[57]  Geoffrey R. Loftus,et al.  Evaluating forgetting curves. , 1985 .

[58]  D. Schacter,et al.  Remediation of memory disorders: experimental evaluation of the spaced-retrieval technique. , 1985, Journal of clinical and experimental neuropsychology.

[59]  P. A. Kolers,et al.  Procedures of mind. , 1984 .

[60]  W. Runquist,et al.  Some effects of remembering on forgetting , 1983, Memory & cognition.

[61]  J. H. Neely,et al.  Inhibition from related primes in recognition memory. , 1983 .

[62]  Ronald J. Nungester,et al.  Testing Effects Measured with Alternate Test Forms , 1982 .

[63]  Philippe C. Duchastel,et al.  Testing versus review: Effects on retention. , 1982 .

[64]  R. Nungester,et al.  Long-Term Retention of Prose following Testing , 1981 .

[65]  Philippe C. Duchastel,et al.  Retention of prose following testing with different types of tests , 1981 .

[66]  Charles P. Thompson,et al.  Recall facilitates subsequent recognition. , 1980 .

[67]  W. Whitten,et al.  Learning From Tests: Facilitation of Delayed Recall by Initial Recognition Alternatives. , 1980 .

[68]  John P. Rickards.  Adjunct Postquestions in Text: A Critical Review of Methods and Processes , 1979 .

[69]  Frederick T. Bacon.  Credibility of Repeated Statements: Memory for Trivia. , 1979 .

[70]  N. J. Slamecka,et al.  The Generation Effect: Delineation of a Phenomenon , 1978 .

[71]  Alan D. Baddeley,et al.  The influence of length and frequency of training session on the rate of learning to type. , 1978 .

[72]  C. Thompson,et al.  How recall facilitates subsequent recall: A reappraisal. , 1978 .

[73]  Henry L. Roediger,et al.  The role of recall time in producing hypermnesia , 1978 .

[74]  L. E. Bourne,et al.  Remembering the levels of information in words , 1978 .

[75]  F. Craik,et al.  Interaction between encoding and retrieval operations in cued recall. , 1977 .

[76]  J. Bartlett,et al.  Effects of Immediate Testing on Delayed Retrieval: Search and Recovery Operations with Four Types of Cue. , 1977 .

[77]  John D. Bransford,et al.  Levels of processing versus transfer appropriate processing , 1977 .

[78]  Robert A. Bjork,et al.  Learning from tests: Effects of spacing , 1977 .

[79]  Thomas C. Toppino,et al.  Frequency and the Conference of Referential Validity. , 1977 .

[80]  Vito Modigliani,et al.  Effects on a later recall by delaying initial recall. , 1976 .

[81]  Alan S. Brown,et al.  Information Processing and Cognition: The Loyola Symposium , 1976 .

[82]  John Brown,et al.  Recall and Recognition , 1976 .

[83]  A. Glenberg.  Monotonic and nonmonotonic lag effects in paired-associate and recognition memory paradigms , 1976 .

[84]  R. Lockhart.  The Facilitation of Recognition by Recall. , 1975 .

[85]  J. F. Voss,et al.  Retention of Prose Materials as a Function of Postacquisition Testing. , 1975 .

[86]  Michael J. Watkins,et al.  Concept and measurement of primary memory. , 1974 .

[87]  E. Tulving,et al.  Effects of Temporal and Semantic Encoding in Immediate Recall upon Subsequent Retrieval. , 1974 .

[88]  Fraser A. Bleasdale,et al.  Retrieval difficulty and subsequent recall , 1973, Memory & cognition.

[89]  Endel Tulving,et al.  Encoding specificity and retrieval processes in episodic memory. , 1973 .

[90]  Bennet B. Murdock,et al.  Effects of Prior Free Recall Testing on Final Recall and Recognition. , 1971 .

[91]  W. Donaldson,et al.  Output effects in multitrial free recall , 1971 .

[92]  Joe Eichner,et al.  Study versus test trials and long-term retention in free-recall learning , 1971 .

[93]  W. Kintsch,et al.  Differential effects of study and test trials on long-term recognition and recall , 1971 .

[94]  A. Smith,et al.  Output interference and organized recall from long-term memory , 1971 .

[95]  C. Izawa,et al.  The test trial potentiating model , 1971 .

[96]  S. Madigan,et al.  Perfect recall and total forgetting: A problem for models of short-term memory , 1971 .

[97]  F. Craik.  The fate of primary memory items in free recall , 1970 .

[98]  Sue R. Rosner.  The effects of presentation and recall trials on organization in multitrial free recall , 1970 .

[99]  C. Izawa,et al.  Optimal Potentiating Effects and Forgetting-Prevention Effects of Tests in Paired-Associate Learning. , 1970 .

[100]  G. A. Allen,et al.  Effects of recall tests on long-term retention of paired associates , 1969 .

[101]  N. J. Slamecka,et al.  An examination of trace storage in free recall. , 1968, Journal of experimental psychology.

[102]  John Brown,et al.  Reciprocal facilitation and impairment of free recall , 1968 .

[103]  C. Izawa,et al.  Function of test trials in paired-associate learning. , 1967, Journal of experimental psychology.

[104]  Endel Tulving,et al.  The effects of presentation and recall of material in free-recall learning , 1967 .

[105]  E. Rothkopf.  Learning from Written Instructive Materials: An Exploration of the Control of Inspection Behavior by Test-Like Events , 1966 .

[106]  M. Glanzer,et al.  Two storage mechanisms in free recall , 1966 .

[107]  E. Tulving,et al.  Availability versus accessibility of information in memory for words , 1966 .

[108]  E Tulving,et al.  Input and output interference in short-term associative memory. , 1966, Journal of experimental psychology.

[109]  C. Izawa.  Reinforcement-Test Sequences in Paired-Associate Learning , 1966 .

[110]  N. Mackintosh.  Psychology of Human Learning , 1965, Nature.

[111]  E. Tulving.  INTRATRIAL AND INTERTRIAL RETENTION: NOTES TOWARDS A THEORY OF FREE RECALL VERBAL LEARNING. , 1964, Psychological review.

[112]  Endel Tulving,et al.  Sources of intratrial interference in immediate recall of paired associates , 1963 .

[113]  E. Tulving.  Subjective organization in free recall of "unrelated" words. , 1962, Psychological review.

[114]  W. Estes,et al.  Learning theory and the new "mental chemistry". , 1960, Psychological review.

[115]  I ROCK,et al.  The role of repetition in associative learning. , 1957, The American journal of psychology.

[116]  Benjamin S. Bloom,et al.  Taxonomy of Educational Objectives: The Classification of Educational Goals. , 1957 .

[117]  J. B. Stroud,et al.  Review, with special reference to temporal position. , 1940 .

[118]  A. W. Melton,et al.  The influence of degree of interpolated learning on retroactive inhibition and the overt transfer of specific responses. By Arthur W. Melton, Jean McQueen Irwin, 1940. , 1940, The American journal of psychology.

[119]  H. F. Spitzer.  Studies in retention. , 1939 .

[120]  G. Forlano.  School Learning with Various Methods of Practice and Rewards , 1937, Teachers College Record: The Voice of Scholarship in Education.

[121]  G. M. Ruch,et al.  The Use of Objective Tests in Teaching as Illustrated by Grammar , 1929, The School Review.

[122]  W. Brown,et al.  To What Extent Is Memory Measured by a Single Recall , 1923 .

[123]  E. Thorndike.  Communications and discussion. Repetition versus recall in memorizing vocabularies; The effect of continuous exercise and of rest upon difficult mental multiplication. , 1914 .

[124]  Edwina E. Abott.  ON THE ANALYSIS OF THE FACTOR OF RECALL IN THE LEARNING PROCESS , 1909 .

[125]  D. Balota,et al.  Is Expanded Retrieval Practice a Superior Form of Spaced Retrieval? A Critical Review of the Extant Literature. , 2007 .

[126]  H. Pashler,et al.  Distributed practice in verbal recall tasks: A review and quantitative synthesis. , 2006, Psychological bulletin.

[127]  Henry L Roediger,et al.  The effect of forced recall on illusory recollection in younger and older adults. , 2006, The American journal of psychology.

[128]  H. Pashler,et al.  When does feedback facilitate learning of words? , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[129]  C. Izawa,et al.  Optimal Foreign Language Learning and Retention: Theoretical and Applied Investigations on the Effects of Presentation Repetition Programs. , 2005 .

[130]  W..  The Situation with Respect to the Spacing of Repetitions and Memory , 2005 .

[131]  Susan M. Barnett,et al.  When and where do we apply what we learn? A taxonomy for far transfer. , 2002, Psychological bulletin.

[132]  Catherine Cherry,et al.  Retrieval strategies as a rehabilitation aid for cognitive loss in pathological ageing , 2000 .

[133]  Robert D. Hill,et al.  Cognitive rehabilitation in old age , 2000 .

[134]  Robert A. Bjork,et al.  Assessing our own competence: Heuristics and illusions. , 1999 .

[135]  D. Gopher,et al.  Attention and performance XVII: Cognitive regulation of performance: Interaction of theory and application. , 1999 .

[136]  R. Sternberg,et al.  "Dynamic testing": Erratum. , 1998 .

[137]  F. N. Dempster,et al.  Distributing and Managing the Conditions of Encoding and Practice , 1996 .

[138]  Michael C. Anderson,et al.  Remembering can cause forgetting: retrieval dynamics in long-term memory. , 1994, Journal of experimental psychology. Learning, memory, and cognition.

[139]  R. Bjork.  Memory and metamemory considerations in the training of human beings. , 1994 .

[140]  H. Roediger,et al.  Remembering, knowing, and reconstructing the past , 1993 .

[141]  Robert A. Bjork,et al.  A new theory of disuse and an old theory of stimulus fluctuation , 1992 .

[142]  John A. Glover,et al.  The "Testing" Phenomenon: Not Gone but Nearly Forgotten , 1989 .

[143]  H. Roediger,et al.  Explaining dissociations between implicit and explicit measures of retention: A processing account , 1989 .

[144]  Robert A. Bjork,et al.  Retrieval practice and the maintenance of knowledge. , 1988 .

[145]  P. E. Morris,et al.  Practical aspects of memory : current research and issues , 1988 .

[146]  Vito Modigliani,et al.  The effect of expanded versus massed practice on the retention of multiplication facts and spelling lists. , 1985 .

[147]  J. Richardson.  The Effects of Retention Tests upon Human Learning and Memory: an historical review and an experimental analysis , 1985 .

[148]  George Mandler,et al.  Appearance and Reality: Does a Recognition Test Really Improve Subsequent Recall and Recognition?. , 1981 .

[149]  Henry L. Roediger,et al.  Output Interference in the Recall of Categorized and Paired-Associate Lists , 1980 .

[150]  J. J. Franks,et al.  The effects of effort toward comprehension on recall , 1978 .

[151]  Robert A. Bjork,et al.  Optimum rehearsal patterns and name learning , 1978 .

[152]  Henry L. Roediger,et al.  Recall as a self-limiting process , 1978 .

[153]  F. Craik,et al.  Depth of processing and the retention of words , 1975 .

[154]  Richard C. Anderson,et al.  On asking people questions about what they are reading , 1975 .

[155]  M. Erdelyi,et al.  Hypermnesia for pictures: Incremental memory for pictures but not words in multiple recall trials☆ , 1974 .

[156]  Endel Tulving,et al.  Free recall of trilingual lists , 1970 .

[157]  Y. Morrison.  presented at the Annual Meeting of the , 1970 .

[158]  K. Laughery,et al.  Is a test trial a training trial in free recall learning , 1968 .

[159]  C. Burt.  THE PSYCHOLOGY OF LEARNING , 1958 .

[160]  B. R. Bugelski.  Principles of learning and memory , 1956 .

[161]  H. Babcock,et al.  Association of a , 1955 .

[162]  Mildred L. Fitch,et al.  Frequent testing as a motivating factor in large lecture classes. , 1951 .

[163]  S. S. Stevens,et al.  Handbook of experimental psychology , 1951 .

[164]  H. H. Remmers,et al.  The negative suggestion effect on true-false examination questions. , 1926 .

[165]  D. Spalding.  The Principles of Psychology , 1873, Nature.

[166]  Henry L. Roediger,et al.  Examining the Testing Effect with Open-and Closed-book Tests , 2022 .