Explaining short-term memory phenomena with an integrated episodic/semantic framework of long-term memory

Current thinking about human memory is dominated by distinctions between episodic and semantic memory and between short-term memory (STM) and long-term memory (LTM). However, many memory phenomena seem to cut across these distinctions. This article attempts to set the groundwork for the issues that need to be resolved in generating an integrated model of long-term memory that incorporates semantic, episodic, and short-term memory. We contrast Nairne's (2002, Annual Review of Psychology) consensus account of short-term memory with a relatively generic theory of an integrated episodic-semantic memory. The later consists primarily of a list of principles which we and others argue are necessary to include in any theory of long-term memory. We then add some more specific assumptions to outline a modern theory of forgetting. We then turn to the issue of much of the phenomena thought to necessitate a dedicated short-term memory can be explained by an integrated theory of episodic and semantic memory. Our conclusion is that an integrated theory of long-term memory must be augmented to explain a small number of outstanding memory phenomena. Finally, we ask whether the augmentation needs to involve a dedicated mnemonic system, or sensory or language-based systems, which also have mnemonic capabilities.

[1]  M. Corballis,et al.  The evolution of foresight: What is mental time travel, and is it unique to humans? , 2007, The Behavioral and brain sciences.

[2]  Tim van Gelder,et al.  Defining ‘Distributed Representation’ , 1992 .

[3]  Yevgeniy B. Sirotin,et al.  Going beyond a single list: Modeling the effects of prior experience on episodic free recall , 2005, Psychonomic bulletin & review.

[4]  J. Fuster,et al.  Unit activity in monkey parietal cortex related to haptic perception and temporary memory , 2004, Experimental Brain Research.

[5]  Marcella Laiacona,et al.  Group aggregates and individual reliability: The case of verbal short-term memory , 1996, Memory & cognition.

[6]  F. Tong,et al.  Decoding reveals the contents of visual working memory in early visual areas , 2009, Nature.

[7]  A. Baddeley The episodic buffer: a new component of working memory? , 2000, Trends in Cognitive Sciences.

[8]  L. Storms,et al.  Apparent backward association: a situational effect. , 1958, Journal of experimental psychology.

[9]  R. Shiffrin,et al.  List-strength Effect: Ii. Theoretical Mechanisms , 1990 .

[10]  Colin M. Macleod,et al.  The production effect: delineation of a phenomenon. , 2010, Journal of experimental psychology. Learning, memory, and cognition.

[11]  Gerald Tehan,et al.  Determinants of Short‐term Forgetting: Decay, Retroactive Interference, or Proactive Interference? , 1999 .

[12]  J. Lake,et al.  Repeated speech errors: Evidence for learning , 2010, Cognition.

[13]  B. Underwood Interference and forgetting. , 1957, Psychological review.

[14]  E. Tulving Episodic memory: from mind to brain. , 2002, Annual review of psychology.

[15]  Guillermo Campoy,et al.  Evidence for decay in verbal short-term memory: a commentary on Berman, Jonides, and Lewis (2009). , 2012, Journal of experimental psychology. Learning, memory, and cognition.

[16]  J. Jenkins,et al.  Paired-associate learning as a function of the strength of links in the associative chain , 1964 .

[17]  R. Greene,et al.  Immediate serial recall of mixed-modality lists. , 1989, Journal of experimental psychology. Learning, memory, and cognition.

[18]  J. Fawcett,et al.  Assessing the costs and benefits of production in recognition , 2014, Psychonomic bulletin & review.

[19]  K. Michaelian Mental Time Travel: Episodic Memory and Our Knowledge of the Personal Past , 2016 .

[20]  Steve Majerus,et al.  Language repetition and short-term memory: an integrative framework , 2013, Front. Hum. Neurosci..

[21]  Endel Tulving,et al.  Encoding specificity and retrieval processes in episodic memory. , 1973 .

[22]  Michael J Kahana,et al.  Contextual Variability in Free Recall. , 2011, Journal of memory and language.

[23]  Tyler D. Bancroft,et al.  Does stimulus complexity determine whether working memory storage relies on prefrontal or sensory cortex? , 2014, Attention, perception & psychophysics.

[24]  Prahlad Gupta,et al.  EXPLORING THE RELATIONSHIP BETWEEN WORD PROCESSING AND VERBAL SHORT-TERM MEMORY: EVIDENCE FROM ASSOCIATIONS AND DISSOCIATIONS , 2004, Cognitive neuropsychology.

[25]  Gary M. Oppenheim,et al.  Motor movement matters: The flexible abstractness of inner speech , 2010, Memory & cognition.

[26]  Gianluca Campana,et al.  Priming of motion direction and area V5/MT: a test of perceptual memory. , 2002, Cerebral cortex.

[27]  Morris Moscovitch,et al.  Dissociating Measures of Associative Memory: Evidence and Theoretical Implications. , 2007 .

[28]  Nelson Cowan,et al.  Processing limits of selective attention and working memory: Potential implications for interpreting , 2000 .

[29]  Hyungwook Yim,et al.  The Development of Episodic Memory , 2013, Psychological science.

[30]  N. Cowan Attention and Memory: An Integrated Framework , 1995 .

[31]  R. Conrad,et al.  Interference or decay over short retention intervals , 1967 .

[32]  Barbara Anne Dosher,et al.  Judgments of semantic and episodic relatedness: Common time-course and failure of segregation , 1991 .

[33]  Oliver Baumann,et al.  Neural Correlates of Temporal Complexity and Synchrony during Audiovisual Correspondence Detection , 2018, eNeuro.

[34]  Joyce M. G. Vromen,et al.  Category-length and category-strength effects using images of scenes , 2018, Memory & Cognition.

[35]  S Magnussen,et al.  The psychophysics of perceptual memory , 1999, Psychological research.

[36]  B. Underwood,et al.  Fate of first-list associations in transfer theory. , 1959, Journal of experimental psychology.

[37]  John-Dylan Haynes,et al.  Decoding the Contents of Visual Short-Term Memory from Human Visual and Parietal Cortex , 2012, The Journal of Neuroscience.

[38]  R. F. Westbrook,et al.  False context fear memory in rats , 2015, Learning & memory.

[39]  Donald M. Thomson,et al.  Context Effects in Recognition Memory. , 1972 .

[40]  M. Abeles,et al.  Single unit activity in the auditory cortex of a monkey performing a short term memory task , 2004, Experimental Brain Research.

[41]  Stephan Lewandowsky,et al.  Interference-Based Forgetting in Verbal Short-Term Memory. , 2008 .

[42]  M. Humphreys,et al.  Effect of Retention Interval on the Cue Repetition Effect , 1985 .

[43]  S. Dennis,et al.  The inverse list length effect: A challenge for pure exemplar models of recognition memory , 2010 .

[44]  Costanza Papagno,et al.  The Neural Correlates of Phonological Short-term Memory: A Repetitive Transcranial Magnetic Stimulation Study , 2006, Journal of Cognitive Neuroscience.

[45]  L. Porter,et al.  Negative transfer in verbal learning. , 1953, Journal of experimental psychology.

[46]  Joseph T. Devlin,et al.  The hearing ear is always found close to the speaking tongue: Review of the role of the motor system in speech perception , 2017, Brain and Language.

[47]  R. Henson Short-Term Memory for Serial Order: The Start-End Model , 1998, Cognitive Psychology.

[48]  G. A. Miller,et al.  Verbal context and the recall of meaningful material. , 1950, The American journal of psychology.

[49]  Marc W Howard,et al.  Contextual variability and serial position effects in free recall. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[50]  Simon Farrell,et al.  Benchmarks for models of short-term and working memory. , 2018, Psychological bulletin.

[51]  Phillip M. Tell The role of certain acoustic and semantic factors at short and long retention intervals , 1972 .

[52]  J. Lachaux,et al.  What is that little voice inside my head? Inner speech phenomenology, its role in cognitive performance, and its relation to self-monitoring , 2014, Behavioural Brain Research.

[53]  S. Dennis,et al.  The role of stimulus type in list length effects in recognition memory , 2011, Memory & Cognition.

[54]  Markus Kiefer,et al.  A holistic account of the own-race effect in face recognition: evidence from a cross-cultural study , 2004, Cognition.

[55]  S. Dennis,et al.  The list length effect in recognition memory: an analysis of potential confounds , 2011, Memory & cognition.

[56]  Michael S. Humphreys,et al.  A Context Noise Model of Episodic Recognition Memory , 2001 .

[57]  M. Humphreys,et al.  Reinstating higher order properties of a study list by retrieving a list item , 2014, Memory & cognition.

[58]  Moshe Naveh-Benjamin,et al.  The effects of divided attention at encoding on item and associative memory , 2003, Memory & cognition.

[59]  Marc W. Howard,et al.  A distributed representation of temporal context , 2002 .

[60]  Michael S. Humphreys,et al.  Contexts and control operations used in accessing list-specific, generalized, and semantic memories , 2009, Cognitive Psychology.

[61]  Richard S. J. Frackowiak,et al.  The structural components of music perception. A functional anatomical study. , 1997, Brain : a journal of neurology.

[62]  William E Hockley,et al.  The picture superiority effect in associative recognition , 2008, Memory & cognition.

[63]  M. Humphreys,et al.  Global similarity accounts of embedded-category designs: Tests of the Global Matching models , 2010 .

[64]  M. Bitterman,et al.  Runway performance of goldfish as a function of complete and incomplete reduction in amount of reward , 1972 .

[65]  M J Watkins,et al.  The intricacy of memory span , 1977, Memory & cognition.

[66]  M. Humphreys,et al.  Recency effects in direct and indirect memory tasks , 1991, Memory & cognition.

[67]  S. Gronlund,et al.  Global matching models of recognition memory: How the models match the data , 1996, Psychonomic bulletin & review.

[68]  Gordon D. A. Brown,et al.  Time does not cause forgetting in short-term serial recall , 2004, Psychonomic bulletin & review.

[69]  M. Watkins,et al.  Buildup of Proactive Inhibition as a Cue-Overload Effect. , 1975 .

[70]  J. Wixted The psychology and neuroscience of forgetting. , 2004, Annual review of psychology.

[71]  David Howard,et al.  Three ways for understanding written words, and their use in two contrasting cases of surface dyslexia (together with an odd routine for making 'orthographic' errors in oral word production). , 1987 .

[72]  R. Morris,et al.  Elements of a neurobiological theory of hippocampal function: the role of synaptic plasticity, synaptic tagging and schemas , 2006, The European journal of neuroscience.

[73]  N. Cowan An embedded-processes model of working memory , 1999 .

[74]  M. Humphreys,et al.  Expecting dirt but saying dart: The creation of a blend memory , 2001, Psychonomic bulletin & review.

[75]  Clinton S. Weeks,et al.  Buffered forgetting: When targets and distractors are both forgotten , 2007, Memory & cognition.

[76]  Simon Farrell,et al.  Temporal clustering and sequencing in short-term memory and episodic memory. , 2012, Psychological review.

[77]  M. Humphreys,et al.  Different Ways to Cue a Coherent Memory System: A Theory for Episodic, Semantic, and Procedural Tasks. , 1989 .

[78]  M. Humphreys,et al.  Delayed Priming of the Pronunciation of Inconsistent Words and Pseudowords , 1993 .

[79]  A. Paivio Imagery and verbal processes , 1972 .

[80]  D. Nelson,et al.  Experiencing a word can prime its accessibility and its associative connections to related words , 2002, Memory & cognition.

[81]  J. Bain,et al.  Set-size effects in primary memory: An age-related capacity limitation? , 1988, Memory & cognition.

[82]  Neal W Morton,et al.  A predictive framework for evaluating models of semantic organization in free recall. , 2016, Journal of memory and language.

[83]  R. Bjork,et al.  Recency-sensitive retrieval processes in long-term free recall☆ , 1974 .

[84]  James W Bisley,et al.  Activity of neurons in cortical area MT during a memory for motion task. , 2004, Journal of neurophysiology.

[85]  B. Underwood,et al.  Proactive inhibition in short-term retention of single items , 1962 .

[86]  T. Teyler,et al.  The hippocampal memory indexing theory. , 1986, Behavioral neuroscience.

[87]  Mark W Greenlee,et al.  High-Fidelity Perceptual Long-Term Memory Revisited—and Confirmed , 2003, Psychological science.

[88]  Klaus Oberauer,et al.  Design for a working memory. , 2009 .

[89]  J. S. Nairne Remembering over the short-term: the case against the standard model. , 2002, Annual review of psychology.

[90]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[91]  Alan D Baddeley,et al.  Memory for serial order across domains: An overview of the literature and directions for future research. , 2014, Psychological bulletin.

[92]  B. C. Motter,et al.  Neural correlates of feature selective memory and pop-out in extrastriate area V4 , 1994, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[93]  Ray Pike,et al.  Global matching: A comparison of the SAM, Minerva II, Matrix, and TODAM models. , 1989 .

[94]  B McElree,et al.  Working memory and focal attention. , 2001, Journal of experimental psychology. Learning, memory, and cognition.

[95]  Randi C. Martin,et al.  Independence of Input and Output Phonology in Word Processing and Short-Term Memory , 1999 .

[96]  Anne Cutler,et al.  A theory of lexical access in speech production , 1999, Behavioral and Brain Sciences.

[97]  P. Barrouillet,et al.  Time constraints and resource sharing in adults' working memory spans. , 2004, Journal of experimental psychology. General.

[98]  Winston D. Goh,et al.  Proactive interference and cuing effects in short-term cued recall: Does foil context matter? , 2006, Memory & cognition.

[99]  R. Conrad,et al.  Acoustic confusions in immediate memory. , 1964 .

[100]  R. H. Hopkins,et al.  Pronunciation effects in recognition memory , 1972 .

[101]  Kit W Cho,et al.  Null category-length and target–lure relatedness effects in episodic recognition: A constraint on item-noise interference models , 2013, Quarterly journal of experimental psychology.

[102]  Jeremy I. Skipper,et al.  Seeing Voices : How Cortical Areas Supporting Speech Production Mediate Audiovisual Speech Perception , 2007 .

[103]  A. Baddeley Human Memory: Theory and Practice, Revised Edition , 1990 .

[104]  S. E. Napps,et al.  Morphemic relationships in the lexicon: Are they distinct from semantic and formal relationships? , 1989, Memory & cognition.

[105]  I. Neath,et al.  Immunity to proactive interference is not a property of the focus of attention in working memory , 2011, Memory & cognition.

[106]  Michael I. Jordan,et al.  Forward Models: Supervised Learning with a Distal Teacher , 1992, Cogn. Sci..

[107]  Derek K. Jones,et al.  Perisylvian language networks of the human brain , 2005, Annals of neurology.

[108]  M. Usher,et al.  The demise of short-term memory revisited: empirical and computational investigations of recency effects. , 2005, Psychological review.

[109]  E. McKone,et al.  The decay of short-term implicit memory: Unpacking lag , 1998, Memory & cognition.

[110]  C. Tse The role of associative strength in the semantic relatedness effect on immediate serial recall , 2009, Memory.

[111]  Delos D. Wickens,et al.  The nature and timing of the retrieval process and of interference effects. , 1981 .

[112]  Richard L. Lewis,et al.  In search of decay in verbal short-term memory. , 2009, Journal of experimental psychology. Learning, memory, and cognition.

[113]  Timothy F. Brady,et al.  Conceptual Distinctiveness Supports Detailed Visual Long-term Memory for Real-world Objects the Fidelity of Long-term Memory for Visual Information , 2022 .

[114]  Michael S. Humphreys,et al.  Forward and backward associations in cued recall: Predictions from the encoding specificity principle. , 1975 .

[115]  Michael S. Humphreys,et al.  Thinking about human memory , 2016 .

[116]  Costanza Papagno,et al.  Mapping the brain network of the phonological loop , 2017, Human brain mapping.

[117]  William K. Estes,et al.  Phonemic Coding and Rehearsal in Short-Term Memory for Letter Strings. , 1973 .

[118]  Angela Kinnell,et al.  Bayesian Analysis of Recognition Memory: The Case of the List-Length Effect , 2007 .

[119]  Gabriel A Radvansky,et al.  Walking through Doorways Causes Forgetting: Further Explorations , 2011, Quarterly journal of experimental psychology.

[120]  Marc W Howard,et al.  A context-based theory of recency and contiguity in free recall. , 2008, Psychological review.

[121]  Dorothy Tse,et al.  References and Notes Supporting Online Material Materials and Methods Figs. S1 to S5 Tables S1 to S3 Electron Impact (ei) Mass Spectra Chemical Ionization (ci) Mass Spectra References Schemas and Memory Consolidation Research Articles Research Articles Research Articles Research Articles , 2022 .

[122]  L. Crespi Quantitative variation of incentive and performance in the white rat. , 1942 .

[123]  Timothy F. Brady,et al.  Scene Memory Is More Detailed Than You Think : The Role of Categories in Visual Long-Term Memory , 2010 .

[124]  Endel Tulving,et al.  Organization of memory: Quo vadis? , 1995 .

[125]  M. Humphreys,et al.  Change in a Sponsorship Alliance and the Communication Implications of Spontaneous Recovery , 2012 .

[126]  Linda Clare,et al.  Errorless Learning in the Rehabilitation of Memory Impairment: A Critical Review , 2008, Neuropsychology Review.

[127]  M. Poirier,et al.  Memory for Related and Unrelated Words: Further Evidence on the Influence of Semantic Factors in Immediate Serial Recall , 1995, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[128]  Hermann Ebbinghaus,et al.  Memory: a contribution to experimental psychology. , 1987, Annals of neurosciences.

[129]  N. Burgess,et al.  Selective Interference with Verbal Short-Term Memory for Serial Order Information: A New Paradigm and Tests of a Timing-Signal Hypothesis , 2003, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[130]  Aimée M. Surprenant,et al.  Principles of Memory , 2009 .

[131]  Sean M. Polyn,et al.  A context maintenance and retrieval model of organizational processes in free recall. , 2009, Psychological review.

[132]  W. Marslen-Wilson,et al.  Accessing Different Types of Lexical Semantic Information: Evidence From Priming , 1995 .

[133]  Michael S. Humphreys,et al.  Articulatory loop explanations of memory span and pronunciation rate correspondences: A cautionary note , 1988 .

[134]  Gerald Tehan,et al.  Testing feature interaction: Between-stream irrelevant speech effects in immediate recall , 2002 .

[135]  G. Tehan,et al.  Associative relatedness enhances recall and produces false memories in immediate serial recall. , 2010, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[136]  C. Perfetti The Representation Problem in Reading Acquisition , 1992 .

[137]  G. Tehan,et al.  Concreteness effects in short-term memory: a test of the item-order hypothesis. , 2011, Canadian journal of experimental psychology = Revue canadienne de psychologie experimentale.

[138]  James L. McClelland,et al.  Understanding normal and impaired word reading: computational principles in quasi-regular domains. , 1996, Psychological review.

[139]  M. Verde,et al.  Associative interference in recognition memory: A dual-process account , 2004, Memory & cognition.

[140]  K. Lamberts,et al.  List Strength Effect without List Length Effect in Recognition Memory , 2008, Quarterly journal of experimental psychology.

[141]  G. Tononi,et al.  Cortical Development, Electroencephalogram Rhythms, and the Sleep/Wake Cycle , 2015, Biological Psychiatry.

[142]  Dylan M. Jones,et al.  The phonological store of working memory: is it phonological and is it a store? , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[143]  J Jonides,et al.  Human Rehearsal Processes and the Frontal Lobes: PET Evidence , 1995, Annals of the New York Academy of Sciences.

[144]  Troy A. Smith,et al.  The fSAM model of false recall. , 2007, Psychological review.

[145]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[146]  Steven M. Smith,et al.  Environmental context-dependent memory: A review and meta-analysis , 2001, Psychonomic bulletin & review.

[147]  J. Jenkins,et al.  The effects of associative strength and response hierarchy on paired-associate learning , 1964 .

[148]  G. J. Johnson A distinctiveness model of serial learning , 1991 .

[149]  Jean B. McGovern,et al.  Extinction of associations in four transfer paradigms. , 1964 .

[150]  Michael Tomasello,et al.  Two-year-olds learn words for absent objects and actions. , 1996 .

[151]  I. Neath,et al.  The focus of attention is similar to other memory systems rather than uniquely different , 2014, Frontiers in Human Neuroscience.

[152]  Janet Wiles,et al.  Memory retrieval with two cues: think of intersecting sets , 1993 .

[153]  Dylan M. Jones,et al.  Perceptual-motor determinants of auditory-verbal serial short-term memory , 2016 .

[154]  M. Greenlee,et al.  Delayed discrimination of spatial frequency for gratings of different orientation: behavioral and fMRI evidence for low-level perceptual memory stores in early visual cortex , 2008, Experimental Brain Research.

[155]  M. Conway,et al.  Modality and long-term memory , 1987 .

[156]  Richard S. J. Frackowiak,et al.  The neural correlates of the verbal component of working memory , 1993, Nature.

[157]  R. Shiffrin,et al.  Search of associative memory. , 1981 .

[158]  M. Humphreys,et al.  The role of context in producing item interactions and false memories. , 2004, Journal of experimental psychology. Learning, memory, and cognition.

[159]  N. C. Waugh,et al.  Short-term memory and intertrial interval , 1967 .

[160]  D. O. Hebb,et al.  The organization of behavior , 1988 .

[161]  M. Humphreys,et al.  Associative Interference Effects in Recognition and Recall , 1990 .

[162]  M. Humphreys,et al.  Transient phonemic codes and immunity to proactive interference , 1995, Memory & cognition.

[163]  A D Baddeley,et al.  Short-term Memory for Word Sequences as a Function of Acoustic, Semantic and Formal Similarity , 1966, The Quarterly journal of experimental psychology.

[164]  Marcia K. Johnson,et al.  Refreshing: A Minimal Executive Function , 2007, Cortex.

[165]  Donald H. Kausler,et al.  Psychology of verbal learning and memory , 1974 .

[166]  R. Overton,et al.  Multiple trace retrieval: A trace-to-trace retrieval process? , 1979 .

[167]  Vencislav Popov,et al.  Frequency effects on memory: A resource-limited theory. , 2019, Psychological review.

[168]  Svem Magnussen,et al.  High-Fidelity Perceptual Long-Term Memory , 1994 .

[169]  R. K. Young,et al.  Tests of three hypotheses about the effective stimulus in serial learning. , 1962, Journal of experimental psychology.

[170]  H. McGurk,et al.  Hearing lips and seeing voices , 1976, Nature.

[171]  L. Reder,et al.  A mechanistic account of the mirror effect for word frequency: a computational model of remember-know judgments in a continuous recognition paradigm. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[172]  Elizabeth Jefferies,et al.  Lexical and semantic binding in verbal short-term memory , 2006 .

[173]  N. Cowan The magical number 4 in short-term memory: A reconsideration of mental storage capacity , 2001, Behavioral and Brain Sciences.

[174]  E. Tulving Chronesthesia: Conscious awareness of subjective time. , 2002 .

[175]  M. Humphreys,et al.  Cuing effects in short-term recall , 1996, Memory & cognition.

[176]  Gary M. Oppenheim,et al.  The dark side of incremental learning: A model of cumulative semantic interference during lexical access in speech production , 2010, Cognition.

[177]  Colleen M. Kelley,et al.  A contextual change account of the directed forgetting effect. , 2002, Journal of experimental psychology. Learning, memory, and cognition.

[178]  Michael S. Humphreys,et al.  Target similarity effects: Support for the parallel distributed processing assumptions , 2000, Memory & cognition.