A distributed representation of temporal context

The principles of recency and contiguity are two cornerstones of the theoretical and empirical analysis of human memory. Recency has been alternatively explained by mechanisms of decay, displacement, and retroactive interference. Another account of recency is based on the idea of variable context (Estes, 1955; Mensink & Raaijmakers, 1989). Such notions are typically cast in terms of a randomly fluctuating population of elements reflective of subtle changes in the environment or in the subjects' mental state. This random context view has recently been incorporated into distributed and neural network memory models (Murdock, 1997; Murdock, Smith, & Bai, 2001). Here we propose an alternative model. Rather than being driven by random fluctuations, this formulation, the temporal context model (TCM), uses retrieval of prior contextual states to drive contextual drift. In TCM, retrieved context is an inherently asymmetric retrieval cue. This allows the model to provide a principled explanation of the widespread advantage for forward recalls in free and serial recall. Modeling data from single-trial free recall, we demonstrate that TCM can simultaneously explain recency and contiguity effects across time scales.

[1]  H. Ebbinghaus.  Memory A Contribution Toexperimental Psychology , 1913 .

[2]  J. A. McGeoch.  The Direction and Extent of Intra-Serial Associations at Recall , 1936 .

[3]  E. Raskin,et al.  The strength and direction of associations formed in the learning of nonsense syllables , 1937 .

[4]  W. Estes.  Statistical theory of spontaneous recovery and regression. , 1955, Psychological review.

[5]  S. Ebenholtz,et al.  THE PRINCIPLE OF ASSOCIATIVE SYMMETRY , 1962 .

[6]  Murdock,et al.  The serial position effect of free recall , 1962 .

[7]  B. Murdock.  Short-term memory and paired-associate learning , 1963 .

[8]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[9]  Richard C. Atkinson,et al.  Human Memory: A Proposed System and its Control Processes , 1968, Psychology of Learning and Motivation.

[10]  T. Dixon,et al.  Verbal behavior and general behavior theory , 1968 .

[11]  M. Glanzer,et al.  The removal of items from short-term storage , 1969 .

[12]  R. Okada,et al.  Interresponse times in single-trial free recall. , 1970 .

[13]  Walter Kintsch,et al.  11 – Models for Free Recall and Recognition1 , 1970 .

[14]  Donald A. Norman,et al.  Models Of Human Memory , 1970 .

[15]  R M Shiffrin,et al.  Forgetting: Trace Erosion or Retrieval Failure? , 1970, Science.

[16]  H. P. Bahrick.  Two-phase model for prompted recall. , 1970 .

[17]  D. Rundus.  Analysis of rehearsal processes in free recall. , 1971 .

[18]  P. Marshall,et al.  The effects of the elimination of rehearsal on primacy and recency , 1972 .

[19]  John R. Anderson,et al.  RECOGNITION AND RETRIEVAL PROCESSES IN FREE RECALL , 1972 .

[20]  Murray Glanzer,et al.  Storage Mechanisms in Recall , 1972 .

[21]  Philippe R. Falkenberg.  Recall Improves in Short-Term Memory The More Recall Context Resembles Learning Context. , 1972 .

[22]  A. W. Melton,et al.  Coding Processes in Human Memory. , 1973 .

[23]  R. Bjork,et al.  Recency-sensitive retrieval processes in long-term free recall☆ , 1974 .

[24]  D. A. Brodie,et al.  Effect of Presentation Time on Nominal and Functional Serial-Position Curves of Free Recall. , 1977 .

[25]  W. Estes,et al.  Order and position in primary memory for letter strings , 1977 .

[26]  J. Metcalfe,et al.  Controlled rehearsal in single-trial free recall , 1978 .

[27]  S. Monsell.  Recency, immediate recognition memory, and reaction time , 1978, Cognitive Psychology.

[28]  B. Bergum,et al.  Attention and Performance VI , 1978 .

[29]  D. Rundus,et al.  Maintenance rehearsal and long-term recency , 1980, Memory & cognition.

[30]  Richard M. Shiffrin,et al.  SAM: A theory of probabilistic search in associative memory. , 1980 .

[31]  M. Bradley,et al.  A two-process account of long-term serial position effects , 1980 .

[32]  R. Shiffrin,et al.  Search of associative memory. , 1981 .

[33]  W. Estes,et al.  Item and order information in short-term memory: Evidence for multilevel perturbation processes. , 1981 .

[34]  R. Shiffrin,et al.  Order effects in recall. , 1981 .

[35]  Michael Friendly,et al.  The Toronto Word Pool: Norms for imagery, concreteness, orthographic variables, and grammatical usage for 1,080 words , 1982 .

[36]  B. Bergum,et al.  Attention and performance IX , 1982 .

[37]  R. Shiffrin,et al.  A retrieval model for both recognition and recall. , 1984, Psychological review.

[38]  R. Cook,et al.  Memory processing of serial lists by pigeons, monkeys, and people. , 1985, Science.

[39]  A. Glenberg,et al.  A temporal distinctiveness theory of recency and modality effects. , 1986, Journal of experimental psychology. Learning, memory, and cognition.

[40]  Michael I. Jordan.  An introduction to linear algebra in parallel distributed processing , 1986 .

[41]  R. Nosofsky.  Attention, similarity, and the identification-categorization relationship. , 1986, Journal of experimental psychology. General.

[42]  R. Shepard,et al.  Toward a universal law of generalization for psychological science. , 1987, Science.

[43]  R. Nosofsky.  Attention and learning processes in the identification and categorization of integral stimuli. , 1987, Journal of experimental psychology. Learning, memory, and cognition.

[44]  J. Raaijmakers,et al.  A model for interference and forgetting , 1988 .

[45]  B. Murdock,et al.  Memory for Serial Order , 1989 .

[46]  I. Neath,et al.  Recency effect in recall of a word list when an immediate memory task is performed after each word presentation. , 1989, The American journal of psychology.

[47]  J. Raaijmakers,et al.  A model for contextual fluctuation , 1989 .

[48]  I Neath,et al.  Schedules of presentation and temporal distinctiveness in human memory. , 1990, Journal of experimental psychology. Learning, memory, and cognition.

[49]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[50]  James L. McClelland,et al.  Learning the structure of event sequences. , 1991, Journal of experimental psychology. General.

[51]  G. J. Johnson.  A distinctiveness model of serial learning , 1991 .

[52]  N. Burgess,et al.  Toward a network model of the articulatory loop , 1992, Connectionist psychology: A text with readings.

[53]  B. Murdock,et al.  Analysis of the list-strength effect. , 1993 .

[54]  S. Lewandowsky,et al.  Intralist distractors and recall direction: Constraints on models of memory for serial order. , 1993 .

[55]  I. Neath.  Distinctiveness and serial position effects in recognition , 1993, Memory & cognition.

[56]  Axel Cleeremans,et al.  Mechanisms of Implicit Learning: Connectionist Models of Sequence Processing , 1993 .

[57]  J. Wixted,et al.  An analysis of latency and interresponse time in free recall , 1994, Memory & cognition.

[58]  Michael S. Humphreys,et al.  An auto-associative neural network for sparse representations : analysis and application to models of recognition and cued recall , 1994 .

[59]  M. Masson,et al.  Using confidence intervals in within-subject designs , 1994, Psychonomic bulletin & review.

[60]  S. Lewandowsky,et al.  FORWARD AND BACKWARD RECALL: DIFFERENT RETRIEVAL PROCESSES , 1995 .

[61]  James M. Bower,et al.  Computational Neuroscience: Trends in Research , 1996 .

[62]  M. Kahana.  Associative retrieval processes in free recall , 1996, Memory & cognition.

[63]  R. G. Crowder,et al.  Distinctiveness and very short-term serial position effects. , 1996, Memory.

[64]  D. Norris,et al.  THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1996, 49A (1), 80 ± 115 Unchained Memory: Error Patterns Rule out Chaining Models of Immediate Serial Recall , 2022 .

[65]  Michael J. Kahana,et al.  Testing the role of associative interference and compound cues in sequence memory , 1997 .

[66]  B. Murdock.  Context and mediators in a theory of distributed associative memory (TODAM2). , 1997 .

[67]  J. S. Nairne,et al.  Positional Distinctiveness and the Ratio Rule in Free Recall , 1997 .

[68]  R. Shiffrin,et al.  A model for recognition memory: REM—retrieving effectively from memory , 1997, Psychonomic bulletin & review.

[69]  R. Henson.  Short-Term Memory for Serial Order: The Start-End Model , 1998, Cognitive Psychology.

[70]  D. Norris,et al.  The primacy model: a new model of immediate serial recall. , 1998, Psychological review.

[71]  Marc W Howard,et al.  Contextual variability and serial position effects in free recall. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[72]  D. Laming.  Testing the Idea of Distinct Storage Mechanisms in Memory , 1999 .

[73]  N. Burgess.  Memory for Serial Order : A Network Model of the Phonological Loop and its Timing , 1999 .

[74]  G. Ward,et al.  A recency-based account of the primacy effect in free recall. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[75]  G D Brown,et al.  Oscillator-based memory for serial order. , 2000, Psychological review.

[76]  David Smith,et al.  Judgments of Frequency and Recency in a Distributed Memory Model. , 2001, Journal of mathematical psychology.

[77]  Daniel S. Rizzuto,et al.  An Autoassociative Neural Network Model of Paired-Associate Learning , 2001, Neural Computation.

[78]  M. Kahana.  Associative symmetry and memory theory , 2002, Memory & cognition.

[79]  M. Kahana,et al.  Associative asymmetry in probed recall of serial lists , 2002, Memory & cognition.

[80]  Stephex GROSSBERGl.  Behavioral Contrast in Short Term Memory : Serial Binary Memory Models or Parallel Continuous Memory Models ? , 2003 .