Memory for serial order: A network model of the phonological loop and its timing

A connectionist model of human short-term memory is presented that extends the "phonological loop" (A. D. Baddeley, 1986) to encompass serial order and learning. Psychological and neuropsychological data motivate separate layers of lexical, timing, and input and output phonemic information. Connection weights between layers show Hebbian learning and decay over short and long time scales. At recall, the timing signal is rerun, phonemic information feeds back from output to input, and lexical nodes compete to be selected. The selected node then receives decaying inhibition. The model provides an explanatory mechanism for the phonological loop and for the effects of serial position, presentation modality, lexicality, grouping, and Hebb repetition. It makes new psychological and neuropsychological predictions and is a starting point for understanding the role of the phonological loop in vocabulary acquisition and for interpreting data from functional neuroimaging.

[1]  HighWire Press.  Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[2]  J. P. Guilford,et al.  The Determination of Memory Span by the Method of Constant Stimuli , 1925 .

[3]  L. A. Jeffress,et al.  Cerebral Mechanisms in Behavior , 1953 .

[4]  G. A. Miller.  THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .

[5]  R. Conrad.  Serial order intrusions in immediate memory. , 1960, British journal of psychology.

[6]  A. W. Melton.  Implications of short-term memory for a general theory of memory , 1963 .

[7]  A. J. Hull,et al.  INFORMATION, ACOUSTIC CONFUSION AND MEMORY SPAN. , 1964, British journal of psychology.

[8]  R. Conrad,et al.  Acoustic confusions in immediate memory. , 1964 .

[9]  R. Conrad,et al.  Order error in immediate recall of sequences , 1965 .

[10]  A D Baddeley,et al.  Short-term Memory for Word Sequences as a Function of Acoustic, Semantic and Formal Similarity , 1966, The Quarterly journal of experimental psychology.

[11]  D. Aaronson.  Temporal course of perception in an immediate recall task. , 1968 .

[12]  A D Baddeley,et al.  How Does Acoustic Similarity Influence Short-Term Memory? , 1968, The Quarterly journal of experimental psychology.

[13]  D. J. Murray.  Articulation and acoustic confusability in short-term memory. , 1968 .

[14]  T Shallice,et al.  The selective impairment of auditory verbal short-term memory. , 1969, Brain : a journal of neurology.

[15]  Wayne A. Wickelgran.  Context-sensitive coding, associative memory, and serial order in (speech) behavior. , 1969 .

[16]  J Ryan,et al.  Grouping and Short-Term Memory: Different Means and Patterns of Grouping , 1969, The Quarterly journal of experimental psychology.

[17]  S. Sternberg.  Memory-scanning: mental processes revealed by reaction-time experiments. , 1969, American scientist.

[18]  G. Bower,et al.  Group structure, coding, and memory for digit series , 1969 .

[19]  R. G. Crowder,et al.  Precategorical acoustic storage (PAS) , 1969 .

[20]  John C. Jahnke,et al.  The Ranschburg effect. , 1969 .

[21]  John Morton,et al.  Absence of a Cross-Modal “Suffix Effect” in Short-Term Memory , 1970 .

[22]  E. Kandel.  Nerve cells and behavior. , 1970, Scientific American.

[23]  E. Kaplan,et al.  The assessment of aphasia and related disorders , 1972 .

[24]  A. W. Melton,et al.  Coding Processes in Human Memory. , 1973 .

[25]  H A Simon,et al.  How Big Is a Chunk? , 1974, Science.

[26]  A Baddeley,et al.  Working memory. In G. H. Bower (Ed.), The psychology of learning andmotivation: Advances in research and theory (Vol. 8, pp. 47-89). , 1974 .

[27]  Robert G. Crowder,et al.  The Modality Effect in Free and Serial Recall as a Function of Phonological Similarity. , 1974 .

[28]  E. Bjork,et al.  Short-term order and item retention. , 1974 .

[29]  Alice F. Healy,et al.  Separating item from order information in short-term memory , 1974 .

[30]  G. Hitch.  The role of attention in visual and auditory suffix effects , 1975, Memory & cognition.

[31]  Paolo Nichelli,et al.  Verbal and Non-Verbal Short-Term Memory Impairment Following Hemispheric Damage , 1975, Cortex.

[32]  A. Baddeley,et al.  Word length and the structure of short-term memory , 1975 .

[33]  Ragnhild Söderbergh.  Language by ear and by eye , 1975, Journal of Child Language.

[34]  R. Davidson,et al.  Consciousness and Self-Regulation: Advances in Research and Theory IV , 1976 .

[35]  J. O’Keefe.  Place units in the hippocampus of the freely moving rat , 1976, Experimental Neurology.

[36]  T. Shallice,et al.  Short-term memory impairment and spontaneous speech , 1977, Neuropsychologia.

[37]  M J Watkins,et al.  The intricacy of memory span , 1977, Memory & cognition.

[38]  W. Estes,et al.  Order and position in primary memory for letter strings , 1977 .

[39]  S. Monsell.  Recency, immediate recognition memory, and reaction time , 1978, Cognitive Psychology.

[40]  R. Shiffrin,et al.  Short-term forgetting of item and order information. , 1978 .

[41]  Nick C. Ellis,et al.  A bilingual word‐length effect: Implications for intelligence testing and the relative ease of mental calculation in Welsh and English , 1980 .

[42]  A. Drewnowski.  Attributes and priorities in short-term recall: A new model of memory span. , 1980 .

[43]  B. Fischhoff,et al.  Journal of Experimental Psychology: Human Learning and Memory , 1980 .

[44]  W. Estes,et al.  Item and order information in short-term memory: Evidence for multilevel perturbation processes. , 1981 .

[45]  Donald A. Norman,et al.  Simulating a Skilled Typist: A Study of Skilled Cognitive-Motor Performance , 1982, Cogn. Sci..

[46]  Derek Besner,et al.  Basic processes in reading: Two phonological codes. , 1982 .

[47]  B L McNaughton,et al.  Long‐term synaptic enhancement and short‐term potentiation in rat fascia dentata act through different mechanisms , 1982, The Journal of physiology.

[48]  E. Bienenstock,et al.  Theory for the development of neuron selectivity: orientation specificity and binocular interaction in visual cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[49]  Alan D. Baddeley,et al.  Disruption of short-term memory by unattended speech : Implications for the structure of working memory , 1982 .

[50]  J M Gardiner,et al.  On recency and echoic memory. , 1983, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[51]  A. Healy,et al.  Effects of repetition on short-term retention of order information. , 1984, Journal of experimental psychology. Learning, memory, and cognition.

[52]  A. Baddeley,et al.  Exploring the Articulatory Loop , 1984 .

[53]  Giuseppe Vallar,et al.  Fractionation of working memory: Neuropsychological evidence for a phonological short-term store , 1984 .

[54]  D. Bouwhuis,et al.  Attention and performance X : control of language processes , 1986 .

[55]  A. Baddeley,et al.  Phonological short-term store, phonological processing and sentence comprehension: A neuropsychological case study , 1984 .

[56]  Charles Hulme,et al.  Speech Rate and the Development of Short-Term Memory Span. , 1984 .

[57]  T. Shallice,et al.  Isolating Cognitive Modules with the Dual-Task Paradigm: Are Speech Perception and Production Separate Processes? , 1985, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[58]  C. Eriksen,et al.  An electromyographic examination of response competition , 1985 .

[59]  H. Simon,et al.  STM capacity for Chinese words and idioms: Chunking and acoustical loop hypotheses , 1985, Memory & cognition.

[60]  Clive Frankish,et al.  Modality-specific grouping effects in short-term memory , 1985 .

[61]  Kanter,et al.  Temporal association in asymmetric neural networks. , 1986, Physical review letters.

[62]  A. Glenberg,et al.  A temporal distinctiveness theory of recency and modality effects. , 1986, Journal of experimental psychology. Learning, memory, and cognition.

[63]  M. Alexander,et al.  Principles of Neural Science , 1981 .

[64]  D Kleinfeld,et al.  Sequential state generation by model neural networks. , 1986, Proceedings of the National Academy of Sciences of the United States of America.

[65]  Andrew Heathcote,et al.  Representation of order information: An analysis of grouping effects in short-term memory. , 1986 .

[66]  Donald A. Norman,et al.  Attention to Action , 1986 .

[67]  B. Boruff,et al.  Short-term memory capacity: magic number or magic spell? , 1986, Journal of experimental psychology. Learning, memory, and cognition.

[68]  James W. Stigler,et al.  Digit memory in Chinese and English: Evidence for a temporally limited store , 1986, Cognition.

[69]  Stephen Grossberg,et al.  Competitive Learning: From Interactive Activation to Adaptive Resonance , 1987, Cogn. Sci..

[70]  D. A. Allport,et al.  Language perception and production : relationships between listening, speaking, reading and writing , 1987 .

[71]  T. Shallice.  From Neuropsychology to Mental Structure , 1988 .

[72]  R Treiman,et al.  Short-term memory errors for spoken syllables are affected by the linguistic structure of the syllables. , 1988, Journal of experimental psychology. Learning, memory, and cognition.

[73]  A. P. Georgopoulos,et al.  Primate motor cortex and free arm movements to visual targets in three- dimensional space. II. Coding of the direction of movement by a neuronal population , 1988, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[74]  B. Dosher,et al.  Serial position and set size in short-term memory: The time course of recognition , 1989 .

[75]  B. Murdock,et al.  Memory for Serial Order , 1989 .

[76]  James L. McClelland,et al.  A distributed, developmental model of word recognition and naming. , 1989, Psychological review.

[77]  Catherine G. Penney,et al.  Recall mode and recency in immediate serial recall: Computer users beware! , 1989 .

[78]  A. R. Gardner-Medwin.  Doubly modifiable synapses: a model of short and long term auto-associative memory , 1989, Proceedings of the Royal Society of London. B. Biological Sciences.

[79]  S. Keele,et al.  Timing Functions of The Cerebellum , 1989, Journal of Cognitive Neuroscience.

[80]  Chris Mellish,et al.  Current research in natural language generation , 1990 .

[81]  R. G. Crowder,et al.  Schedules of presentation and temporal distinctiveness in human memory. , 1990 .

[82]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[83]  R. Schweickert,et al.  Phonological Similarity, Pronunciation Rate, and Memory Span , 1990 .

[84]  R. Church,et al.  Alternative representations of time, number, and rate , 1990, Cognition.

[85]  George Houghton,et al.  The problem of serial order: a neural network model of sequence learning and recall , 1990 .

[86]  J. S. Nairne.  A feature model of immediate memory , 1990, Memory & cognition.

[87]  R U Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[88]  Michael I. Jordan.  Attractor dynamics and parallelism in a connectionist sequential machine , 1990 .

[89]  Tim Shallice,et al.  Neuropsychological impairments of short-term memory , 1992 .

[90]  A. Baddeley.  Neuropsychological impairments of short-term memory: The development of the concept of working memory: implications and contributions of neuropsychology , 1990 .

[91]  Cristina Burani,et al.  Articulatory coding and phonological judgements on written words and pictures: The role of the phonological output buffer. , 1991 .

[92]  A. Baddeley,et al.  The influences of number of syllables and wordlikeness on children’s repetition of nonwords , 1991, Applied Psycholinguistics.

[93]  Antje S. Meyer,et al.  The time course of lexical access in speech production: A study of picture naming , 1991 .

[94]  Gordon D. A. Brown,et al.  Memory for familiar and unfamiliar words: Evidence for a long-term memory contribution to short-term memory span , 1991 .

[95]  D I Perrett,et al.  Organization and functions of cells responsive to faces in the temporal cortex. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[96]  J. S. Nairne.  The Loss of Positional Certainty in Long-Term Memory , 1992 .

[97]  Nelson Cowan,et al.  The role of verbal output time in the effects of word length on immediate memory. , 1992 .

[98]  Richard S. J. Frackowiak,et al.  The anatomy of phonological and semantic processing in normal subjects. , 1992, Brain : a journal of neurology.

[99]  N. Burgess,et al.  Toward a network model of the articulatory loop , 1992, Connectionist psychology: A text with readings.

[100]  A. L. Leiner,et al.  Cognitive and language functions of the human cerebellum , 1993, Trends in Neurosciences.

[101]  T. Bliss,et al.  A synaptic model of memory: long-term potentiation in the hippocampus , 1993, Nature.

[102]  T. Shallice,et al.  Perseverative and Semantic Influences on Visual Object Naming Errors in Optic Aphasia: A Connectionist Account , 1993, Journal of Cognitive Neuroscience.

[103]  R. Schweickert.  A multinomial processing tree model for degradation and redintegration in immediate recall , 1993, Memory & cognition.

[104]  Gary S. Dell,et al.  Structure and Content in Language Production: A Theory of Frame Constraints in Phonological Speech Errors , 1993, Cogn. Sci..

[105]  Paul W. B. Atkins,et al.  Models of reading aloud: Dual-route and parallel-distributed-processing approaches. , 1993 .

[106]  S. Zeki.  A vision of the brain , 1993 .

[107]  Richard S. J. Frackowiak,et al.  The neural correlates of the verbal component of working memory , 1993, Nature.

[108]  D. Mewhort,et al.  On serial recall: A critique of chaining in the theory of distributed associative memory. , 1994 .

[109]  Jun Tanji,et al.  Role for supplementary motor area cells in planning several movements ahead , 1994, Nature.

[110]  Risto Miikkulainen,et al.  SARDNET: A Self-Organizing Feature Map for Sequences , 1994, NIPS.

[111]  M. Treisman,et al.  The Internal Clock: Electroencephalographic Evidence for Oscillatory Processes Underlying Time Perception , 1994, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[112]  Stephan Lewandowsky,et al.  Memory for Serial Order Revisited , 1994 .

[113]  Nick C. Ellis,et al.  Handbook of spelling : theory, process, and intervention , 1994 .

[114]  Neil Burgess,et al.  A solvable connectionist model of immediate recall of ordered lists , 1994, NIPS.

[115]  J. S. Nairne,et al.  Critique of the retrieval/deblurring assumptions of the theory of distributed associative memory , 1994 .

[116]  I Neath,et al.  Word-length effects in immediate memory: Overwriting trace decay theory , 1995, Psychonomic bulletin & review.

[117]  George Houghton,et al.  Parallel Models of Serial Behaviour: Lashley Revisited , 1995 .

[118]  Michael D. Kopelman,et al.  The handbook of memory disorders , 1995 .

[119]  R. Llinás,et al.  Dynamic organization of motor control within the olivocerebellar system , 1995, Nature.

[120]  Dylan M. Jones,et al.  Functional equivalence of verbal and spatial information in serial short-term memory. , 1995, Journal of experimental psychology. Learning, memory, and cognition.

[121]  Functional characteristics of the inner voice and the inner ear: Single or double agency? , 1995 .

[122]  R H Logie,et al.  Visuospatial working memory, movement control and executive demands. , 1995, British journal of psychology.

[123]  Joseph P. Levy,et al.  Connectionist models of memory and language , 1995 .

[124]  M. Jüptner,et al.  Localization of a cerebellar timing process using PET , 1995, Neurology.

[125]  Hermann Ackermann,et al.  Cerebellar contributions to cognition , 1995, Behavioural Brain Research.

[126]  Andrew Spencer,et al.  Phonology: Theory and Description , 1995 .

[127]  Charles Hulme,et al.  Modeling Item Length Effects in Memory Span: No Rehearsal Needed? , 1995 .

[128]  M M Smyth,et al.  Serial Order in Spatial Immediate Memory , 1996, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[129]  A. C. Yu,et al.  Temporal Hierarchical Control of Singing in Birds , 1996, Science.

[130]  E. Bizzi,et al.  The Cognitive Neurosciences , 1996 .

[131]  N. Burgess,et al.  Temporal Grouping Effects in Immediate Recall: A Working Memory Analysis , 1996 .

[132]  Susan E. Gathercole,et al.  Models Of Short-Term Memory , 1996 .

[133]  T. Hartley,et al.  A Linguistically Constrained Model of Short-Term Memory for Nonwords ☆ , 1996 .

[134]  D. Norris,et al.  THE QUARTERLY JOURNAL OF EXPERIMENTAL PSYCHOLOGY, 1996, 49A (1), 80 ± 115 Unchained Memory: Error Patterns Rule out Chaining Models of Immediate Serial Recall , 2022 .

[135]  A. Baddeley.  Exploring the Central Executive , 1996 .

[136]  Neil Burgess,et al.  Representations of Serial Order , 1997, NCPW.

[137]  G D Brown,et al.  Word-frequency effects on short-term memory tasks: evidence for a redintegration process in immediate serial recall. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[138]  M. Silveri,et al.  The phonological short-term store-rehearsal system: Patterns of impairment and neural correlates , 1997, Neuropsychologia.

[139]  M Treisman,et al.  A comparison of the encoding of content and order in olfactory memory and in memory for visually presented verbal materials. , 1997, British journal of psychology.

[140]  B. MacWhinney,et al.  Vocabulary Acquisition and Verbal Short-Term Memory: Computational and Neural Bases , 1997, Brain and Language.

[141]  R. G. Crowder,et al.  Temporal distinctiveness and modality. , 1997, Journal of experimental psychology. Learning, memory, and cognition.

[142]  A. Baddeley,et al.  The phonological loop as a language learning device. , 1998, Psychological review.

[143]  D. Norris,et al.  The primacy model: a new model of immediate serial recall. , 1998, Psychological review.

[144]  David Glasspool,et al.  4th Neural Computation and Psychology Workshop, London, 9–11 April 1997 , 1998, Perspectives in Neural Computing.

[145]  M. Zorzi,et al.  Two routes or one in reading aloud? A connectionist dual-process model. , 1998 .

[146]  K. van der Goten,et al.  Interfering with the Central Executive by Means of a Random Interval Repetition Task , 1998, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[147]  M. Poirier,et al.  Semantic Similarity and Immediate Serial Recall: Is There a Detrimental Effect on Order Information? , 1999, The Quarterly journal of experimental psychology. A, Human experimental psychology.

[148]  R. Henson.  Positional information in short-term memory: Relative or absolute? , 1999, Memory & cognition.

[149]  A. Georgopoulos,et al.  Motor cortical encoding of serial order in a context-recall task. , 1999, Science.

[150]  N Burgess,et al.  Recoding, storage, rehearsal and grouping in verbal short-term memory: an fMRI study , 2000, Neuropsychologia.

[151]  G D Brown,et al.  Oscillator-based memory for serial order. , 2000, Psychological review.