From Numerosity to Ordinal Rank: A Gain-Field Model of Serial Order Representation in Cortical Working Memory

Encoding the serial order of events is an essential function of working memory, but one whose neural basis is not yet well understood. In the present work, we advance a new model of how serial order is represented in working memory. Our approach is predicated on three key findings from neurophysiological research: (1) prefrontal neurons that code conjunctively for item and order, (2) parietal neurons that represent count information through a graded and compressive code, and (3) multiplicative gain modulation as a mechanism for information integration. We used an artificial neural network, integrating across these three findings, to simulate human immediate serial recall performance. The model reproduced a core set of benchmark empirical findings, including primacy and recency effects, transposition gradients, effects of interitem similarity, and developmental effects. The model moves beyond previous accounts by bridging between neuroscientific findings and detailed behavioral data, and gives rise to several testable predictions.

[1]  R. O’Reilly,et al.  Three forms of binding and their neural substrates: Alternatives to temporal synchrony , 2003 .

[2]  A. Mikami,et al.  Prefrontal activity during serial probe reproduction task: encoding, mnemonic, and retrieval processes. , 2006, Journal of neurophysiology.

[3]  J. Joseph,et al.  Activity in the caudate nucleus of monkey during spatial sequencing. , 1995, Journal of neurophysiology.

[4]  S. Funahashi,et al.  Delay-period activity in the primate prefrontal cortex encoding multiple spatial positions and their order of presentation , 1997, Behavioural Brain Research.

[5]  M. Botvinick.  Effects of domain-specific knowledge on memory for serial order , 2005, Cognition.

[6]  J. Tanji,et al.  Integration of temporal order and object information in the monkey lateral prefrontal cortex. , 2004, Journal of neurophysiology.

[7]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[8]  S. Lewandowsky,et al.  Dissimilar items benefit from phonological similarity in serial recall. , 2003, Journal of experimental psychology. Learning, memory, and cognition.

[9]  E. Miller,et al.  Coding of Cognitive Magnitude Compressed Scaling of Numerical Information in the Primate Prefrontal Cortex , 2003, Neuron.

[10]  N. Burgess.  Memory for Serial Order : A Network Model of the Phonological Loop and its Timing , 1999 .

[11]  Emilio Salinas,et al.  Fast Remapping of Sensory Stimuli onto Motor Actions on the Basis of Contextual Modulation , 2004, The Journal of Neuroscience.

[12]  John Jonides,et al.  Order Information in Working Memory: fMRI Evidence for Parietal and Prefrontal Mechanisms , 2000, Journal of Cognitive Neuroscience.

[13]  L F Abbott,et al.  Coordinate transformations in the visual system: how to generate gain fields and what to compute with them. , 2001, Progress in brain research.

[14]  M. D’Esposito.  Working memory. , 2008, Handbook of clinical neurology.

[15]  Brent Doiron,et al.  Deterministic Multiplicative Gain Control with Active Dendrites , 2005, The Journal of Neuroscience.

[16]  R. Conrad,et al.  Order error in immediate recall of sequences , 1965 .

[17]  J. Tanji,et al.  Activity in the Lateral Prefrontal Cortex Reflects Multiple Steps of Future Events in Action Plans , 2006, Neuron.

[18]  S. Lewandowsky,et al.  An endogenous distributed model of ordering in serial recall , 2002, Psychonomic bulletin & review.

[19]  R. Henson.  Short-Term Memory for Serial Order: The Start-End Model , 1998, Cognitive Psychology.

[20]  George Houghton,et al.  The problem of serial order: a neural network model of sequence learning and recall , 1990 .

[21]  Tim Shallice,et al.  Neuropsychological impairments of short-term memory , 1992 .

[22]  J. Jonides,et al.  Working memory for order and the parietal cortex: An event-related functional magnetic resonance imaging study , 2006, Neuroscience.

[23]  D. Zipser,et al.  A spiking network model of short-term active memory , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[24]  Emilio Salinas,et al.  Gain Modulation A Major Computational Principle of the Central Nervous System , 2000, Neuron.

[25]  Peter Ford Dominey,et al.  A Model of Corticostriatal Plasticity for Learning Oculomotor Associations and Sequences , 1995, Journal of Cognitive Neuroscience.

[26]  David J. Freedman,et al.  Representation of the Quantity of Visual Items in the Primate Prefrontal Cortex , 2002, Science.

[27]  E. Miller,et al.  An integrative theory of prefrontal cortex function. , 2001, Annual review of neuroscience.

[28]  J. Fuster.  The Prefrontal Cortex—An Update Time Is of the Essence , 2001, Neuron.

[29]  Andreas Nieder,et al.  Temporal and Spatial Enumeration Processes in the Primate Parietal Cortex , 2006, Science.

[30]  John Jonides,et al.  Processes of Working Memory in Mind and Brain , 2005 .

[31]  D. Norris,et al.  The primacy model: a new model of immediate serial recall. , 1998, Psychological review.

[32]  G D Brown,et al.  Oscillator-based memory for serial order. , 2000, Psychological review.

[33]  Andreas Nieder,et al.  A parieto-frontal network for visual numerical information in the monkey. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[34]  J. Houk,et al.  Model of cortical-basal ganglionic processing: encoding the serial order of sensory events. , 1998, Journal of neurophysiology.

[35]  Matthew M Botvinick,et al.  Short-term memory for serial order: a recurrent neural network model. , 2006, Psychological review.

[36]  M. Manfredi,et al.  The masseter inhibitory reflex is evoked by innocuous stimuli and mediated by A beta afferent fibres , 2004, Experimental Brain Research.

[37]  Richard S. Busby,et al.  Generalizable Relational Binding from Coarse-coded Distributed Representations , 2001, NIPS.

[38]  Rna Henson,et al.  Short-term memory for serial order. , 2001 .

[39]  Alexandre Pouget,et al.  Computational approaches to sensorimotor transformations , 2000, Nature Neuroscience.

[40]  J. Joseph,et al.  Neural activity in the caudate nucleus of monkeys during spatial sequencing , 2004, Experimental Brain Research.

[41]  T. Sejnowski,et al.  Spatial Transformations in the Parietal Cortex Using Basis Functions , 1997, Journal of Cognitive Neuroscience.

[42]  J. Joseph,et al.  Prefrontal cortex and spatial sequencing in macaque monkey , 2004, Experimental Brain Research.

[43]  J. Tanji,et al.  Numerical representation for action in the parietal cortex of the monkey , 2002, Nature.

[44]  H. Eichenbaum,et al.  Critical role of the hippocampus in memory for sequences of events , 2002, Nature Neuroscience.

[45]  A. Nieder.  Counting on neurons: the neurobiology of numerical competence , 2005, Nature Reviews Neuroscience.

[46]  Lauren M. Bylsma,et al.  Regularization in short-term memory for serial order. , 2005, Journal of experimental psychology. Learning, memory, and cognition.

[47]  C. Marshuetz,et al.  Order information in working memory: an integrative review of evidence from brain and behavior. , 2005, Psychological bulletin.

[48]  Peter Ford Dominey.  An Anatomically Structured Sensory-Motor Sequence Learning System Displays Some General Linguistic Capacities , 1997, Brain and Language.

[49]  Gordon D. A. Brown,et al.  Children's serial recall errors: implications for theories of short-term memory development. , 2000, Journal of experimental child psychology.

[50]  Randall C. O'Reilly,et al.  A Model of the Phonological Loop: Generalization and Binding , 2001, NIPS.

[51]  J. Tanji,et al.  Representation of the temporal order of visual objects in the primate lateral prefrontal cortex. , 2003, Journal of neurophysiology.

[52]  Prahlad Gupta,et al.  EXPLORING THE RELATIONSHIP BETWEEN WORD PROCESSING AND VERBAL SHORT-TERM MEMORY: EVIDENCE FROM ASSOCIATIONS AND DISSOCIATIONS , 2004, Cognitive neuropsychology.

[53]  R. Andersen,et al.  Head position signals used by parietal neurons to encode locations of visual stimuli , 1995, Nature.