From Distributed Resources to Limited Slots in Multiple-Item Working Memory: A Spiking Network Model with Normalization

Recent behavioral studies have given rise to two contrasting models for limited working memory capacity: a “discrete-slot” model in which memory items are stored in a limited number of slots, and a “shared-resource” model in which the neural representation of items is distributed across a limited pool of resources. To elucidate the underlying neural processes, we investigated a continuous network model for working memory of an analog feature. Our model network fundamentally operates with a shared resource mechanism, and stimuli in cue arrays are encoded by a distributed neural population. On the other hand, the network dynamics and performance are also consistent with the discrete-slot model, because multiple objects are maintained by distinct localized population persistent activity patterns (bump attractors). We identified two phenomena of recurrent circuit dynamics that give rise to limited working memory capacity. As the working memory load increases, a localized persistent activity bump may either fade out (so the memory of the corresponding item is lost) or merge with another nearby bump (hence the resolution of mnemonic representation for the merged items becomes blurred). We identified specific dependences of these two phenomena on the strength and tuning of recurrent synaptic excitation, as well as network normalization: the overall population activity is invariant to set size and delay duration; therefore, a constant neural resource is shared by and dynamically allocated to the memorized items. We demonstrate that the model reproduces salient observations predicted by both discrete-slot and shared-resource models, and propose testable predictions of the merging phenomenon.

[1]  Daeyeol Lee,et al.  Neuronal basis of age-related working memory decline , 2011, Nature.

[2]  Markus Siegel,et al.  Neural substrates of cognitive capacity limitations , 2011, Proceedings of the National Academy of Sciences.

[3]  John F. Magnotti,et al.  Visual Short-Term Memory Compared in Rhesus Monkeys and Humans , 2011, Current Biology.

[4]  Tatiana A. Engel,et al.  Same or Different? A Neural Circuit Mechanism of Similarity-Based Pattern Match Decision Making , 2011, The Journal of Neuroscience.

[5]  R. Hampton,et al.  Monkeys Recall and Reproduce Simple Shapes from Memory , 2011, Current Biology.

[6]  Jon Driver,et al.  Principal component analysis of behavioural individual differences suggests that particular aspects of visual working memory may relate to specific aspects of attention , 2011, Neuropsychologia.

[7]  Edward Awh,et al.  Precision in Visual Working Memory Reaches a Stable Plateau When Individual Item Limits Are Exceeded , 2011, The Journal of Neuroscience.

[8]  Liqiang Huang,et al.  Visual working memory is better characterized as a distributed resource rather than discrete slots. , 2010, Journal of vision.

[9]  Christopher L. Asplund,et al.  What are the units of storage in visual working memory? , 2010, Journal of vision.

[10]  Jon Driver,et al.  Integration of Goal- and Stimulus-Related Visual Signals Revealed by Damage to Human Parietal Cortex , 2010, The Journal of Neuroscience.

[11]  E. Vogel,et al.  Discrete capacity limits in visual working memory , 2010, Current Opinion in Neurobiology.

[12]  Markus Siegel,et al.  Phase-dependent neuronal coding of objects in short-term memory , 2009, Proceedings of the National Academy of Sciences.

[13]  Ipek Oruc,et al.  Improved face discrimination after face adaptation , 2009 .

[14]  Bevil R. Conway,et al.  Color-tuned neurons are spatially clustered according to color preference within alert macaque posterior inferior temporal cortex , 2009, Proceedings of the National Academy of Sciences.

[15]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[16]  Jeffrey S. Johnson,et al.  A Dynamic Neural Field Model of Visual Working Memory and Change Detection , 2009, Psychological science.

[17]  Jesper Tegnér,et al.  Mechanism for top-down control of working memory capacity , 2009, Proceedings of the National Academy of Sciences.

[18]  Robert J Summers,et al.  Neuronal convergence in early contrast vision: binocular summation is followed by response nonlinearity and area summation. , 2009, Journal of vision.

[19]  S. Luck,et al.  Sudden Death and Gradual Decay in Visual Working Memory , 2009, Psychological science.

[20]  S. Luck,et al.  The influence of similarity on visual working memory representations , 2009, Visual cognition.

[21]  D. Heeger,et al.  The Normalization Model of Attention , 2009, Neuron.

[22]  Paul M Bays,et al.  Dynamic Shifts of Limited Working Memory Resources in Human Vision , 2008, Science.

[23]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[24]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[25]  Earl K Miller,et al.  The representation of multiple objects in prefrontal neuronal delay activity. , 2007, Cerebral cortex.

[26]  J. Tegnér,et al.  A biophysical model of multiple-item working memory: A computational and neuroimaging study , 2006, Neuroscience.

[27]  M. Chun,et al.  Dissociable neural mechanisms supporting visual short-term memory for objects , 2006, Nature.

[28]  Shun-ichi Amari,et al.  Difficulty of Singularity in Population Coding , 2005, Neural Computation.

[29]  Nelson Cowan,et al.  Working Memory Capacity , 2005 .

[30]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[31]  Stephen R Mitroff,et al.  Nothing compares 2 views: Change blindness can occur despite preserved access to the changed information , 2004, Perception & psychophysics.

[32]  A. Hollingworth Failures of retrieval and comparison constrain change detection in natural scenes. , 2003, Journal of experimental psychology. Human perception and performance.

[33]  Leslie G. Ungerleider,et al.  Neural processing of emotional faces requires attention , 2002, Proceedings of the National Academy of Sciences of the United States of America.

[34]  A. Raffone,et al.  A Cortical Mechanism for Binding in Visual Working Memory , 2001, Journal of Cognitive Neuroscience.

[35]  P. Goldman-Rakic,et al.  Coding Specificity in Cortical Microcircuits: A Multiple-Electrode Analysis of Primate Prefrontal Cortex , 2001, The Journal of Neuroscience.

[36]  J. Jonides,et al.  Overlapping mechanisms of attention and spatial working memory , 2001, Trends in Cognitive Sciences.

[37]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[38]  R. Zemel,et al.  Information processing with population codes , 2000, Nature Reviews Neuroscience.

[39]  P. Goldman-Rakic,et al.  Synaptic mechanisms and network dynamics underlying spatial working memory in a cortical network model. , 2000, Cerebral cortex.

[40]  S. Magnussen Low-level memory processes in vision , 2000, Trends in Neurosciences.

[41]  Stefan Treue,et al.  Seeing multiple directions of motion—physiology and psychophysics , 2000, Nature Neuroscience.

[42]  X. Wang,et al.  Synaptic Basis of Cortical Persistent Activity: the Importance of NMDA Receptors to Working Memory , 1999, The Journal of Neuroscience.

[43]  A. Pouget,et al.  Reading population codes: a neural implementation of ideal observers , 1999, Nature Neuroscience.

[44]  P. Goldman-Rakic,et al.  Isodirectional tuning of adjacent interneurons and pyramidal cells during working memory: evidence for microcolumnar organization in PFC. , 1999, Journal of neurophysiology.

[45]  Alexandre Pouget,et al.  Probabilistic Interpretation of Population Codes , 1996, Neural Computation.

[46]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[47]  Kenneth D. Miller,et al.  Physiological Gain Leads to High ISI Variability in a Simple Model of a Cortical Regular Spiking Cell , 1997, Neural Computation.

[48]  J P Thomas,et al.  Parallel processing in visual short-term memory. , 1996, Journal of experimental psychology. Human perception and performance.

[49]  Patrick J. Bennett,et al.  Masking of spatial frequency in visual memory depends on distal, not retinal, frequency , 1996, Vision Research.

[50]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[51]  P. Goldman-Rakic Cellular basis of working memory , 1995, Neuron.

[52]  N. Fisher Statistical Analysis of Circular Data , 1993 .

[53]  C. Stevens,et al.  Voltage dependence of NMDA-activated macroscopic conductances predicted by single-channel kinetics , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[54]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[55]  J. T. Massey,et al.  Mental rotation of the neuronal population vector. , 1989, Science.

[56]  H Pashler,et al.  Familiarity and visual change detection , 1988, Perception & psychophysics.

[57]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[58]  D. Regan Storage of spatial-frequency information and spatial-frequency discrimination , 1985 .

[59]  G. A. Miller THE PSYCHOLOGICAL REVIEW THE MAGICAL NUMBER SEVEN, PLUS OR MINUS TWO: SOME LIMITS ON OUR CAPACITY FOR PROCESSING INFORMATION 1 , 1956 .