The binding pool: A model of shared neural resources for distinct items in visual working memory

Visual working memory (VWM) refers to the ability to encode, store, and retrieve visual information. The two prevailing theories that describe VWM assume that information is stored either in discrete slots or within a shared pool of resources. However, there is not yet a good understanding of the neural mechanisms that would underlie such theories. To address this gap, we provide a computationally realized neural account that uses a pool of shared neurons to store information about one or more distinct stimuli. The binding pool model is a neural network that is essentially a hybrid of the slot and resource theories. It describes how information can be stored and retrieved from a pool of shared resources using a type/token architecture (Bowman & Wyble in Psychological Review 114(1), 38–70, 2007; Kanwisher in Cognition 27, 117–143, 1987; Mozer in Journal of Experimental Psychology: Human Perception and Performance 15(2), 287–303, 1989). The model can store multiple distinct objects, each containing binding links to one or more features. The binding links are stored in a pool of shared resources and, thus, produce mutual interference as memory load increases. Given a cue, the model retrieves a specific object and then reconstructs other features bound to that object, along with a confidence metric. The model can simulate data from continuous report and change detection paradigms and generates testable predictions about the interaction of report accuracy, confidence, and stimulus similarity. The testing of such predictions will help to identify the boundaries of shared resource theories, thereby providing insight into the roles of ensembles and context in explaining our ability to remember visual information.

[1]  P. Cavanagh,et al.  The Capacity of Visual Short-Term Memory is Set Both by Visual Information Load and by Number of Objects , 2004, Psychological science.

[2]  Simon Farrell,et al.  Modeling working memory: An interference model of complex span , 2012, Psychonomic bulletin & review.

[3]  B. Underwood,et al.  Proactive inhibition in short-term retention of single items , 1962 .

[4]  Klaus Oberauer,et al.  Visual working memory declines when more features must be remembered for each object , 2013, Memory & cognition.

[5]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[6]  P. Cavanagh,et al.  Flexible cognitive resources: competitive content maps for attention and memory , 2013, Trends in Cognitive Sciences.

[7]  Klaus Oberauer,et al.  Design for a working memory. , 2009 .

[8]  George A. Alvarez,et al.  Explaining human multiple object tracking as resource-constrained approximate inference in a dynamic probabilistic model , 2009, NIPS.

[9]  Timothy F. Brady,et al.  A probabilistic model of visual working memory: Incorporating higher order regularities into working memory capacity estimates. , 2013, Psychological review.

[10]  Tony A. Plate,et al.  Holographic reduced representations , 1995, IEEE Trans. Neural Networks.

[11]  Paul M Bays,et al.  Temporal dynamics of encoding, storage, and reallocation of visual working memory. , 2011, Journal of vision.

[12]  Pentti Kanerva,et al.  Sparse distributed memory and related models , 1993 .

[13]  G. Alvarez,et al.  Object features fail independently in visual working memory: evidence for a probabilistic feature-store model. , 2011, Journal of vision.

[14]  R. Sekuler,et al.  Recognizing spatial patterns: a noisy exemplar approach , 2002, Vision Research.

[15]  M. D’Esposito Working memory. , 2008, Handbook of clinical neurology.

[16]  Wei Ji Ma,et al.  Variability in encoding precision accounts for visual short-term memory limitations , 2012, Proceedings of the National Academy of Sciences.

[17]  William Prinzmetal,et al.  Phenomenology of attention: I. Color, location, orientation, and spatial frequency. , 1998 .

[18]  M. Nieuwenstein,et al.  The attentional blink provides episodic distinctiveness: sparing at a cost. , 2009, Journal of experimental psychology. Human perception and performance.

[19]  I. Rock,et al.  Perception without attention: Results of a new method , 1992, Cognitive Psychology.

[20]  E. Vul,et al.  Independent Sampling of Features Enables Conscious Perception of Bound Objects , 2010, Psychological science.

[21]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[22]  R. Sekuler,et al.  Distortions in recall from visual memory: two classes of attractors at work. , 2010, Journal of vision.

[23]  M. Hasselmo,et al.  Computational Modeling of Entorhinal Cortex , 2000, Annals of the New York Academy of Sciences.

[24]  Frank Tong,et al.  Introspective judgments predict the precision and likelihood of successful maintenance of visual working memory. , 2012, Journal of vision.

[25]  S. Luck,et al.  The influence of similarity on visual working memory representations , 2009, Visual cognition.

[26]  Melissa R. Beck,et al.  Attention shifts or volatile representations: What causes binding deficits in visual working memory? , 2012 .

[27]  A. Treisman,et al.  Binding in short-term visual memory. , 2002, Journal of experimental psychology. General.

[28]  Paul R. Martin,et al.  Receptive field asymmetries produce color-dependent direction selectivity in primate lateral geniculate nucleus. , 2010, Journal of vision.

[29]  Ernst Niebur,et al.  Mechanisms of perceptual organization provide auto-zoom and auto-localization for attention to objects , 2010, Proceedings of the National Academy of Sciences.

[30]  V. Goffaux,et al.  The horizontal tuning of face perception relies on the processing of intermediate and high spatial frequencies. , 2011, Journal of vision.

[31]  A. Treisman,et al.  Illusory conjunctions in the perception of objects , 1982, Cognitive Psychology.

[32]  Timothy F. Brady,et al.  Hierarchical Encoding in Visual Working Memory , 2010, Psychological science.

[33]  R. Jacobs,et al.  A probabilistic clustering theory of the organization of visual short-term memory. , 2013, Psychological review.

[34]  R. VanRullen Binding hardwired versus on-demand feature conjunctions , 2009 .

[35]  S. Luck,et al.  Discrete fixed-resolution representations in visual working memory , 2008, Nature.

[36]  Xiao-Jing Wang,et al.  From Distributed Resources to Limited Slots in Multiple-Item Working Memory: A Spiking Network Model with Normalization , 2012, The Journal of Neuroscience.

[37]  Bennet B. Murdock,et al.  A distributed memory model for serial-order information. , 1983 .

[38]  Edward K. Vogel,et al.  The capacity of visual working memory for features and conjunctions , 1997, Nature.

[39]  George A. Alvarez,et al.  Variability in the quality of visual working memory , 2012, Nature Communications.

[40]  A. Treisman,et al.  A feature-integration theory of attention , 1980, Cognitive Psychology.

[41]  N. Kanwisher Repetition blindness: Type recognition without token individuation , 1987, Cognition.

[42]  B. Wyble,et al.  The simultaneous type, serial token model of temporal attention and working memory. , 2007, Psychological review.

[43]  Wei Ji Ma,et al.  No Evidence for an Item Limit in Change Detection , 2013, PLoS Comput. Biol..

[44]  Arno Koning,et al.  Multiple object tracking: anticipatory attention doesn't "bounce". , 2012, Journal of vision.

[45]  Paul M Bays,et al.  Dynamic Updating of Working Memory Resources for Visual Objects , 2011, The Journal of Neuroscience.

[46]  M. Chun,et al.  Organization of visual short-term memory. , 2000, Journal of experimental psychology. Learning, memory, and cognition.

[47]  E. Vogel,et al.  PSYCHOLOGICAL SCIENCE Research Article Visual Working Memory Represents a Fixed Number of Items Regardless of Complexity , 2022 .

[48]  Rachel A Robbins,et al.  A Review and Clarification of the Terms “holistic,” “configural,” and “relational” in the Face Perception Literature , 2012, Front. Psychology.

[49]  Joshua K. Hartshorne Visual Working Memory Capacity and Proactive Interference , 2008, PloS one.

[50]  Brad Wyble,et al.  Attentional episodes in visual perception. , 2011, Journal of experimental psychology. General.

[51]  W. Ma,et al.  A detection theory account of change detection. , 2004, Journal of vision.

[52]  James L. McClelland Explorations In Parallel Distributed Processing , 1988 .

[53]  Nancy B. Carlisle,et al.  The benefit of forgetting , 2012, Psychonomic Bulletin & Review.

[54]  M. Mozer Types and tokens in visual letter perception. , 1989, Journal of experimental psychology. Human perception and performance.

[55]  Paul M Bays,et al.  The precision of visual working memory is set by allocation of a shared resource. , 2009, Journal of vision.

[56]  Timothy F. Brady,et al.  Modeling visual working memory with the MemToolbox. , 2013, Journal of vision.

[57]  H. D. Block The perceptron: a model for brain functioning. I , 1962 .

[58]  Christopher L. Asplund,et al.  What are the units of storage in visual working memory? , 2010, Journal of vision.

[59]  A. Caramazza,et al.  The structure of graphemic representations , 1990, Cognition.

[60]  G. Bower,et al.  THE PSYCHOLOGY OF LEARNING AND M·OTIVATION , 2001 .

[61]  A Caramazza,et al.  Temporal and spatial repetition blindness: effects of presentation mode and repetition lag on the perception of repeated items. , 1996, Journal of experimental psychology. Human perception and performance.

[62]  S. Luck,et al.  Proactive Interference Does Not Meaningfully Distort Visual Working Memory Capacity Estimates in the Canonical Change Detection Task , 2012, Front. Psychology.

[63]  G. Woodman,et al.  The time course of consolidation in visual working memory. , 2006, Journal of experimental psychology. Human perception and performance.

[64]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[65]  R. Jacobs,et al.  An ideal observer analysis of visual working memory. , 2012, Psychological review.

[66]  G. Woodman,et al.  Storage of features, conjunctions and objects in visual working memory. , 2001, Journal of experimental psychology. Human perception and performance.

[67]  D Marr,et al.  Early processing of visual information. , 1976, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[68]  S. Solomon,et al.  Contrast sensitivity in natural scenes depends on edge as well as spatial frequency structure. , 2009, Journal of vision.