Dynamically Partitionable Autoassociative Networks as a Solution to the Neural Binding Problem

An outstanding question in theoretical neuroscience is how the brain solves the neural binding problem. In vision, binding can be summarized as the ability to represent that certain properties belong to one object while other properties belong to a different object. I review the binding problem in visual and other domains, and review its simplest proposed solution – the anatomical binding hypothesis. This hypothesis has traditionally been rejected as a true solution because it seems to require a type of one-to-one wiring of neurons that would be impossible in a biological system (as opposed to an engineered system like a computer). I show that this requirement for one-to-one wiring can be loosened by carefully considering how the neural representation is actually put to use by the rest of the brain. This leads to a solution where a symbol is represented not as a particular pattern of neural activation but instead as a piece of a global stable attractor state. I introduce the Dynamically Partitionable AutoAssociative Network (DPAAN) as an implementation of this solution and show how DPANNs can be used in systems which perform perceptual binding and in systems that implement syntax-sensitive rules. Finally I show how the core parts of the cognitive architecture ACT-R can be neurally implemented using a DPAAN as ACT-R’s global workspace. Because the DPAAN solution to the binding problem requires only “flat” neural representations (as opposed to the phase encoded representation hypothesized in neural synchrony solutions) it is directly compatible with the most well developed neural models of learning, memory, and pattern recognition.

[1]  I. Biederman,et al.  Neural encoding of relative position. , 2011, Journal of experimental psychology. Human perception and performance.

[2]  G. Wallis,et al.  Learning invariant responses to the natural transformations of objects , 1993, Proceedings of 1993 International Conference on Neural Networks (IJCNN-93-Nagoya, Japan).

[3]  A. Treisman Solutions to the Binding Problem Progress through Controversy and Convergence , 1999, Neuron.

[4]  Michael N. Shadlen,et al.  Synchrony Unbound A Critical Evaluation of the Temporal Binding Hypothesis , 1999, Neuron.

[5]  Aniket Kittur,et al.  A Solution to the Binding Problem for Compositional Connectionism , 2004, AAAI Technical Report.

[6]  P. Cavanagh,et al.  Tracking multiple targets with multifocal attention , 2005, Trends in Cognitive Sciences.

[7]  Yuki Yamada,et al.  Two noncontiguous locations can be attended concurrently: Evidence from the attentional blink , 2006, Psychonomic bulletin & review.

[8]  Thomas Serre,et al.  A Theory of Object Recognition: Computations and Circuits in the Feedforward Path of the Ventral Stream in Primate Visual Cortex , 2005 .

[9]  D. Somers,et al.  Multiple Spotlights of Attentional Selection in Human Visual Cortex , 2004, Neuron.

[10]  Nathan Intrator,et al.  (coarse Coding of Shape Fragments) (retinotopy) Representation of Structure , 2000 .

[11]  John R. Anderson,et al.  Information-processing modules and their relative modality specificity , 2007, Cognitive Psychology.

[12]  John R. Anderson,et al.  Conditional Routing of Information to the Neocortex: A Network Model of Basal Ganglia Function , 2008 .

[13]  T. Poggio,et al.  Hierarchical models of object recognition in cortex , 1999, Nature Neuroscience.

[14]  A. Treisman The binding problem , 1996, Current Opinion in Neurobiology.

[15]  Peter Földiák,et al.  Learning Invariance from Transformation Sequences , 1991, Neural Comput..

[16]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[17]  D. J. Felleman,et al.  Distributed hierarchical processing in the primate cerebral cortex. , 1991, Cerebral cortex.

[18]  C. Malsburg Binding in models of perception and brain function , 1995, Current Opinion in Neurobiology.

[19]  T. Poggio,et al.  How Visual Cortex Recognizes Objects: The Tale of the Standard Model , 2002 .

[20]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[21]  John R. Anderson How Can the Human Mind Occur in the Physical Universe , 2007 .

[22]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[23]  Keiji Tanaka,et al.  Neuronal selectivities to complex object features in the ventral visual pathway of the macaque cerebral cortex. , 1994, Journal of neurophysiology.

[24]  Bartlett W. Mel SEEMORE: Combining Color, Shape, and Texture Histogramming in a Neurally Inspired Approach to Visual Object Recognition , 1997, Neural Computation.

[25]  C. Lebiere,et al.  The Atomic Components of Thought , 1998 .

[26]  John R Anderson,et al.  An integrated theory of the mind. , 2004, Psychological review.

[27]  Shelby Montague Tutorial on Neural Systems Modeling , 2011, The Yale Journal of Biology and Medicine.

[28]  R. Desimone,et al.  The Role of Neural Mechanisms of Attention in Solving the Binding Problem , 1999, Neuron.

[29]  Christoph von der Malsburg,et al.  The What and Why of Binding The Modeler’s Perspective , 1999, Neuron.

[30]  J J Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities. , 1982, Proceedings of the National Academy of Sciences of the United States of America.

[31]  Kenneth J. Hayworth Explicit encoding of spatial relations in the human visual system: Evidence from functional neuroimaging , 2009 .

[32]  John E. Hummel,et al.  Getting symbols out of a neural architecture , 2011, Connect. Sci..

[33]  Yuki Yamada,et al.  Dividing attention between two different categories and locations in rapid serial visual presentations , 2007, Perception & psychophysics.

[34]  D. Patterson The University of Southern California. , 1985 .

[35]  Edmund T. Rolls,et al.  Invariant visual object recognition: A model, with lighting invariance , 2006, Journal of Physiology-Paris.