Modeling Compositionality by Dynamic Binding of Synfire Chains

This paper examines the feasibility of manifesting compositionality by a system of synfire chains. Compositionality is the ability to construct mental representations, hierarchically, in terms of parts and their relations. We show that synfire chains may synchronize their waves when a few orderly cross links are available. We propose that synchronization among synfire chains can be used for binding component into a whole. Such synchronization is shown both for detailed simulations, and by numerical analysis of the propagation of a wave along a synfire chain. We show that global inhibition may prevent spurious synchronization among synfire chains. We further show that selecting which synfire chains may synchronize to which others may be improved by including inhibitory neurons in the synfire pools. Finally we show that in a hierarchical system of synfire chains, a part-binding problem may be resolved, and that such a system readily demonstrates the property of priming. We compare the properties of our system with the general requirements for neural networks that demonstrate compositionality.

[1]  Christoph von der Malsburg,et al.  Recognizing Faces by Dynamic Link Matching , 1996, NeuroImage.

[2]  Moshe Abeles,et al.  Corticonics: Neural Circuits of Cerebral Cortex , 1991 .

[3]  Elie Bienenstock,et al.  Compositionality, MDL Priors, and Object Recognition , 1996, NIPS.

[4]  E. Vaadia,et al.  Spatiotemporal structure of cortical activity: properties and behavioral relevance. , 1998, Journal of neurophysiology.

[5]  R. Desimone,et al.  The Role of Neural Mechanisms of Attention in Solving the Binding Problem , 1999, Neuron.

[6]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[7]  E. Vaadia,et al.  Synchronization in neuronal transmission and its importance for information processing. , 1994 .

[8]  Robert M. French,et al.  Synfire chains and catastrophic interference , 2001 .

[9]  Adam Prügel-Bennett,et al.  Analysis of synfire chains , 1995 .

[10]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[11]  D. Georgescauld.  Local Cortical Circuits, An Electrophysiological Study , 1983 .

[12]  A. Treisman.  Solutions to the Binding Problem Progress through Controversy and Convergence , 1999, Neuron.

[13]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[14]  J. Hertz,et al.  Learning short synfire chains by self-organization. , 1996, Network.

[15]  M Abeles,et al.  Synchronization in neuronal transmission and its importance for information processing. , 1994, Progress in brain research.

[16]  T. Poggio,et al.  Are Cortical Models Really Bound by the “Binding Problem”? , 1999, Neuron.

[17]  Braitenberg,et al.  Brain theory : biological basis and computational principles , 1996 .

[18]  K Y M Wong.  Exact dynamics in feedforward neural networks , 1997 .

[19]  Eric O. Postma,et al.  Robust Feedforward Processing in Synfire Chains , 1996, Int. J. Neural Syst..

[20]  H. Barlow.  The neuron doctrine in perception. , 1995 .

[21]  Idan Segev,et al.  On the Transmission of Rate Code in Long Feedforward Networks with Excitatory–Inhibitory Balance , 2003, The Journal of Neuroscience.

[22]  C. Malsburg.  Binding in models of perception and brain function , 1995, Current Opinion in Neurobiology.

[23]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[24]  J. Hummel.  Complementary solutions to the binding problem in vision: Implications for shape perception and object recognition , 2001 .

[25]  Jochen Triesch,et al.  Binding - A Proposed Experiment and a Model , 1996, ICANN.

[26]  David C. Sterratt,et al.  Is a biological temporal learning rule compatible with learning synfire chains , 1999 .

[27]  I. Tetko,et al.  Spatiotemporal activity patterns of rat cortical neurons predict responses in a conditioned task. , 1999, Proceedings of the National Academy of Sciences of the United States of America.

[28]  A. Treisman.  The binding problem , 1996, Current Opinion in Neurobiology.

[29]  L. Shastri,et al.  From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony , 1993, Behavioral and Brain Sciences.

[30]  A Aertsen,et al.  Propagation of synchronous spiking activity in feedforward neural networks , 1996, Journal of Physiology-Paris.

[31]  Daniel Frederic Potter.  Compositional pattern recognition , 1999 .

[32]  Asher Cohen,et al.  Response selection processes for conjunctive targets. , 2000 .

[33]  Daniel Lehmann,et al.  A Model for Representing the Dynamics of a System of Synfire Chains , 2005, Journal of Computational Neuroscience.

[34]  Wolfgang Maass,et al.  Fast Sigmoidal Networks via Spiking Neurons , 1997, Neural Computation.

[35]  J. Changeux,et al.  SYNAPTIC PLASTICITY AS BASIS OF BRAIN ORGANIZATION , 2022 .

[36]  E. Bienenstock.  A model of neocortex , 1995 .

[37]  R. Eckhorn,et al.  Coherent oscillations: A mechanism of feature linking in the visual cortex? , 1988, Biological Cybernetics.

[38]  René Doursat,et al.  Contribution a l'etude des representtions dans le systeme nerveux et dans les reseaux de neurones formels , 1991 .

[39]  C. Gray.  The Temporal Correlation Hypothesis of Visual Feature Integration Still Alive and Well , 1999, Neuron.

[40]  Wolfgang Maass,et al.  Networks of spiking neurons can emulate arbitrary Hopfield nets in temporal coding , 1997 .

[41]  W. Singer,et al.  Stimulus-specific neuronal oscillations in orientation columns of cat visual cortex. , 1989, Proceedings of the National Academy of Sciences of the United States of America.

[42]  A. Damasio.  Time-locked multiregional retroactivation: A systems-level proposal for the neural substrates of recall and recognition , 1989, Cognition.

[43]  L R R Carreiro,et al.  The modulation of simple reaction time by the spatial probability of a visual stimulus. , 2003, Brazilian journal of medical and biological research = Revista brasileira de pesquisas medicas e biologicas.

[44]  Azriel Rosenfeld,et al.  From volumes to views: An approach to 3-D object recognition , 1992, CVGIP Image Underst..

[45]  Michael N. Shadlen,et al.  Synchrony Unbound A Critical Evaluation of the Temporal Binding Hypothesis , 1999, Neuron.

[46]  W. Newsome,et al.  The Variable Discharge of Cortical Neurons: Implications for Connectivity, Computation, and Information Coding , 1998, The Journal of Neuroscience.

[47]  S. Ullman.  Aligning pictorial descriptions: An approach to object recognition , 1989, Cognition.

[48]  D. C. Essen,et al.  Modular and hierarchical organization of extrastriate visual cortex in the macaque monkey. , 1990, Cold Spring Harbor symposia on quantitative biology.

[49]  V. Braitenberg.  Two Views of the Cerebral Cortex , 1986 .

[50]  M. Usher,et al.  Segmentation, Binding, and Illusory Conjunctions , 1991, Neural Computation.

[51]  David Horn,et al.  The Importance of Noise for Segmentation and Binding in Dynamical Neural Systems , 1996, Int. J. Neural Syst..

[52]  W. Regehr,et al.  Short-term synaptic plasticity. , 2002, Annual review of physiology.

[53]  Christoph von der Malsburg,et al.  The What and Why of Binding The Modeler’s Perspective , 1999, Neuron.

[54]  J. Hummel,et al.  An architecture for rapid, hierarchical structural description , 1996 .

[55]  Wolf Singer,et al.  Neuronal Synchrony: A Versatile Code for the Definition of Relations? , 1999, Neuron.

[56]  Wilfried Brauer,et al.  Synchronization without oscillatory neurons , 1996, Biol. Cybern..

[57]  Jorma Rissanen,et al.  Stochastic Complexity in Statistical Inquiry , 1989, World Scientific Series in Computer Science.

[58]  Isaac Meilijson,et al.  Distributed Synchrony of Spiking Neurons in a Hebbian Cell Assembly , 1999, NIPS.