Using Temporal Binding for Robust Connectionist Recruitment Learning over Delayed Lines ∗

– a b stra t_ a ltyx,v .2 20/04/03 0632:25 cx9789 E xp – The temporal correlation hypothesis proposes using distributed synchrony for the binding of different stimulus features. However, synchronized spikes must travel over cortical circuits that have varying-length pathways, leading to mismatched arrival times. This raises the question of how initial stimulus-dependent synchrony might be preserved at a destination binding site. Earlier, we proposed constraints on tolerance and segregation parameters for a phase-coding approach, within cortical circuits, to address this question [ 22]. The purpose of the present paper is twofold. First, we conduct simulation experiments to test the proposed constraints. Second, we explore the practicality of temporal binding to drive a process of long∗A similar version of this report has been submitted to the Neurocomputing Journal Special Issue on Spiking Neural Systems. term memory formation based on a recruitment learning

[1]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[2]  Alexandros V. Gerbessiotis,et al.  Topics in parallel and distributed computation , 1993 .

[3]  Jacques Sougné,et al.  Period doubling as a means of representing multiply instantiated entities , 1998 .

[4]  Ch. von der Malsburg,et al.  A neural cocktail-party processor , 1986, Biological Cybernetics.

[5]  M. Abeles,et al.  Firing Rates and Weil-Timed Events in the Cerebral Cortex , 1994 .

[6]  Leslie G. Valiant,et al.  Functionality in neural nets , 1988, COLT '88.

[7]  T. Sejnowski,et al.  Synchronous oscillatory activity in sensory systems: new vistas on mechanisms , 1997, Current Opinion in Neurobiology.

[8]  J E Lisman,et al.  Storage of 7 +/- 2 short-term memories in oscillatory subcycles , 1995, Science.

[9]  I. Biederman,et al.  Dynamic binding in a neural network for shape recognition. , 1992, Psychological review.

[10]  Wayne A. Wickelgren,et al.  Chunking and consolidation: A theoretical synthesis of semantic networks configuring in conditioning , 1979 .

[11]  R. O’Reilly,et al.  Three forms of binding and their neural substrates: Alternatives to temporal synchrony , 2003 .

[12]  Lokendra Shastri,et al.  Advances in SHRUTI—A Neurally Motivated Model of Relational Knowledge Representation and Rapid Inference Using Temporal Synchrony , 1999, Applied Intelligence.

[13]  Andreas K. Engel,et al.  Temporal Binding, Binocular Rivalry, and Consciousness , 1999, Consciousness and Cognition.

[14]  Christoph von der Malsburg,et al.  The Correlation Theory of Brain Function , 1994 .

[15]  Lokendra Shastri,et al.  A Computational Model of Tractable Reasoning - Taking Inspiration from Cognition , 1993, IJCAI.

[16]  Lokendra Shastri,et al.  Types and Quantifiers in SHRUTI: A Connectionist Model of Rapid Reasoning and Relational Processing , 1998, Hybrid Neural Systems.

[17]  DeLiang Wang,et al.  Synchrony and Desynchrony in Integrate-and-Fire Oscillators , 1999, Neural Computation.

[18]  Lokendra Shastri,et al.  Biological Grounding of Recruitment Learning and Vicinal Algorithms in Long-Term Potentiation , 2001, Emergent Neural Computational Architectures Based on Neuroscience.

[19]  D. Hubel,et al.  Segregation of form, color, movement, and depth: anatomy, physiology, and perception. , 1988, Science.

[20]  Lokendra Shastri,et al.  Semantic Networks: An Evidential Formalization and Its Connectionist Realization , 1988 .

[21]  William J. Bowhill,et al.  Design of High-Performance Microprocessor Circuits , 2001 .

[22]  Jean Bullier,et al.  The Timing of Information Transfer in the Visual System , 1997 .

[23]  W Singer,et al.  Visual feature integration and the temporal correlation hypothesis. , 1995, Annual review of neuroscience.

[24]  Deliang Wang,et al.  Global competition and local cooperation in a network of neural oscillators , 1995 .

[25]  Leslie G. Ungerleider,et al.  Pathways for motion analysis: Cortical connections of the medial superior temporal and fundus of the superior temporal visual areas in the macaque , 1990, The Journal of comparative neurology.

[26]  Martin Schneider,et al.  Activity-Dependent Development of Axonal and Dendritic Delays, or, Why Synaptic Transmission Should Be Unreliable , 2002, Neural Computation.

[27]  Wolf Singer,et al.  Time as Coding Space in Neocortical Processing: A Hypothesis , 1994 .

[28]  Nick Littlestone,et al.  Redundant noisy attributes, attribute errors, and linear-threshold learning using winnow , 1991, COLT '91.

[29]  W. Singer,et al.  Oscillatory responses in cat visual cortex exhibit inter-columnar synchronization which reflects global stimulus properties , 1989, Nature.

[30]  O Jensen,et al.  Novel lists of 7 +/- 2 known items can be reliably stored in an oscillatory short-term memory network: interaction with long-term memory. , 1996, Learning & memory.

[31]  Walter Schneider,et al.  Controlled and automatic human information processing: II. Perceptual learning, automatic attending and a general theory. , 1977 .

[32]  Leslie G. Valiant,et al.  Circuits of the mind , 1994 .

[33]  D. R. Mani Lokendra Shastri A Connectionist Solution to the Multiple Instantiation Problem using Temporal Synchrony , 1992 .

[34]  Frank Rosenblatt,et al.  PRINCIPLES OF NEURODYNAMICS. PERCEPTRONS AND THE THEORY OF BRAIN MECHANISMS , 1963 .

[35]  C. Malsburg Binding in models of perception and brain function , 1995, Current Opinion in Neurobiology.

[36]  Richard Reviewer-Granger Unified Theories of Cognition , 1991, Journal of Cognitive Neuroscience.

[37]  Leslie G. Valiant,et al.  A theory of the learnable , 1984, STOC '84.

[38]  Axel Cleeremans,et al.  The Unity of Consciousness: Binding, Integration, and Dissociation , 2003 .

[39]  Jerome A. Feldman,et al.  Dynamic connections in neural networks , 1990, Biological Cybernetics.

[40]  Robert M. French,et al.  A Neurobiologically Inspired Model of Working Memory Based on Neuronal Synchrony and Rythmicity , 1997, NCPW.

[41]  Leslie G. Valiant,et al.  A neuroidal architecture for cognitive computation , 1998, ICALP.

[42]  Jacques Sougné,et al.  Connectionism and the problem of multiple instantiation , 1998, Trends in Cognitive Sciences.

[43]  Antony Browne,et al.  Connectionist inference models , 2001, Neural Networks.

[44]  V. Lamme,et al.  The distinct modes of vision offered by feedforward and recurrent processing , 2000, Trends in Neurosciences.

[45]  Peter König,et al.  Binding by temporal structure in multiple feature domains of an oscillatory neuronal network , 1994, Biological Cybernetics.

[46]  C. Koch,et al.  A brief history of time (constants). , 1996, Cerebral cortex.

[47]  Stefan Wermter,et al.  Hybrid Neural Systems, revised papers from a workshop , 1998 .

[48]  P. König,et al.  Correlated firing in sensory-motor systems , 1995, Current Opinion in Neurobiology.

[49]  David Bailey,et al.  Layered Hybrid Connectionist Models for Cognitive Science , 1998, Hybrid Neural Systems.

[50]  L. Shastri,et al.  From simple associations to systematic reasoning: A connectionist representation of rules, variables and dynamic bindings using temporal synchrony , 1993, Behavioral and Brain Sciences.

[51]  C. Gunay,et al.  The required measures of phase segregation in distributed cortical processing , 2001, IJCNN'01. International Joint Conference on Neural Networks. Proceedings (Cat. No.01CH37222).

[52]  Wolfgang Maass,et al.  Spiking Neurons , 1998, NC.

[53]  Ad Aertsen,et al.  Stable propagation of synchronous spiking in cortical neural networks , 1999, Nature.

[54]  Mark Alan Fanty Learning in structured connectionist networks , 1988 .

[55]  A. Treisman The binding problem , 1996, Current Opinion in Neurobiology.

[56]  Andreas Knoblauch,et al.  Pattern separation and synchronization in spiking associative memories and visual areas , 2001, Neural Networks.