A Moving Bump in a Continuous Manifold: A Comprehensive Study of the Tracking Dynamics of Continuous Attractor Neural Networks

Understanding how the dynamics of a neural network is shaped by the network structure and, consequently, how the network structure facilitates the functions implemented by the neural system is at the core of using mathematical models to elucidate brain functions. This study investigates the tracking dynamics of continuous attractor neural networks (CANNs). Due to the translational invariance of neuronal recurrent interactions, CANNs can hold a continuous family of stationary states. They form a continuous manifold in which the neural system is neutrally stable. We systematically explore how this property facilitates the tracking performance of a CANN, which is believed to have clear correspondence with brain functions. By using the wave functions of the quantum harmonic oscillator as the basis, we demonstrate how the dynamics of a CANN is decomposed into different motion modes, corresponding to distortions in the amplitude, position, width, or skewness of the network state. We then develop a perturbation approach that utilizes the dominating movement of the network's stationary states in the state space. This method allows us to approximate the network dynamics up to an arbitrary accuracy depending on the order of perturbation used. We quantify the distortions of a gaussian bump during tracking and study their effects on tracking performance. Results are obtained on the maximum speed for a moving stimulus to be trackable and the reaction time for the network to catch up with an abrupt change in the stimulus.

[1]  Henry C. Tuckwell,et al.  Introduction to theoretical neurobiology , 1988 .

[2]  Paul Miller,et al.  Analysis of Spike Statistics in Neuronal Systems with Continuous Attractors or Multiple, Discrete Attractor States , 2006, Neural Computation.

[3]  A. Pouget,et al.  Reading population codes: a neural implementation of ideal observers , 1999, Nature Neuroscience.

[4]  Eytan Domany,et al.  Models of Neural Networks I , 1991 .

[5]  B. Ermentrout Neural networks as spatio-temporal pattern-forming systems , 1998 .

[6]  Thomas P. Trappenberg,et al.  Continuous Attractor Neural Networks , 2005 .

[7]  Carson C. Chow,et al.  Stationary Bumps in Networks of Spiking Neurons , 2001, Neural Computation.

[8]  E. Rolls,et al.  Self-organizing continuous attractor networks and path integration: one-dimensional models of head direction cells , 2002, Network.

[9]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[10]  Shang‐keng Ma Modern Theory of Critical Phenomena , 1976 .

[11]  Ranulfo Romo,et al.  Basic mechanisms for graded persistent activity: discrete attractors, continuous attractors, and dynamic representations , 2003, Current Opinion in Neurobiology.

[12]  John H. R. Maunsell,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. , 1983, Journal of neurophysiology.

[13]  S. Amari Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[14]  Yao Lu,et al.  Traveling Bumps and Their Collisions in a Two-Dimensional Neural Field , 2011, Neural Computation.

[15]  P. Goldman-Rakic,et al.  Mnemonic coding of visual space in the monkey's dorsolateral prefrontal cortex. , 1989, Journal of neurophysiology.

[16]  H. Sompolinsky,et al.  13 Modeling Feature Selectivity in Local Cortical Circuits , 2022 .

[17]  A. Georgopoulos,et al.  Cognitive neurophysiology of the motor cortex. , 1993, Science.

[18]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[19]  Carlos D. Brody,et al.  Design of Continuous Attractor Networks with Monotonic Tuning Using a Symmetry Principle , 2008, Neural Computation.

[20]  C. Koch,et al.  Methods in Neuronal Modeling: From Ions to Networks , 1998 .

[21]  J. Taube Head direction cells and the neurophysiological basis for a sense of direction , 1998, Progress in Neurobiology.

[22]  D C Van Essen,et al.  Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. , 1983, Journal of neurophysiology.

[23]  D.I. Standage,et al.  A continuous attractor neural network model of divided visual attention , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[24]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[25]  Si Wu,et al.  Population Coding and Decoding in a Neural Field: A Computational Study , 2002, Neural Computation.

[26]  Si Wu,et al.  Dynamical Synapses Enhance Neural Information Processing: Gracefulness, Accuracy, and Mobility , 2011, Neural Computation.

[27]  Si Wu,et al.  Computing with Continuous Attractors: Stability and Online Aspects , 2005, Neural Computation.

[28]  Si Wu,et al.  Computational neuroscience in China , 2010, Science China Life Sciences.

[29]  Wolfram Erlhagen,et al.  Internal models for visual perception , 2003, Biological Cybernetics.

[30]  D. Heeger Modeling simple-cell direction selectivity with normalized, half-squared, linear operators. , 1993, Journal of neurophysiology.

[31]  Si Wu,et al.  Dynamics of neural networks with continuous attractors , 2008 .

[32]  Xiao-Jing Wang,et al.  A Model of Visuospatial Working Memory in Prefrontal Cortex: Recurrent Network and Cellular Bistability , 1998, Journal of Computational Neuroscience.

[33]  Si Wu,et al.  Dynamics and Computation of Continuous Attractors , 2008, Neural Computation.

[34]  E. Villaseñor Introduction to Quantum Mechanics , 2008, Nature.

[35]  Stephen Grossberg,et al.  Nonlinear neural networks: Principles, mechanisms, and architectures , 1988, Neural Networks.

[36]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[37]  J. Cowan,et al.  Excitatory and inhibitory interactions in localized populations of model neurons. , 1972, Biophysical journal.

[38]  Leandro Nunes de Castro,et al.  Recent Developments In Biologically Inspired Computing , 2004 .

[39]  Xiao-Jing Wang Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[40]  Paul C. Bressloff,et al.  Breathing Pulses in an Excitatory Neural Network , 2004, SIAM J. Appl. Dyn. Syst..

[41]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[42]  Michael J. Berry,et al.  Anticipation of moving stimuli by the retina , 1999, Nature.

[43]  J J Hopfield,et al.  Neurons with graded response have collective computational properties like those of two-state neurons. , 1984, Proceedings of the National Academy of Sciences of the United States of America.

[44]  A P Georgopoulos,et al.  On the relations between the direction of two-dimensional arm movements and cell discharge in primate motor cortex , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[45]  Bernhard Schölkopf,et al.  Classification of Faces in Man and Machine , 2006, Neural Computation.

[46]  Thomas Wennekers,et al.  Dynamic Approximation of Spatiotemporal Receptive Fields in Nonlinear Neural Field Models , 2002, Neural Computation.

[47]  Richard H R Hahnloser,et al.  Double-ring network model of the head-direction system. , 2002, Physical review. E, Statistical, nonlinear, and soft matter physics.

[48]  Xiao-Jing Wang,et al.  Robust Spatial Working Memory through Homeostatic Synaptic Scaling in Heterogeneous Cortical Networks , 2003, Neuron.

[49]  David Pinto,et al.  Mathematical neuroscience: from neurons to circuits to systems , 2003, Journal of Physiology-Paris.

[50]  Stephen Coombes,et al.  Existence and Wandering of Bumps in a Spiking Neural Network Model , 2006, SIAM J. Appl. Dyn. Syst..

[51]  M. Giese,et al.  Learning to discriminate complex movements: biological versus artificial trajectories. , 2006, Journal of vision.

[52]  Y Dan,et al.  Motion-Induced Perceptual Extrapolation of Blurred Visual Targets , 2001, The Journal of Neuroscience.