Dynamic shift mechanism of continuous attractors in a class of recurrent neural networks

Continuous attractors of recurrent neural networks (RNNs) have attracted extensive interests in recent years. It is often used to describe the encoding of continuous stimuli such as orientation, moving direction and spatial location of objects. This paper studies the dynamic shift mechanism of a class of continuous attractor neural networks. It shows that if the external input is a gaussian shape with its center varying along with time, by adding a slight shift to the weights, the symmetry of gaussian weight function is destroyed. Then, the activity profile will shift continuously without changing its shape, and the shift speed can be controlled accurately by a given constant. Simulations are employed to illustrate the theory.

[1]  H. Sebastian Seung,et al.  Learning Continuous Attractors in Recurrent Networks , 1997, NIPS.

[2]  C. Gilbert,et al.  Spatial integration and cortical dynamics. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[3]  T. Sejnowski,et al.  Neurocomputational models of working memory , 2000, Nature Neuroscience.

[4]  Terrence J. Sejnowski,et al.  ASSOCIATIVE MEMORY AND HIPPOCAMPAL PLACE CELLS , 1995 .

[5]  H. Sompolinsky,et al.  Theory of orientation tuning in visual cortex. , 1995, Proceedings of the National Academy of Sciences of the United States of America.

[6]  Haim Sompolinsky,et al.  Traveling Waves and the Processing of Weakly Tuned Inputs in a Cortical Network Module , 2004, Journal of Computational Neuroscience.

[7]  Emilio Salinas,et al.  Background Synaptic Activity as a Switch Between Dynamical States in a Network , 2003, Neural Computation.

[8]  Xiao-Jing Wang.  Synaptic reverberation underlying mnemonic persistent activity , 2001, Trends in Neurosciences.

[9]  Thomas P. Trappenberg,et al.  Why is our capacity of working memory so large , 2003 .

[10]  Si Wu,et al.  The Tracking Speed of Continuous Attractors , 2007, ISNN.

[11]  Zhang Yi,et al.  Continuous attractors of a class of recurrent neural networks without lateral inhibition , 2008, 2008 IEEE Conference on Cybernetics and Intelligent Systems.

[12]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[13]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[14]  H. Sebastian Seung,et al.  Continuous attractors and oculomotor control , 1998, Neural Networks.

[15]  Xiao-Jing Wang,et al.  Cannabinoid-mediated disinhibition and working memory: dynamical interplay of multiple feedback mechanisms in a continuous attractor model of prefrontal cortex. , 2007, Cerebral cortex.

[16]  Thomas P. Trappenberg,et al.  Self-organising continuous attractor networks with multiple activity packets, and the representation of space , 2004, Neural Networks.

[17]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[18]  Si Wu,et al.  Computing with Continuous Attractors: Stability and Online Aspects , 2005, Neural Computation.