Nonequilibrium Statistical Mechanics of Continuous Attractors

Continuous attractors have been used to understand recent neuroscience experiments where persistent activity patterns encode internal representations of external attributes like head direction or spatial location. However, the conditions under which the emergent bump of neural activity in such networks can be manipulated by space and time-dependent external sensory or motor signals are not understood. Here, we find fundamental limits on how rapidly internal representations encoded along continuous attractors can be updated by an external signal. We apply these results to place cell networks to derive a velocity-dependent nonequilibrium memory capacity in neural networks.

[1]  Eduardo D. Sontag,et al.  Adaptation and regulation with signal detection implies internal model , 2003, Syst. Control. Lett..

[2]  Si Wu,et al.  Fluctuation-response relation unifies dynamical behaviors in neural fields. , 2014, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  H S Seung,et al.  How the brain keeps the eyes still. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Surya Ganguli,et al.  A Multiplexed, Heterogeneous, and Adaptive Code for Navigation in Medial Entorhinal Cortex , 2017, Neuron.

[5]  Peter E. Latham,et al.  Optimal computation with attractor networks , 2003, Journal of Physiology-Paris.

[6]  V. Jayaraman,et al.  Ring attractor dynamics in the Drosophila central brain , 2017, Science.

[7]  Bruce L. McNaughton,et al.  Path integration and the neural basis of the 'cognitive map' , 2006, Nature Reviews Neuroscience.

[8]  William Bialek,et al.  Collective Behavior of Place and Non-place Neurons in the Hippocampal Network , 2016, Neuron.

[9]  Yasser Roudi,et al.  Network mechanisms of grid cells , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[10]  Chenglin Miao,et al.  Place cells in the hippocampus: Eleven maps for eleven rooms , 2014, Proceedings of the National Academy of Sciences.

[11]  Yoram Burakyy,et al.  Accurate Path Integration in Continuous Attractor Network Models of Grid Cells , 2009 .

[12]  R. Monasson,et al.  Crosstalk and transitions between multiple spatial maps in an attractor neural network model of the hippocampus: collective motion of the activity. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[13]  Surya Ganguli,et al.  Principles governing the integration of landmark and self-motion cues in entorhinal cortical codes for navigation , 2018, Nature Neuroscience.

[14]  Si Wu,et al.  Dynamics and Computation of Continuous Attractors , 2008, Neural Computation.

[15]  Alessandro Treves,et al.  Attractor neural networks storing multiple space representations: A model for hippocampal place fields , 1998, cond-mat/9807101.

[16]  Johannes D. Seelig,et al.  Angular velocity integration in a fly heading circuit , 2017, eLife.

[17]  Neil Burgess,et al.  How environment and self‐motion combine in neural representations of space , 2016, The Journal of physiology.

[18]  Brent Doiron,et al.  Optimizing Working Memory with Heterogeneity of Recurrent Cortical Excitation , 2013, The Journal of Neuroscience.

[19]  Uğur M Erdem,et al.  A goal‐directed spatial navigation model using forward trajectory planning based on grid cells , 2012, The European journal of neuroscience.

[20]  B. McNaughton,et al.  Spatial representation in the hippocampal formation: a history , 2017, Nature Neuroscience.

[21]  John J. Hopfield,et al.  Rapid, parallel path planning by propagating wavefronts of spiking neural activity , 2012, Front. Comput. Neurosci..

[22]  John J Hopfield,et al.  Neurodynamics of mental exploration , 2009, Proceedings of the National Academy of Sciences.

[23]  A. Compte,et al.  Bump attractor dynamics in prefrontal cortex explains behavioral precision in spatial working memory , 2014, Nature Neuroscience.

[24]  John J. Hopfield,et al.  Neural networks and physical systems with emergent collective computational abilities , 1999 .

[25]  Si Wu,et al.  Computing with Continuous Attractors: Stability and Online Aspects , 2005, Neural Computation.

[26]  Surya Ganguli,et al.  Emergent elasticity in the neural code for space , 2018, Proceedings of the National Academy of Sciences.

[27]  S. Amari.  Dynamics of pattern formation in lateral-inhibition type neural fields , 1977, Biological Cybernetics.

[28]  Si Wu,et al.  Spike Frequency Adaptation Implements Anticipative Tracking in Continuous Attractor Neural Networks , 2014, NIPS.

[29]  Brad E. Pfeiffer,et al.  Hippocampal place cell sequences depict future paths to remembered goals , 2013, Nature.

[30]  Dmitriy Aronov,et al.  Mapping of a non-spatial dimension by the hippocampal/entorhinal circuit , 2017, Nature.

[31]  Sompolinsky,et al.  Storing infinite numbers of patterns in a spin-glass model of neural networks. , 1985, Physical review letters.

[32]  R. Monasson,et al.  Transitions between Spatial Attractors in Place-Cell Models. , 2015, Physical review letters.

[33]  Bruce L McNaughton,et al.  Attractor-map versus autoassociation based attractor dynamics in the hippocampal network. , 2010, Journal of neurophysiology.

[34]  R. Monasson,et al.  Crosstalk and transitions between multiple spatial maps in an attractor neural network model of the hippocampus: phase diagram. , 2013, Physical review. E, Statistical, nonlinear, and soft matter physics.

[35]  Anders Krogh,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[36]  H Sebastian Seung,et al.  Plasticity and tuning by visual feedback of the stability of a neural integrator. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Daniel D. Lee,et al.  Stability of the Memory of Eye Position in a Recurrent Network of Conductance-Based Model Neurons , 2000, Neuron.

[38]  M Tsodyks,et al.  Attractor neural network models of spatial maps in hippocampus , 1999, Hippocampus.

[39]  Sompolinsky,et al.  Spin-glass models of neural networks. , 1985, Physical review. A, General physics.

[40]  E. Save,et al.  Attractors in Memory , 2005, Science.

[41]  John J. Hopfield,et al.  Understanding Emergent Dynamics: Using a Collective Activity Coordinate of a Neural Network to Recognize Time-Varying Patterns , 2015, Neural Computation.

[42]  Rishidev Chaudhuri,et al.  Computational principles of memory , 2016, Nature Neuroscience.

[43]  H. Seung,et al.  Plasticity and tuning of the time course of analog persistent firing in a neural integrator. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[44]  Yoram Burak,et al.  Fundamental limits on persistent activity in networks of noisy neurons , 2012, Proceedings of the National Academy of Sciences.

[45]  Johannes D. Seelig,et al.  Neural dynamics for landmark orientation and angular path integration , 2015, Nature.

[46]  Peter E. Latham,et al.  A Balanced Memory Network , 2007, PLoS Comput. Biol..

[47]  Neil Burgess,et al.  Attractor Dynamics in the Hippocampal Representation of the Local Environment , 2005, Science.

[48]  H. Sebastian Seung,et al.  Continuous attractors and oculomotor control , 1998, Neural Networks.

[49]  Sukbin Lim,et al.  Noise Tolerance of Attractor and Feedforward Memory Models , 2012, Neural Computation.

[50]  A. Treves,et al.  Hippocampal remapping and grid realignment in entorhinal cortex , 2007, Nature.

[51]  Surya Ganguli,et al.  Environmental Boundaries as an Error Correction Mechanism for Grid Cells , 2015, Neuron.

[52]  C. Barry,et al.  Specific evidence of low-dimensional continuous attractor dynamics in grid cells , 2013, Nature Neuroscience.

[53]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[54]  R. Muller,et al.  Multiple representations in the hippocampus , 1991, Hippocampus.