A unified theory for the origin of grid cells through the lens of pattern formation

Grid cells in the brain fire in strikingly regular hexagonal patterns across space. There are currently two seemingly unrelated frameworks for understanding these patterns. Mechanistic models account for hexagonal firing fields as the result of pattern-forming dynamics in a recurrent neural network with hand-tuned center-surround connectivity. Normative models specify a neural architecture, a learning rule, and a navigational task, and observe that grid-like firing fields emerge due to the constraints of solving this task. Here we provide an analytic theory that unifies the two perspectives by casting the learning dynamics of neural networks trained on navigational tasks as a pattern forming dynamical system. This theory provides insight into the optimal solutions of diverse formulations of the normative task, and shows that symmetries in the representation of space correctly predict the structure of learned firing fields in trained neural networks. Further, our theory proves that a nonnegativity constraint on firing rates induces a symmetry-breaking mechanism which favors hexagonal firing fields. We extend this theory to the case of learning multiple grid maps and demonstrate that optimal solutions consist of a hierarchy of maps with increasing length scales. These results unify previous accounts of grid cell firing and provide a novel framework for predicting the learned representations of recurrent neural networks.

[1]  Caswell Barry,et al.  Grid cell symmetry is shaped by environmental geometry , 2015, Nature.

[2]  M. Stemmler,et al.  Probable nature of higher-dimensional symmetries underlying mammalian grid-cell activity patterns , 2014, eLife.

[3]  Larry R Squire,et al.  Medial entorhinal cortex lesions only partially disrupt hippocampal place cells and hippocampus-dependent place memory. , 2014, Cell reports.

[4]  Surya Ganguli,et al.  Environmental Boundaries as an Error Correction Mechanism for Grid Cells , 2015, Neuron.

[5]  Ron Meir,et al.  Extracting grid cell characteristics from place cell inputs using non-negative principal component analysis , 2016, eLife.

[6]  Timothy Edward John Behrens,et al.  Generalisation of structural knowledge in the Hippocampal-Entorhinal system , 2018, NeurIPS.

[7]  Razvan Pascanu,et al.  Vector-based navigation using grid-like representations in artificial agents , 2018, Nature.

[8]  M. Botvinick,et al.  The hippocampus as a predictive map , 2016 .

[9]  Surya Ganguli,et al.  Principles governing the integration of landmark and self-motion cues in entorhinal cortical codes for navigation , 2018, Nature Neuroscience.

[10]  Kate Jeffery,et al.  Grid Cells Encode Local Positional Information , 2017, Current Biology.

[11]  Surya Ganguli,et al.  A Multiplexed, Heterogeneous, and Adaptive Code for Navigation in Medial Entorhinal Cortex , 2017, Neuron.

[12]  Timothy E. J. Behrens,et al.  Organizing conceptual knowledge in humans with a gridlike code , 2016, Science.

[13]  K. Zhang,et al.  Representation of spatial orientation by the intrinsic dynamics of the head-direction cell ensemble: a theory , 1996, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[14]  M. Cross,et al.  Pattern formation outside of equilibrium , 1993 .

[15]  Uğur M Erdem,et al.  A goal‐directed spatial navigation model using forward trajectory planning based on grid cells , 2012, The European journal of neuroscience.

[16]  Xue-Xin Wei,et al.  Emergence of grid-like representations by training recurrent neural networks to perform spatial localization , 2018, ICLR.

[17]  Surya Ganguli,et al.  Emergent elasticity in the neural code for space , 2018, Proceedings of the National Academy of Sciences.

[18]  Surya Ganguli,et al.  A mathematical theory of semantic development in deep neural networks , 2018, Proceedings of the National Academy of Sciences.

[19]  Lisa M. Giocomo,et al.  Remembered reward locations restructure entorhinal spatial maps , 2019, Science.

[20]  M. Fyhn,et al.  Progressive increase in grid scale from dorsal to ventral medial entorhinal cortex , 2008, Hippocampus.

[21]  Dmitriy Aronov,et al.  Mapping of a non-spatial dimension by the hippocampal/entorhinal circuit , 2017, Nature.

[22]  J. Prentice,et al.  A principle of economy predicts the functional architecture of grid cells , 2013, eLife.

[23]  B. McNaughton,et al.  The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats , 1983, Experimental Brain Research.

[24]  Yoram Burakyy,et al.  Accurate Path Integration in Continuous Attractor Network Models of Grid Cells , 2009 .

[25]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[26]  Mark C. Fuhs,et al.  A Spin Glass Model of Path Integration in Rat Medial Entorhinal Cortex , 2006, The Journal of Neuroscience.