Actionable Neural Representations: Grid Cells from Minimal Constraints

To afford flexible behaviour, the brain must build internal representations that mirror the structure of variables in the external world. For example, 2D space obeys rules: the same set of actions combine in the same way everywhere (step north, then south, and you won’t have moved, wherever you start). We suggest the brain must represent this consistent meaning of actions across space, as it allows you to find new short-cuts and navigate in unfamiliar settings. We term this representation an ‘actionable representation’. We formulate actionable representations using group and representation theory, and show that, when combined with biological and functional constraints non-negative firing, bounded neural activity, and precise coding multiple modules of hexagonal grid cells are the optimal representation of 2D space. We support this claim with intuition, analytic justification, and simulations. Our analytic results normatively explain a set of surprising grid cell phenomena, and make testable predictions for future experiments. Lastly, we highlight the generality of our approach beyond just understanding 2D space. Our work characterises a new principle for understanding and designing flexible internal representations: they should be actionable, allowing animals and machines to predict the consequences of their actions, rather than just encode.

[1]  James C. R. Whittington,et al.  Disentangling with Biological Constraints: A Theory of Functional Cell Types , 2022, 2210.01768.

[2]  I. Fiete,et al.  No Free Lunch from Deep Learning in Neuroscience: A Case Study through Models of the Entorhinal-Hippocampal Circuit , 2023, bioRxiv.

[3]  James C. R. Whittington,et al.  Relating transformers to models and neural representations of the hippocampal formation , 2021, ICLR.

[4]  H. Sompolinsky,et al.  Locally ordered representation of 3D space in the entorhinal cortex , 2021, Nature.

[5]  Roddy M. Grieves,et al.  Irregular distribution of grid cell firing fields in rats exploring a 3D volumetric space , 2021, Nature Neuroscience.

[6]  Joan Bruna,et al.  Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges , 2021, ArXiv.

[7]  Richard J. Gardner,et al.  Toroidal topology of population activity in grid cells , 2021, Nature.

[8]  Neil Burgess,et al.  Prediction and generalisation over directed actions by grid cells , 2021, ICLR.

[9]  Chen Sun,et al.  Hippocampal neurons represent events as transferable units of experience , 2020, Nature Neuroscience.

[10]  Caswell Barry,et al.  The Tolman-Eichenbaum Machine: Unifying Space and Relational Memory through Generalization in the Hippocampal Formation , 2019, Cell.

[11]  Dmitri B. Chklovskii,et al.  Neuroscience-Inspired Online Unsupervised Learning Algorithms: Artificial neural networks , 2019, IEEE Signal Processing Magazine.

[12]  Surya Ganguli,et al.  A unified theory for the origin of grid cells through the lens of pattern formation , 2019, NeurIPS.

[13]  Anirvan M. Sengupta,et al.  Manifold-tiling Localized Receptive Fields are Optimal in Similarity-preserving Neural Networks , 2018, bioRxiv.

[14]  Surya Ganguli,et al.  Emergent elasticity in the neural code for space , 2018, Proceedings of the National Academy of Sciences.

[15]  Razvan Pascanu,et al.  Vector-based navigation using grid-like representations in artificial agents , 2018, Nature.

[16]  Øyvind Arne Høydal,et al.  Object-vector coding in the medial entorhinal cortex , 2019, Nature.

[17]  Xue-Xin Wei,et al.  Emergence of grid-like representations by training recurrent neural networks to perform spatial localization , 2018, ICLR.

[18]  Kimberly L. Stachenfeld,et al.  The hippocampus as a predictive map , 2017, Nature Neuroscience.

[19]  V. Jayaraman,et al.  Ring attractor dynamics in the Drosophila central brain , 2017, Science.

[20]  Surya Ganguli,et al.  A Multiplexed, Heterogeneous, and Adaptive Code for Navigation in Medial Entorhinal Cortex , 2017, Neuron.

[21]  Yasser Roudi,et al.  Grid cells show field-to-field variability and this explains the aperiodic response of inhibitory interneurons , 2017, bioRxiv.

[22]  Ron Meir,et al.  Extracting grid cell characteristics from place cell inputs using non-negative principal component analysis , 2016, eLife.

[23]  Alexander Mathis,et al.  Connecting multiple spatial scales to decode the population activity of grid cells , 2015, Science Advances.

[24]  Jason S. Prentice,et al.  A principle of economy predicts the functional architecture of grid cells , 2013, eLife.

[25]  Edvard I. Moser,et al.  Shearing-induced asymmetry in entorhinal grid cells , 2015, Nature.

[26]  Caswell Barry,et al.  Grid cell symmetry is shaped by environmental geometry , 2015, Nature.

[27]  Jakob N. Foerster,et al.  Three-dimensional head-direction coding in the bat brain , 2014, Nature.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  May-Britt Moser,et al.  The entorhinal grid map is discretized , 2012, Nature.

[31]  H. B. Barlow,et al.  Possible Principles Underlying the Transformations of Sensory Messages , 2012 .

[32]  Martin Stemmler,et al.  Optimal Population Codes for Space: Grid Cells Outperform Place Cells , 2012, Neural Computation.

[33]  Alexander Mathis,et al.  Resolution of nested neuronal representations can be exponential in the number of neurons. , 2012, Physical review letters.

[34]  Kechen Zhang,et al.  Universal conditions for exact path integration in neural systems , 2012, Proceedings of the National Academy of Sciences.

[35]  Ila Fiete,et al.  Grid cells generate an analog error-correcting code for singularly precise neural computation , 2011, Nature Neuroscience.

[36]  Aapo Hyvärinen,et al.  Statistical Models of Natural Images and Cortical Visual Representation , 2010, Top. Cogn. Sci..

[37]  Yoram Burakyy,et al.  Accurate Path Integration in Continuous Attractor Network Models of Grid Cells , 2009 .

[38]  S. Laughlin,et al.  Fly Photoreceptors Demonstrate Energy-Information Trade-Offs in Neural Coding , 2007, PLoS biology.

[39]  B. Dumitrescu Positive Trigonometric Polynomials and Signal Processing Applications , 2007 .

[40]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[41]  Aapo Hyvärinen,et al.  Topographic Independent Component Analysis , 2001, Neural Computation.

[42]  Geoffrey E. Hinton,et al.  Learning Hierarchical Structures with Linear Relational Embedding , 2001, NIPS.

[43]  David J. Field,et al.  Emergence of simple-cell receptive field properties by learning a sparse code for natural images , 1996, Nature.

[44]  N. Logothetis,et al.  Shape representation in the inferior temporal cortex of monkeys , 1995, Current Biology.

[45]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[46]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.