Generalisation of structural knowledge in the Hippocampal-Entorhinal system

A central problem to understanding intelligence is the concept of generalisation. This allows previously learnt structure to be exploited to solve tasks in novel situations differing in their particularities. We take inspiration from neuroscience, specifically the hippocampal-entorhinal system known to be important for generalisation. We propose that to generalise structural knowledge, the representations of the structure of the world, i.e. how entities in the world relate to each other, need to be separated from representations of the entities themselves. We show, under these principles, artificial neural networks embedded with hierarchy and fast Hebbian memory, can learn the statistics of memories and generalise structural knowledge. Spatial neuronal representations mirroring those found in the brain emerge, suggesting spatial cognition is an instance of more general organising principles. We further unify many entorhinal cell types as basis functions for constructing transition graphs, and show these representations effectively utilise memories. We experimentally support model assumptions, showing a preserved relationship between entorhinal grid and hippocampal place cells across environments.

[1]  Ron Meir,et al.  Extracting grid cell characteristics from place cell inputs using non-negative principal component analysis , 2016, eLife.

[2]  Li Lu,et al.  Integrating time from experience in the lateral entorhinal cortex , 2018, Nature.

[3]  H. Eichenbaum,et al.  The hippocampus and memory for orderly stimulus relations. , 1997, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Fabio Viola,et al.  Generative Temporal Models with Spatial Memory for Partially Observed Environments , 2018, ICML.

[5]  E. Bostock,et al.  Experience‐dependent modifications of hippocampal place cell firing , 1991, Hippocampus.

[6]  D. Amaral,et al.  Entorhinal Cortex Lesions Disrupt the Relational Organization of Memory in Monkeys , 2004, The Journal of Neuroscience.

[7]  D. Hassabis,et al.  Patients with hippocampal amnesia cannot imagine new experiences , 2007, Proceedings of the National Academy of Sciences.

[8]  Alexander Mathis,et al.  Connecting multiple spatial scales to decode the population activity of grid cells , 2015, Science Advances.

[9]  Timothy E. J. Behrens,et al.  Organizing conceptual knowledge in humans with a gridlike code , 2016, Science.

[10]  Daan Wierstra,et al.  Stochastic Backpropagation and Approximate Inference in Deep Generative Models , 2014, ICML.

[11]  Rafal Bogacz,et al.  An Approximation of the Error Backpropagation Algorithm in a Predictive Coding Network with Local Hebbian Synaptic Plasticity , 2017, Neural Computation.

[12]  Shane Legg,et al.  Human-level control through deep reinforcement learning , 2015, Nature.

[13]  Xue-Xin Wei,et al.  Emergence of grid-like representations by training recurrent neural networks to perform spatial localization , 2018, ICLR.

[14]  J. O’Keefe,et al.  Grid cell firing patterns signal environmental novelty by expansion , 2012, Proceedings of the National Academy of Sciences.

[15]  H. Eichenbaum,et al.  The global record of memory in hippocampal neuronal activity , 1999, Nature.

[16]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[17]  T. Hafting,et al.  Finite Scale of Spatial Representation in the Hippocampus , 2008, Science.

[18]  David Amos,et al.  Generative Temporal Models with Memory , 2017, ArXiv.

[19]  L F Abbott,et al.  Modular Realignment of Entorhinal Grid Cell Activity as a Basis for Hippocampal Remapping , 2011, The Journal of Neuroscience.

[20]  J. O’Keefe,et al.  Neural Representations of Location Composed of Spatially Periodic Bands , 2012, Science.

[21]  Geoffrey E. Hinton,et al.  Using Fast Weights to Attend to the Recent Past , 2016, NIPS.

[22]  Neil Burgess,et al.  Using Grid Cells for Navigation , 2015, Neuron.

[23]  M. Moser,et al.  Representation of Geometric Borders in the Entorhinal Cortex , 2008, Science.

[24]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[25]  D. Hassabis,et al.  Tracking the Emergence of Conceptual Knowledge during Human Decision Making , 2009, Neuron.

[26]  H. Eichenbaum,et al.  Robust Conjunctive Item–Place Coding by Hippocampal Neurons Parallels Learning What Happens Where , 2009, The Journal of Neuroscience.

[27]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[28]  R U Muller,et al.  Head-direction cells recorded from the postsubiculum in freely moving rats. I. Description and quantitative analysis , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[29]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[30]  James L. McClelland,et al.  Why there are complementary learning systems in the hippocampus and neocortex: insights from the successes and failures of connectionist models of learning and memory. , 1995, Psychological review.

[31]  Sachin S. Deshmukh,et al.  Influence of local objects on hippocampal representations: Landmark vectors and memory , 2013, Hippocampus.

[32]  Dmitriy Aronov,et al.  Mapping of a non-spatial dimension by the hippocampal/entorhinal circuit , 2017, Nature.

[33]  B. McNaughton,et al.  Independent Codes for Spatial and Episodic Memory in Hippocampal Neuronal Ensembles , 2005, Science.

[34]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[35]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[36]  Kimberly L. Stachenfeld,et al.  The hippocampus as a predictive map , 2017, Nature Neuroscience.

[37]  A. Treves,et al.  Hippocampal remapping and grid realignment in entorhinal cortex , 2007, Nature.

[38]  May-Britt Moser,et al.  The entorhinal grid map is discretized , 2012, Nature.

[39]  D. Hassabis,et al.  Neuroscience-Inspired Artificial Intelligence , 2017, Neuron.

[40]  Razvan Pascanu,et al.  Vector-based navigation using grid-like representations in artificial agents , 2018, Nature.

[41]  M. Botvinick,et al.  The hippocampus as a predictive map , 2016 .