Exploratory Behaviour Depends on Multisensory Integration during Spatial Learning

Active exploration is a necessary component of a putative spatial representation system in the mammalian brain. We address the problem of how spatial exploratory behaviour is generated in rodents by combining an artificial neural network model of place coding with a multiobjective evolutionary algorithm that tunes the model parameters so as to maximise the efficiency of environment exploration. A central property of the spatial representation model is an online calibration between external visual cues and path integration, a widely accepted concept in theoretical accounts of spatial learning in animals. We find that the artificially evolved exploration model leads to recurrent patterns of exploratory behaviour in a way observed in experimental studies of spatial exploration in rodents. Our results provide a link between the functional organisation of the biological spatial learning network and the observed high-level patterns of exploratory behaviour.

[1]  M. Wilson,et al.  NMDA receptors, place cells and hippocampal spatial memory , 2004, Nature Reviews Neuroscience.

[2]  Angelo Arleo,et al.  Multimodal sensory integration and concurrent navigation strategies for spatial cognition in real and artificial organisms. , 2007, Journal of integrative neuroscience.

[3]  Angelo Arleo,et al.  Contribution of Cerebellar Sensorimotor Adaptation to Hippocampal Spatial Memory , 2012, PloS one.

[4]  Angelo Arleo,et al.  Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity , 2000, Biological Cybernetics.

[5]  M. Halliday.  Effect of Previous Exploratory Activity on the Exploration of a Simple Maze , 1966, Nature.

[6]  B L McNaughton,et al.  Path Integration and Cognitive Mapping in a Continuous Attractor Neural Network Model , 1997, The Journal of Neuroscience.

[7]  Bruce L. McNaughton,et al.  Path integration and the neural basis of the 'cognitive map' , 2006, Nature Reviews Neuroscience.

[8]  Arne D. Ekstrom,et al.  Cellular networks underlying human spatial navigation , 2003, Nature.

[9]  K M Gothard,et al.  Dynamics of Mismatch Correction in the Hippocampal Ensemble Code for Space: Interaction between Path Integration and Environmental Cues , 1996, The Journal of Neuroscience.

[10]  K. Montgomery,et al.  The relation between fear and exploratory behavior. , 1955, Journal of comparative and physiological psychology.

[11]  E. Save,et al.  Cerebellum Shapes Hippocampal Spatial Code , 2011, Science.

[12]  Angelo Arleo,et al.  Place Cells and Spatial Navigation Based on 2D Visual Feature Extraction, Path Integration, and Reinforcement Learning , 2000, NIPS.

[13]  Hugh F. Durrant-Whyte,et al.  Simultaneous localization and mapping: part I , 2006, IEEE Robotics & Automation Magazine.

[14]  Yoav Benjamini,et al.  Freedom of movement and the stability of its unfolding in free exploration of mice , 2009, Proceedings of the National Academy of Sciences.

[15]  R. Passingham.  The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[16]  Hugh Durrant-Whyte,et al.  Simultaneous Localisation and Mapping ( SLAM ) : Part I The Essential Algorithms , 2006 .

[17]  Daniel L. Schacter,et al.  Spatial Representation in the Entorhinal Cortex , 2004 .

[18]  H. Mittelstaedt,et al.  Homing by path integration in a mammal , 1980, Naturwissenschaften.

[19]  Goldberg,et al.  Genetic algorithms , 1993, Robust Control Systems with Genetic Algorithms.

[20]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.

[21]  G. Einevoll,et al.  From grid cells to place cells: A mathematical model , 2006, Hippocampus.

[22]  Michael E. Hasselmo,et al.  Neuromodulation, theta rhythm and rat spatial navigation , 2002, Neural Networks.

[23]  W E Skaggs,et al.  Deciphering the hippocampal polyglot: the hippocampus as a path integration system. , 1996, The Journal of experimental biology.

[24]  Angelo Arleo,et al.  Spatial Learning and Action Planning in a Prefrontal Cortical Network Model , 2011, PLoS Comput. Biol..

[25]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[26]  Angelo Arleo,et al.  Cognitive navigation based on nonuniform Gabor space sampling, unsupervised growing networks, and reinforcement learning , 2004, IEEE Transactions on Neural Networks.

[27]  Anat Sakov,et al.  Genotype-environment interactions in mouse behavior: a way out of the problem. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[28]  Yoav Benjamini,et al.  Rats and mice share common ethologically relevant parameters of exploratory behavior , 2001, Behavioural Brain Research.

[29]  David E. Goldberg,et al.  A niched Pareto genetic algorithm for multiobjective optimization , 1994, Proceedings of the First IEEE Conference on Evolutionary Computation. IEEE World Congress on Computational Intelligence.

[30]  B L McNaughton,et al.  Dynamics of the hippocampal ensemble code for space. , 1993, Science.

[31]  Ofer Tchernichovski,et al.  The dynamics of long-term exploration in the rat , 1998, Biological Cybernetics.

[32]  Torkel Hafting,et al.  Conjunctive Representation of Position, Direction, and Velocity in Entorhinal Cortex , 2006, Science.

[33]  R. Palmer,et al.  Introduction to the theory of neural computation , 1994, The advanced book program.

[34]  T. Hafting,et al.  Microstructure of a spatial map in the entorhinal cortex , 2005, Nature.

[35]  Ricardo Chavarriaga,et al.  A Computational Model of Parallel Navigation Systems in Rodents , 2005 .

[36]  W. Gerstner,et al.  Is there a geometric module for spatial orientation? Insights from a rodent navigation model. , 2009, Psychological review.

[37]  Stéphane Doncieux,et al.  Sferesv2: Evolvin' in the multi-core world , 2010, IEEE Congress on Evolutionary Computation.

[38]  T. J. Roper,et al.  Non-random dispersal in the butterfly Maniola jurtina: implications for metapopulation models , 2000, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[39]  D. Eilam,et al.  Home base behavior of rats (Rattus norvegicus) exploring a novel environment , 1989, Behavioural Brain Research.

[40]  Y. Benjamini,et al.  Quantifying the buildup in extent and complexity of free exploration in mice , 2011, Proceedings of the National Academy of Sciences.

[41]  Hugh F. Durrant-Whyte,et al.  Simultaneous map building and localization for an autonomous mobile robot , 1991, Proceedings IROS '91:IEEE/RSJ International Workshop on Intelligent Robots and Systems '91.