Analyzing Interactions between Cue-Guided and Place-Based Navigation with a Computational Model of Action Selection: Influence of Sensory Cues and Training

The hypothesis of multiple memory systems involved in different learning of navigation strategies has gained strong arguments through biological experiments. However, it remains difficult for experimentalists to understand how these systems interact. We propose a new computational model of selection between parallel systems involving cue-guided and place-based navigation strategies that allows analyses of selection switches between both control systems, while providing information that is not directly accessible in experiments with animals. Contrary to existing models of navigation, its module of selection is adaptive and uses a criterion which allows the comparison of strategies having different learning processes. Moreover, the spatial representation used by the place-based strategy is based on a recent hippocampus model. We illustrate the ability of this navigation model to analyze animal behavior in experiments in which the availability of sensory cues, together with the amount of training, influence the competitive or cooperative nature of their interactions.

[1]  Y Burnod,et al.  Organizational levels of the cerebral cortex: An integrated model , 1991, Acta biotheoretica.

[2]  John M. Pearce,et al.  Hippocampal lesions disrupt navigation based on cognitive maps but not heading vectors , 1998, Nature.

[3]  Jean-Arcady Meyer,et al.  Integration of Navigation and Action Selection Functionalities in a Computational Model of Cortico-Basal-Ganglia–Thalamo-Cortical Loops , 2005, Adapt. Behav..

[4]  Wilfried Brauer,et al.  Spatial Cognition III , 2003, Lecture Notes in Computer Science.

[5]  John M. Pearson,et al.  A Physiologically-Inspired Model of Numerical Classification Based on Graded Stimulus Coding , 2009, Front. Behav. Neurosci..

[6]  Erin L. Rich,et al.  Rat Prefrontal Cortical Neurons Selectively Code Strategy Switches , 2009, The Journal of Neuroscience.

[7]  C. Paul,et al.  Spatial memory: Theoretical basis and comparative review on experimental methods in rodents , 2009, Behavioural Brain Research.

[8]  R. J. McDonald,et al.  Multiple Parallel Memory Systems in the Brain of the Rat , 2002, Neurobiology of Learning and Memory.

[9]  Aaron P Blaisdell,et al.  Associative Basis of Landmark Learning and Integration in Vertebrates. , 2009, Comparative cognition & behavior reviews.

[10]  Angelo Arleo,et al.  Map-Based Spatial Navigation: A Cortical Column Model for Action Planning , 2008, Spatial Cognition.

[11]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[12]  P. Gisquet-Verrier,et al.  Behavioral Neuroscience , 2005 .

[13]  N. Mons,et al.  Dynamic interplays between memory systems depend on practice: The hippocampus is not always the first to provide solution , 2007, Neuroscience.

[14]  P. E. Gold,et al.  Switching Memory Systems during Learning: Changes in Patterns of Brain Acetylcholine Release in the Hippocampus and Striatum in Rats , 2003, The Journal of Neuroscience.

[15]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[16]  E. Uchibe,et al.  Reinforcement Learning with Multiple Heterogeneous Modules: A Framework for Developmental Robot Learning , 2005, Proceedings. The 4nd International Conference on Development and Learning, 2005..

[17]  Tamás Kiss,et al.  Episodes in Space: A Modeling Study of Hippocampal Place Representation , 2008, SAB.

[18]  Ricardo Chavarriaga,et al.  Robust self-localisation and navigation based on hippocampal place cells , 2005, Neural Networks.

[19]  N. Burgess,et al.  Complementary memory systems: competition, cooperation and compensation , 2005, Trends in Neurosciences.

[20]  Michael A. Arbib,et al.  Affordances. Motivations, and the World Graph Theory , 1998, Adapt. Behav..

[21]  Ricardo Chavarriaga,et al.  A Computational Model of Parallel Navigation Systems in Rodents , 2005 .

[22]  Christian F. Doeller,et al.  Parallel striatal and hippocampal systems for landmarks and boundaries in spatial memory , 2008, Proceedings of the National Academy of Sciences.

[23]  Ricardo Chavarriaga,et al.  Analyzing Interactions between Navigation Strategies Using a Computational Model of Action Selection , 2008, Spatial Cognition.

[24]  John Hallam,et al.  From Animals to Animats 10 , 2008 .