Unsupervised learning of reflexive and action-based affordances to model navigational behavior

Here we model animat navigation in a real world env ironment by using place cell as a sensory representation. The cells’ place fields divided the environment into discrete states. The robot learns knowledge of the environment by memorizing t he sensory outcome of its motor actions. This was composed of a central process, le arning the probability of state-to-state transitions by motor actions and a distal processin g routine, learning the extent to which these state-to-state transitions are caused by sensory-dr iven eflex behavior (obstacle avoidance). Navigational decision making integrates central and distal learned environmental knowledge to select an action that leads to a goal state. Dif ferentiating distal and central processing increases the behavioral accuracy of the selected a tions. We claim that the system can easily be expanded to model other behaviors, using alterna tive definitions of states and actions.

[1]  Robert A. Wilson,et al.  Book Reviews: The MIT Encyclopedia of the Cognitive Sciences , 2000, CL.

[2]  Philippe Gaussier,et al.  From view cells and place cells to cognitive map learning: processing stages of the hippocampal system , 2002, Biological Cybernetics.

[3]  P. König,et al.  A Model of the Ventral Visual System Based on Temporal Stability and Local Memory , 2006, PLoS biology.

[4]  M. Eckardt The Hippocampus as a Cognitive Map , 1980 .

[5]  L. F. Abbott,et al.  A Model of Spatial Map Formation in the Hippocampus of the Rat , 1999, Neural Computation.

[6]  Joscha Bach,et al.  Designing Agents with MicroPsi Node Nets , 2003, KI.

[7]  J O'Keefe,et al.  Robotic and neuronal simulation of the hippocampus and rat navigation. , 1997, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[8]  E. Tolman Cognitive maps in rats and men. , 1948, Psychological review.

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[10]  Wulfram Gerstner,et al.  Learning Navigational Maps Through Potentiation and Modulation of Hippocampal Place Cells , 2004, Journal of Computational Neuroscience.

[11]  Angelo Arleo,et al.  Spatial cognition and neuro-mimetic navigation: a model of hippocampal place cell activity , 2000, Biological Cybernetics.

[12]  R. Passingham The hippocampus as a cognitive map J. O'Keefe & L. Nadel, Oxford University Press, Oxford (1978). 570 pp., £25.00 , 1979, Neuroscience.

[13]  David J. Foster,et al.  A model of hippocampally dependent navigation, using the temporal difference learning rule , 2000, Hippocampus.

[14]  Jean-Arcady Meyer,et al.  Animat navigation using a cognitive graph , 1998, Biological Cybernetics.

[15]  Ricardo Chavarriaga,et al.  Robust self-localisation and navigation based on hippocampal place cells , 2005, Neural Networks.

[16]  R. Morris Developments of a water-maze procedure for studying spatial learning in the rat , 1984, Journal of Neuroscience Methods.

[17]  三嶋 博之 The theory of affordances , 2008 .

[18]  D. Olton,et al.  Animal Behavior Processes , 2022 .

[19]  J. O'Keefe,et al.  The hippocampus as a spatial map. Preliminary evidence from unit activity in the freely-moving rat. , 1971, Brain research.