论文信息 - Adaptive temporal difference learning of spatial memory in the water maze task

Adaptive temporal difference learning of spatial memory in the water maze task

The Morris water maze task is a spatial memory task in which an association between cues from the environment and position must be learned in order to locate a hidden platform. This paper details the results of using a temporal difference (TD) learning approach to learn associations between perceptual states, which are discretized using a self organizing map (SOM), and actions necessary for a robot to successfully locate the hidden platform in a ldquodryrdquo version of the water maze task. Additionally, the adaptability of the temporal difference learning approach in non-stationary environments is explored.

[1] Teuvo Kohonen,et al. The self-organizing map , 1990, Neurocomputing.

[2] David J. Foster,et al. A model of hippocampally dependent navigation, using the temporal difference learning rule , 2000, Hippocampus.

[3] R. Morris. Developments of a water-maze procedure for studying spatial learning in the rat , 1984, Journal of Neuroscience Methods.

[4] Richard T. Vaughan,et al. The Player/Stage Project: Tools for Multi-Robot and Distributed Sensor Systems , 2003 .

[5] James M. Keller,et al. A Robot in a Water Maze: Learning a Spatial Memory Task , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[6] David S. Touretzky,et al. The Role of the Hippocampus in Solving the Morris Water Maze , 1998, Neural Computation.

[7] Richard S. Sutton,et al. Learning to predict by the methods of temporal differences , 1988, Machine Learning.

[8] David C. Noelle,et al. A biologically inspired working memory framework for robots , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[9] Gerald M Edelman,et al. Characterizing functional hippocampal pathways in a brain-based device as it solves a spatial memory task. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[10] P. E. Sharp,et al. Simulation of spatial learning in the Morris water maze by a neural network model of the hippocampal formation and nucleus accumbens , 1995, Hippocampus.