Episodic Memory Multimodal Learning for Robot Sensorimotor Map Building and Navigation

In this paper, an unsupervised learning model of episodic memory is proposed. The proposed model, enhanced episodic memory adaptive resonance theory (EEM-ART), categorizes and encodes experiences of a robot to the environment and generates a cognitive map. EEM-ART consists of multilayer ART networks to extract novel events and encode spatio-temporal connection as episodes by incrementally generating cognitive neurons. The model connects episodes to construct a sensorimotor map for the robot to continuously perform path planning and goal navigation. Experimental results for a mobile robot indicate that EEM-ART can process multiple sensory sources for learning events and encoding episodes simultaneously. The model overcomes perceptual aliasing and robot localization by recalling the encoded episodes with a new anticipation function and generates sensorimotor map to connect episodes together to execute tasks continuously with little to no human intervention.

[1]  John E. Laird,et al.  Enhancing intelligent agents with episodic memory , 2012, Cognitive Systems Research.

[2]  Haizhou Li,et al.  Direction-driven navigation using cognitive map for mobile robots , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  J. Daniel Morrow,et al.  Memory in Silico: Building a Neuromimetic Episodic Cognitive Model , 2009, 2009 WRI World Congress on Computer Science and Information Engineering.

[4]  Marina Weber,et al.  Elements Of Episodic Memory , 2016 .

[5]  Jong-Hwan Kim,et al.  Integrated adaptive resonance theory neural model for episodic memory with task memory for task performance of robots , 2016, 2016 IEEE Congress on Evolutionary Computation (CEC).

[6]  Jianwei Zhang,et al.  Towards an Episodic Memory for Cognitive Robots , 2008 .

[7]  Philippe Gaussier,et al.  Adaptation capability of cognitive map improves behaviors of social robots , 2012, 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics (ICDL).

[8]  Jeffrey L. Krichmar,et al.  Adaptive Robot Path Planning Using a Spiking Neuron Algorithm With Axonal Delays , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[9]  Naoyuki Kubota,et al.  Evolutionary Computation for Intelligent Self-localization in Multiple Mobile Robots Based on SLAM , 2012, ICIRA.

[10]  Jian Huang,et al.  Echo state network based predictive control with particle swarm optimization for pneumatic muscle actuator , 2016, J. Frankl. Inst..

[11]  Honglak Lee,et al.  Deep learning for detecting robotic grasps , 2013, Int. J. Robotics Res..

[12]  Peter I. Corke,et al.  Visual Place Recognition: A Survey , 2016, IEEE Transactions on Robotics.

[13]  François Michaud,et al.  Design and integration of a spatio-temporal memory with emotional influences to categorize and recall the experiences of an autonomous mobile robot , 2015, Autonomous Robots.

[14]  Roland Siegwart,et al.  Hybrid simultaneous localization and map building: a natural integration of topological and metric , 2003, Robotics Auton. Syst..

[15]  Ming Cong,et al.  A biological-inspired episodic cognitive map building framework for mobile robot navigation , 2017 .

[16]  Wenwen Wang,et al.  Neural Modeling of Episodic Memory: Encoding, Retrieval, and Forgetting , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Wenwen Wang,et al.  A self-organizing approach to episodic memory modeling , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[18]  Hubert Konik,et al.  Full Reference Image Quality Assessment Based on Saliency Map Analysis , 2010 .

[19]  Simon X. Yang,et al.  Bioinspired Neural Network-based Q-Learning Approach for robot Path Planning in unknown Environments , 2016, Int. J. Robotics Autom..

[20]  H. Markowitsch,et al.  Amnesic disorders , 2012, The Lancet.

[21]  Yuanqing Xia,et al.  Neural Network-Based Control of Networked Trilateral Teleoperation With Geometrically Unknown Constraints , 2016, IEEE Transactions on Cybernetics.

[22]  Chun-Yi Su,et al.  Neural-Adaptive Control of Single-Master–Multiple-Slaves Teleoperation for Coordinated Multiple Mobile Manipulators With Time-Varying Communication Delays and Input Uncertainties , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[23]  S. Grossberg,et al.  Spikes, synchrony, and attentive learning by laminar thalamocortical circuits , 2006, Brain Research.

[24]  Geert-Jan M. Kruijff,et al.  Episodic-Like Memory for Cognitive Robots , 2012, IEEE Transactions on Autonomous Mental Development.

[25]  Stephen Grossberg,et al.  A massively parallel architecture for a self-organizing neural pattern recognition machine , 1988, Comput. Vis. Graph. Image Process..

[26]  Sergey Levine,et al.  Learning hand-eye coordination for robotic grasping with deep learning and large-scale data collection , 2016, Int. J. Robotics Res..

[27]  Yongji Wang,et al.  Reinforcement learning-based shared control for walking-aid robot and its experimental verification , 2015, Adv. Robotics.

[28]  S. Grossberg.  Beta oscillations and hippocampal place cell learning during exploration of novel environments , 2009, Hippocampus.

[29]  Wei He,et al.  Adaptive Neural Network Control of an Uncertain Robot With Full-State Constraints , 2016, IEEE Transactions on Cybernetics.