Reasoning on the Self-Organizing Incremental Associative Memory for Online Robot Path Planning

SUMMARY Robot path-planning is one of the important issues in robotic navigation. This paper presents a novel robot path-planning approach based on the associative memory using Self-Organizing Incremental Neural Networks (SOINN). By the proposed method, an environment is first autonomously divided into a set of path-fragments by junctions. Each fragment is represented by a sequence of preliminarily generated common patterns (CPs). In an online manner, a robot regards the current path as the associative path-fragments, each connected by junctions. The reasoning technique is additionally proposed for decision making at each junction to speed up the exploration time. Distinct from other methods, our method does not ignore the important information about the regions between junctions (path-fragments). The resultant number of path-fragments is also less than other method. Evaluation is done via Webots physical 3D-simulated and real robot experiments, where only distance sensors are available. Results show that our method can represent the environment effectively; it enables the robot to solve the goal-oriented navigation problem in only one episode, which is actually less than that necessary for most of the Reinforcement Learning (RL) based methods. The running time is proved finite and scales well with the environment. The resultant number of pathfragments matches well to the environment.

[1]  Benjamin Kuipers,et al.  Using the topological skeleton for scalable global metrical map-building , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[2]  Benjamin Kuipers,et al.  The Spatial Semantic Hierarchy , 2000, Artif. Intell..

[3]  Ricardo Chavarriaga,et al.  Robust self-localisation and navigation based on hippocampal place cells , 2005, Neural Networks.

[4]  Christopher Rasmussen,et al.  Combining laser range, color, and texture cues for autonomous road following , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[5]  Rodney A. Brooks,et al.  A Robust Layered Control Syste For A Mobile Robot , 2022 .

[6]  Keiji Nagatani,et al.  Topological simultaneous localization and mapping (SLAM): toward exact localization without explicit localization , 2001, IEEE Trans. Robotics Autom..

[7]  Benjamin Kuipers,et al.  Towards a general theory of topological maps , 2004, Artif. Intell..

[8]  Benjamin Kuipers,et al.  Loop-closing and planarity in topological map-building , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[9]  David Hsu,et al.  Narrow passage sampling for probabilistic roadmap planning , 2005, IEEE Transactions on Robotics.

[10]  Harukazu Igarashi Path planning of a mobile robot by optimization and reinforcement learning , 2006, Artificial Life and Robotics.

[11]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[12]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[13]  Angelo Arleo,et al.  Place Cells and Spatial Navigation based on Vision, Path Integration, and Reinforcement Learning , 2001 .

[14]  Paul Newman,et al.  FAB-MAP: Probabilistic Localization and Mapping in the Space of Appearance , 2008, Int. J. Robotics Res..

[15]  Vijay Kumar,et al.  Using policy gradient reinforcement learning on autonomous robot controllers , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[16]  M. Toussaint A Sensorimotor Map: Modulating Lateral Interactions for Anticipation and Planning , 2006 .

[17]  Y. Charlie Hu,et al.  P-SLAM: Simultaneous Localization and Mapping With Environmental-Structure Prediction , 2007, IEEE Transactions on Robotics.

[18]  Sebastian Thrun,et al.  Integrating Grid-Based and Topological Maps for Mobile Robot Navigation , 1996, AAAI/IAAI, Vol. 2.

[19]  Michiel van de Panne,et al.  Faster Motion Planning Using Learned Local Viability Models , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[20]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[21]  Michiel van de Panne,et al.  RRT-blossom: RRT with a local flood-fill behavior , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[22]  Olivier Michel,et al.  Webots: Symbiosis Between Virtual and Real Mobile Robots , 1998, Virtual Worlds.

[23]  Achim J. Lilienthal,et al.  Incremental spectral clustering and seasons: Appearance-based localization in outdoor environments , 2008, 2008 IEEE International Conference on Robotics and Automation.

[24]  Hugh F. Durrant-Whyte,et al.  A solution to the simultaneous localization and map building (SLAM) problem , 2001, IEEE Trans. Robotics Autom..

[25]  Luc Van Gool,et al.  Omnidirectional Vision Based Topological Navigation , 2007, International Journal of Computer Vision.

[26]  Masayuki Inaba,et al.  Humanoid Arm Motion Planning based on RRT Search of 3D Depth Map , 2002 .

[27]  Masayuki Inaba,et al.  Humanoid arm motion planning using stereo vision and RRT search , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[28]  Shen Furao,et al.  An incremental network for on-line unsupervised classification and topology learning , 2006, Neural Networks.

[29]  Javier González,et al.  Toward a Unified Bayesian Approach to Hybrid Metric--Topological SLAM , 2008, IEEE Transactions on Robotics.

[30]  Benjamin Kuipers,et al.  Local metrical and global topological maps in the hybrid spatial semantic hierarchy , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[31]  Osamu Hasegawa,et al.  Associative Memory for Online Learning in Noisy Environments Using Self-Organizing Incremental Neural Network , 2009, IEEE Transactions on Neural Networks.

[32]  Sebastian Thrun,et al.  Probabilistic robotics , 2002, CACM.

[33]  Olivier Michel,et al.  Cyberbotics Ltd. Webots™: Professional Mobile Robot Simulation , 2004, ArXiv.

[34]  Marc Toussaint,et al.  A Sensorimotor Map: Modulating Lateral Interactions for Anticipation and Planning , 2006, Neural Computation.

[35]  Javier González,et al.  A New Approach for Large-Scale Localization and Mapping: Hybrid Metric-Topological SLAM , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[36]  Angelo Arleo,et al.  Cognitive navigation based on nonuniform Gabor space sampling, unsupervised growing networks, and reinforcement learning , 2004, IEEE Transactions on Neural Networks.

[37]  Michael Jenkin,et al.  Robotic exploration as graph construction , 1991, IEEE Trans. Robotics Autom..

[38]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[39]  Masafumi Hagiwara,et al.  Kohonen feature maps as a supervised learning machine , 1993, IEEE International Conference on Neural Networks.