Learning Topological Maps from Sequential Observation and Action Data under Partially Observable Environment

A map is an abstract internal representation of an environment for a mobile robot, and how to learn it autonomously is one of the most fundamental issues in the research fields of intelligent robotics and artificial intelligence. In this paper, we propose a topological map learning method for mobile robots which constructs a POMDP-based discrete state transition model from time-series data of observations and actions. The main point of this method is to find a set of states or nodes of the map gradually so that it minimizes the three types of entropies or uncertainties of the map about "what observations are obtained", "what actions are available" and "what state transitions are expected". It is shown that the topological structure of the state transition model is effectively obtained by this method.

[1]  Wolfram Burgard,et al.  Integrating Topological and Metric Maps for Mobile Robot Navigation: A Statistical Approach , 1998, AAAI/IAAI.

[2]  Benjamin Kuipers,et al.  Learning to Explore and Build Maps , 1994, AAAI.

[3]  Andrew W. Moore,et al.  X-means: Extending K-means with Efficient Estimation of the Number of Clusters , 2000, ICML.

[4]  David Kortenkamp,et al.  Topological Mapping for Mobile Robots Using a Combination of Sonar and Vision Sensing , 1994, AAAI.

[5]  Wolfgang D. Rencken,et al.  Concurrent localisation and map building for mobile robots using ultrasonic sensors , 1993, Proceedings of 1993 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS '93).

[6]  Maja J. Mataric,et al.  Integration of representation into goal-driven behavior-based robots , 1992, IEEE Trans. Robotics Autom..

[7]  Benjamin Kuipers,et al.  A robot exploration and mapping strategy based on a semantic hierarchy of spatial representations , 1991, Robotics Auton. Syst..

[8]  Thorsten Brants Estimating Markov model structures , 1996, Proceeding of Fourth International Conference on Spoken Language Processing. ICSLP '96.

[9]  Yishay Mansour,et al.  An Information-Theoretic Analysis of Hard and Soft Assignment Methods for Clustering , 1997, UAI.

[10]  Leslie Pack Kaelbling,et al.  Learning Topological Maps with Weak Local Odometric Information , 1997, IJCAI.

[11]  Hans P. Moravec,et al.  High resolution maps from wide angle sonar , 1985, Proceedings. 1985 IEEE International Conference on Robotics and Automation.