Object-spatial layout-route based hybrid map and global localization for mobile robots

This paper presents new object-spatial layout-route based hybrid map representation and global localization approaches using a stereo camera. By representing objects as high-level features in a map, a robot can deal more effectively with different contexts such as dynamic environments, human-robot interaction, and semantic information. However, the use of objects alone for map representation has inherent problems. For example, it is difficult to represent empty spaces for robot navigation, and objects are limited to readily recognizable things. One way to overcome these problems is to develop a hybrid map that includes objects and the spatial layout of a local space. The map developed in this research has a hybrid structure that combines a global topological map and a local hybrid map. The topological map represents the spatial relationships between local spaces. The local hybrid map combines the spatial layout of the local space with the objects found in that space. Based on the proposed map, we suggest a novel coarse-to-fine global localization method that uses object recognition, point cloud fitting and probabilistic scan matching. This approach can accurately estimate robot pose with respect to the correct local space.

[1]  Nando de Freitas,et al.  An Introduction to MCMC for Machine Learning , 2004, Machine Learning.

[2]  Wolfram Burgard,et al.  Integrating Topological and Metric Maps for Mobile Robot Navigation: A Statistical Approach , 1998, AAAI/IAAI.

[3]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[4]  Henrik I. Christensen,et al.  Automatic map acquisition for navigation in domestic environments , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[5]  J. M. M. Montiel,et al.  The SPmap: a probabilistic framework for simultaneous localization and map building , 1999, IEEE Trans. Robotics Autom..

[6]  S. Betge-Brezetz,et al.  Decoupling odometry and exteroceptive perception in building a global world map of a mobile robot: the use of local maps , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[7]  Chong-Won Lee,et al.  Mobile robot navigation based on direct depth and color-based environment modeling , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[8]  Keiji Nagatani,et al.  Topological simultaneous localization and mapping (SLAM): toward exact localization without explicit localization , 2001, IEEE Trans. Robotics Autom..

[9]  Andrew P. Duchon,et al.  Humans do not switch between path knowledge and landmarks when learning a new environment , 2007, Psychological research.

[10]  Wai-Kiang Yeap,et al.  On early cognitive mapping , 2000, Spatial Cogn. Comput..

[11]  Alessandro Saffiotti,et al.  Some notes on the use of hybrid maps for mobile robots , 2004 .

[12]  David Kortenkamp,et al.  Topological Mapping for Mobile Robots Using a Combination of Sonar and Vision Sensing , 1994, AAAI.

[13]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[14]  Evangelos E. Milios,et al.  Robot Pose Estimation in Unknown Environments by Matching 2D Range Scans , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Jae-Bok Song,et al.  SLAM of a Mobile Robot using Thinning-based Topological Information , 2007 .

[16]  Sebastian Thrun,et al.  Robotic mapping: a survey , 2003 .

[17]  A. Siegel,et al.  The development of spatial representations of large-scale environments. , 1975, Advances in child development and behavior.

[18]  Wolfram Burgard,et al.  Monte Carlo Localization: Efficient Position Estimation for Mobile Robots , 1999, AAAI/IAAI.

[19]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[20]  N. Burgess,et al.  Spatial memory: how egocentric and allocentric combine , 2006, Trends in Cognitive Sciences.

[21]  E. Spelke,et al.  Human Spatial Representation: Insights from Animals , 2002 .

[22]  Roland Siegwart,et al.  Cognitive maps for mobile robots - an object based approach , 2007, Robotics Auton. Syst..

[23]  Hendrik Zender,et al.  Multi-Layered Conceptual Spatial Mapping for Autonomous Mobile Robots , 2007, AAAI Spring Symposium: Control Mechanisms for Spatial Knowledge Processing in Cognitive / Intelligent Systems.

[24]  Martial Hebert,et al.  A spectral technique for correspondence problems using pairwise constraints , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[25]  Scott Sanner,et al.  Towards object mapping in non-stationary environments with mobile robots , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Benjamin Kuipers,et al.  A robot exploration and mapping strategy based on a semantic hierarchy of spatial representations , 1991, Robotics Auton. Syst..

[27]  Danica Kragic,et al.  Object detection and mapping for service robot tasks , 2007, Robotica.

[28]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[29]  Avinash C. Kak,et al.  Vision for Mobile Robot Navigation: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Masahiro Tomono,et al.  Mobile robot localization based on an inaccurate map , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[31]  John J. Craig,et al.  Introduction to Robotics Mechanics and Control , 1986 .

[32]  Sung-Kee Park,et al.  Topological map building and exploration based on concave nodes , 2008, 2008 International Conference on Control, Automation and Systems.

[33]  Yan Ke,et al.  PCA-SIFT: a more distinctive representation for local image descriptors , 2004, CVPR 2004.

[34]  Ingemar J. Cox,et al.  Modeling a Dynamic Environment Using a Bayesian Multiple Hypothesis Approach , 1994, Artif. Intell..

[35]  Gaurav S. Sukhatme,et al.  Towards Mapping Dynamic Environments , 2003 .

[36]  Gregory Dudek,et al.  A global topological map formed by local metric maps , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[37]  Hanqi Zhuang,et al.  Simultaneous rotation and translation fitting of two 3-D point sets , 1997, IEEE Trans. Syst. Man Cybern. Part B.

[38]  Woojin Chung,et al.  Mobile Robot Localization Using Fusion of Object Recognition and Range Information , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.