Semantic labeling of places using information extracted from laser and vision sensor data

Indoor environments can typically be divided into places with different functionalities like corridors, kitchens, offices, or seminar rooms. The ability to learn such semantic categories from sensor data enables a mobile robot to extend the representation of the environment facilitating the interaction withhumans. As an example, natural language terms like corridor or room can be used to communicate the position of the robot in a map in a more intuitive way. In this work, we firrst propose an approach based on supervised learning to classify the pose of a mobile robot into semantic classes. Our method uses AdaBoost to boost simple features extracted from range data and vision into a strong classifier. We present two main applications of this approach. Firstly, we show how our approach can be utilized by a moving robot for an online classification of the poses traversed along its path using a hidden Markov model. Secondly, we introduce an approach to learn topological maps from geometric maps by applying our semantic classification procedure in combination with a probabilistic relaxation procedure. We finally show how to apply associative Markov networks (AMNs) together with AdaBoost for classifying complete geometric maps. Experimental results obtained in simulation and with real robots demonstrate the effectiveness of our approach in various indoor environments.

[1]  Sebastian Thrun,et al.  Detecting and modeling doors with mobile robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[2]  Henrik I. Christensen,et al.  Behaviour Coordination in Structured Environments , 2022 .

[3]  Keiji Nagatani,et al.  Topological simultaneous localization and mapping (SLAM): toward exact localization without explicit localization , 2001, IEEE Trans. Robotics Autom..

[4]  Wolfram Burgard,et al.  Supervised Learning of Places from Range Data using AdaBoost , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[5]  Piotr Indyk,et al.  Enhanced hypertext categorization using hyperlinks , 1998, SIGMOD '98.

[6]  Wolfram Burgard,et al.  Using AdaBoost for Place Labeling and Topological Map Building , 2005, ISRR.

[7]  Leslie Pack Kaelbling,et al.  Learning Topological Maps with Weak Local Odometric Information , 1997, IJCAI.

[8]  Sebastian Thrun,et al.  Learning Hierarchical Object Maps of Non-Stationary Environments with Mobile Robots , 2002, UAI.

[9]  Roland Siegwart,et al.  Incremental robot mapping with fingerprints of places , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Paul A. Viola,et al.  Robust Real-time Object Detection , 2001 .

[11]  Ben Taskar,et al.  Discriminative Probabilistic Models for Relational Data , 2002, UAI.

[12]  Dieter Fox,et al.  Relational Object Maps for Mobile Robots , 2005, IJCAI.

[13]  Alessandro Saffiotti,et al.  A virtual sensor for room detection , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Wolfram Burgard,et al.  Semantic Place Classification of Indoor Environments with Mobile Robots Using Boosting , 2005, AAAI.

[15]  Benjamin Kuipers,et al.  A robot exploration and mapping strategy based on a semantic hierarchy of spatial representations , 1991, Robotics Auton. Syst..

[16]  Antonio Torralba,et al.  Context-based vision system for place and object recognition , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Wolfram Burgard,et al.  Multi-Level Surface Maps for Outdoor Terrain Mapping and Loop Closing , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Azriel Rosenfeld,et al.  Scene Labeling by Relaxation Operations , 1976, IEEE Transactions on Systems, Man, and Cybernetics.

[19]  Benjamin Kuipers,et al.  Towards Autonomous Topological Place Detection Using the Extended Voronoi Graph , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[20]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[21]  Yoram Singer,et al.  Improved Boosting Algorithms Using Confidence-rated Predictions , 1998, COLT' 98.

[22]  David Kortenkamp,et al.  Topological Mapping for Mobile Robots Using a Combination of Sonar and Vision Sensing , 1994, AAAI.

[23]  Ben J. A. Kröse,et al.  Hierarchical map building using visual landmarks and geometric constraints , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Hans P. Moravec Sensor Fusion in Certainty Grids for Mobile Robots , 1988, AI Mag..

[25]  Sebastian Thrun,et al.  Learning Metric-Topological Maps for Indoor Mobile Robot Navigation , 1998, Artif. Intell..