A Constructive Machine Learning Approach for Robot Exploration and Search

Semantic knowledge, more specifically semantic maps that associate semantic concepts (labels like ‘room’ and ‘corridor’) to spatial entities, has been employed to improve the performance of (multi-)robot planning tasks, such as search and exploration. However, although current semantic mapping approaches are very effective in labeling the parts of environments already visited by the robots, they are usually unable to predict the labels and, more generally, the structure of unvisited parts of environments. In this contribution, following a Constructive Machine Learning (CML) approach, we discuss the use of a generative method that is able to model and predict the topological structure and the labels of rooms for an indoor, previously unknown (or partially observed) environment. While this approach is not always able to find a perfect prediction of the structure of a given unknown environment, it seems nevertheless able to capture some fundamental structural properties. We explicitly note that the purpose of this paper is not to show any definitive results (although we provide a detailed example), but advocate the potential of using highlevel semantic knowledge to predict the structure of unknown parts of indoor buildings in order to improve exploration and search.

[1]  Wolfram Burgard,et al.  Supervised Learning of Places from Range Data using AdaBoost , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[2]  Wolfram Burgard,et al.  Speeding-up multi-robot exploration by considering semantic place information , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[3]  Barbara Caputo,et al.  Multi-modal Semantic Place Classification , 2010, Int. J. Robotics Res..

[4]  Patric Jensfelt,et al.  Large-scale semantic mapping and reasoning with heterogeneous modalities , 2012, 2012 IEEE International Conference on Robotics and Automation.

[5]  John Folkesson,et al.  What can we learn from 38,000 rooms? Reasoning about unexplored space in indoor environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Patric Jensfelt,et al.  Active Visual Object Search in Unknown Environments Using Uncertain Semantics , 2013, IEEE Transactions on Robotics.

[7]  Alberto Quattrini Li,et al.  A System for Building Semantic Maps of Indoor Environments Exploiting the Concept of Building Typology , 2013, RoboCup.

[8]  Matthew R. Walter,et al.  Learning spatial-semantic representations from natural language descriptions and scene classifications , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Francesco Amigoni,et al.  Exploiting Structural Properties of Buildings Towards General Semantic Mapping Systems , 2014, IAS.

[10]  Francesco Amigoni,et al.  A generative spectral model for semantic mapping of buildings , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[11]  Alberto Quattrini Li,et al.  A semantically-informed multirobot system for exploration of relevant areas in search and rescue settings , 2016, Auton. Robots.