Semantic classification by reasoning on the whole structure of buildings using statistical relational learning techniques

Semantic mapping for autonomous mobile robots includes the place classification task that associates semantic labels (like ‘corridor’ or ‘office’) to rooms perceived in indoor environments. The mainstream approaches to place classification are characterized by local reasoning, where only features relative to the neighbourhood of each room are considered. In this paper, we propose a method for global reasoning on the whole structure of buildings, considered as single structured objects. We use a statistical relational learning algorithm, called kLog, and we compare it against a classifier, Extra-Trees, which resembles classical local approaches, in three tasks: classification of rooms, classification of entire floors of buildings, and validation of simulated worlds. Our results show that our global approach performs better than local approaches when the classification task involves reasoning on the regularities of buildings and when available information about rooms is coarse-grained.

[1]  Wolfram Burgard,et al.  Speeding-up multi-robot exploration by considering semantic place information , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[2]  Ziyuan Liu,et al.  A generalizable knowledge framework for semantic indoor mapping based on Markov logic networks and data driven MCMC , 2014, Future Gener. Comput. Syst..

[3]  Wolfram Burgard,et al.  Conceptual spatial representations for indoor mobile robots , 2008, Robotics Auton. Syst..

[4]  KostavelisIoannis,et al.  Semantic mapping for mobile robotics tasks , 2015 .

[5]  Francesco Amigoni,et al.  A generative spectral model for semantic mapping of buildings , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[6]  Ananth Ranganathan,et al.  PLISS: Detecting and Labeling Places Using Online Change-Point Detection , 2010, Robotics: Science and Systems.

[7]  John Folkesson,et al.  What can we learn from 38,000 rooms? Reasoning about unexplored space in indoor environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Wolfram Burgard,et al.  Supervised semantic labeling of places using information extracted from sensor data , 2007, Robotics Auton. Syst..

[9]  Óscar Martínez Mozos Semantic Labeling of Places with Mobile Robots , 2010, Springer Tracts in Advanced Robotics.

[10]  Antonios Gasteratos,et al.  Semantic mapping for mobile robotics tasks: A survey , 2015, Robotics Auton. Syst..

[11]  Ben Taskar,et al.  Introduction to statistical relational learning , 2007 .

[12]  Wolfram Burgard,et al.  Instace-Based AMN Classification for Improved Object Recognition in 2D and 3D Laser Range Data , 2007, IJCAI.

[13]  Alberto Quattrini Li,et al.  A semantically-informed multirobot system for exploration of relevant areas in search and rescue settings , 2016, Auton. Robots.

[14]  Andrew McCallum,et al.  An Introduction to Conditional Random Fields for Relational Learning , 2007 .

[15]  Luc De Raedt,et al.  kLog: A Language for Logical and Relational Learning with Kernels (Extended Abstract) , 2012, IJCAI.

[16]  Alberto Quattrini Li,et al.  A System for Building Semantic Maps of Indoor Environments Exploiting the Concept of Building Typology , 2013, RoboCup.

[17]  Wolfram Burgard,et al.  Semantic Place Classification of Indoor Environments with Mobile Robots Using Boosting , 2005, AAAI.

[18]  Stefano Carpin,et al.  USARSim: a robot simulator for research and education , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[19]  Pierre Geurts,et al.  Extremely randomized trees , 2006, Machine Learning.

[20]  Cipriano Galindo,et al.  Multi-hierarchical semantic maps for mobile robotics , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Francesco Amigoni,et al.  Exploiting Structural Properties of Buildings Towards General Semantic Mapping Systems , 2014, IAS.

[22]  Fabrizio Costa,et al.  Fast Neighborhood Subgraph Pairwise Distance Kernel , 2010, ICML.

[23]  Matthew R. Walter,et al.  Learning spatial-semantic representations from natural language descriptions and scene classifications , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Luc De Raedt,et al.  Kernels and Distances for Structured Data , 2008 .

[25]  Matthew Richardson,et al.  Markov logic networks , 2006, Machine Learning.

[26]  Lise Getoor,et al.  Learning Probabilistic Relational Models , 1999, IJCAI.

[27]  Barbara Caputo,et al.  Multi-modal Semantic Place Classification , 2010, Int. J. Robotics Res..

[28]  Wolfram Burgard,et al.  Supervised Learning of Places from Range Data using AdaBoost , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[29]  Patric Jensfelt,et al.  Large-scale semantic mapping and reasoning with heterogeneous modalities , 2012, 2012 IEEE International Conference on Robotics and Automation.