A generative spectral model for semantic mapping of buildings

Consider a mobile robot exploring an initially unknown school building and assume that it has already discovered some classrooms, offices, and bathrooms. What can the robot infer about the presence and the locations of other classrooms and offices in the school building? This paper makes a step toward providing an answer to the above question by proposing a system based on a generative model that is able to represent the topological structures and the semantic labeling schemas of buildings and to predict the structure and the schema for unexplored portions of these environments. We represent the buildings as undirected graphs, whose nodes are rooms and edges are physical connections between them. Given an initial knowledge base of graphs, our approach, relying on a spectral analysis of these graphs, segments each graph for finding significant subgraphs and clusters them according to their similarity. A graph representing a new building or an unvisited part of a building is eventually generated by sampling subgraphs from clusters and connecting them.

[1]  John Folkesson,et al.  What can we learn from 38,000 rooms? Reasoning about unexplored space in indoor environments , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Vladlen Koltun,et al.  Computer-generated residential building layouts , 2010, SIGGRAPH 2010.

[3]  Wolfram Burgard,et al.  Supervised Learning of Places from Range Data using AdaBoost , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[4]  Richard C. Wilson,et al.  Spectral Generative Models for Graphs , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[5]  Barbara Caputo,et al.  Multi-modal Semantic Place Classification , 2010, Int. J. Robotics Res..

[6]  Steven Gold,et al.  A Graduated Assignment Algorithm for Graph Matching , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Matthew R. Walter,et al.  Learning spatial-semantic representations from natural language descriptions and scene classifications , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Donald Geman,et al.  Stochastic Relaxation, Gibbs Distributions, and the Bayesian Restoration of Images , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[10]  Cipriano Galindo,et al.  Multi-hierarchical semantic maps for mobile robotics , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Francesco Amigoni,et al.  Exploiting Structural Properties of Buildings Towards General Semantic Mapping Systems , 2014, IAS.

[12]  Jitendra Malik,et al.  Normalized cuts and image segmentation , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[13]  Wolfram Burgard,et al.  Conceptual spatial representations for indoor mobile robots , 2008, Robotics Auton. Syst..

[14]  Wolfram Burgard,et al.  Speeding-up multi-robot exploration by considering semantic place information , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[15]  Kristoffer Sjöö Semantic map segmentation using function-based energy maximization , 2012, 2012 IEEE International Conference on Robotics and Automation.

[16]  Patric Jensfelt,et al.  Large-scale semantic mapping and reasoning with heterogeneous modalities , 2012, 2012 IEEE International Conference on Robotics and Automation.

[17]  Richard C. Wilson,et al.  Parts based generative models for graphs , 2008, 2008 19th International Conference on Pattern Recognition.

[18]  Wolfram Burgard,et al.  Supervised semantic labeling of places using information extracted from sensor data , 2007, Robotics Auton. Syst..

[19]  Alberto Quattrini Li,et al.  A System for Building Semantic Maps of Indoor Environments Exploiting the Concept of Building Typology , 2013, RoboCup.

[20]  Alberto Quattrini Li,et al.  Semantically-informed coordinated multirobot exploration of relevant areas in search and rescue settings , 2013, 2013 European Conference on Mobile Robots.

[21]  Francesco Amigoni,et al.  Towards more realistic indoor environments for the Virtual Robot Competition , 2014 .

[22]  Richard C. Wilson,et al.  Mixing spectral representations of graphs , 2006, 18th International Conference on Pattern Recognition (ICPR'06).