Grounding semantic maps in spatial databases

Abstract Semantic maps add to classic robot maps spatially grounded object instances anchored in a suitable way for knowledge representation and reasoning. They enable a robot to solve reasoning problems of geometrical, topological, ontological and logical nature in addition to localization and path planning. Recent literature on semantic mapping lacks effective and efficient approaches for grounding qualitative spatial relations through analysis of the quantitative geometric data of the mapped entities. Yet, such qualitative relations are essential to perform spatial and ontological reasoning about objects in the robot’s surroundings. This article contributes a framework for semantic map representation, called SEMAP, to overcome this missing aspect. It is able to manage full 3D maps with geometric object models and the corresponding semantic annotations as well as their relative spatial relations. For that, spatial database technology is used to solve the representational and querying problems efficiently. This article describes the extensions necessary to make a spatial database suitable for robotic applications. Especially, we add 3D spatial operators and a tree of transformations to represent relative position information. We evaluate the implemented capabilities and present real life use cases of SEMAP in different application domains.

[1]  Alessandro Saffiotti,et al.  An introduction to the anchoring problem , 2003, Robotics Auton. Syst..

[2]  Óscar Martínez Mozos,et al.  Relational Model for Robotic Semantic Navigation in Indoor Environments , 2017, J. Intell. Robotic Syst..

[3]  Daniele Nardi,et al.  Automatic Extraction of Structural Representations of Environments , 2014, IAS.

[4]  Alessandro Saffiotti,et al.  Robot task planning using semantic maps , 2008, Robotics Auton. Syst..

[5]  Ernst Rank,et al.  Query Support for BIMs using Semantic and Spatial Conditions , 2010 .

[6]  Diedrich Wolter,et al.  Qualitative Spatial Reasoning for Applications: New Challenges and the SparQ Toolbox , 2012 .

[7]  Joachim Hertzberg,et al.  A Toolkit for Automatic Generation of Polygonal Maps - Las Vegas Reconstruction , 2012, ROBOTIK.

[8]  Antonin Guttman,et al.  R-trees: a dynamic index structure for spatial searching , 1984, SIGMOD '84.

[9]  Francesco Chinello,et al.  KUKA Control Toolbox , 2011, IEEE Robotics & Automation Magazine.

[10]  Adam Borkowski,et al.  Towards Semantic Navigation in Mobile Robotics , 2010, Graph Transformations and Model-Driven Engineering.

[11]  Anthony G. Cohn,et al.  Qualitative Spatial Representation and Reasoning with the Region Connection Calculus , 1997, GeoInformatica.

[12]  Joachim Hertzberg,et al.  Model-based furniture recognition for building semantic object maps , 2017, Artif. Intell..

[13]  Diego Calvanese,et al.  The Description Logic Handbook: Theory, Implementation, and Applications , 2003, Description Logic Handbook.

[14]  Joachim Hertzberg,et al.  A Spatio-Semantic Model for Agricultural Environments and Machines , 2018, IEA/AIE.

[15]  Alessandro Saffiotti,et al.  Monitoring the execution of robot plans using semantic knowledge , 2008, Robotics Auton. Syst..

[16]  Joachim Hertzberg,et al.  Towards semantic maps for mobile robots , 2008, Robotics Auton. Syst..

[17]  Moritz Tenorth,et al.  KnowRob: A knowledge processing infrastructure for cognition-enabled robots , 2013, Int. J. Robotics Res..

[18]  Martin Breunig,et al.  3D geo-database research: Retrospective and future directions , 2011, Comput. Geosci..

[19]  Verena Rieser,et al.  A review of spatial reasoning and interaction for real-world robotics , 2017, Adv. Robotics.

[20]  Eliseo Clementini,et al.  A Small Set of Formal Topological Relationships Suitable for End-User Interaction , 1993, SSD.

[21]  Barbara Caputo,et al.  A realistic benchmark for visual indoor place recognition , 2010, Robotics Auton. Syst..

[22]  Sisi Zlatanova,et al.  Topological models and frameworks for 3D spatial objects , 2004, Comput. Geosci..

[23]  Morakot Pilouk,et al.  Spatial data modelling for 3D GIS , 2007 .

[24]  Patric Jensfelt,et al.  Large-scale semantic mapping and reasoning with heterogeneous modalities , 2012, 2012 IEEE International Conference on Robotics and Automation.

[25]  James F. Allen An Interval-Based Representation of Temporal Knowledge , 1981, IJCAI.

[26]  Antonios Gasteratos,et al.  Semantic mapping for mobile robotics tasks: A survey , 2015, Robotics Auton. Syst..