A Robotic Context Query-Processing Framework Based on Spatio-Temporal Context Ontology

Service robots operating in indoor environments should recognize dynamic changes from sensors, such as RGB-depth (RGB-D) cameras, and recall the past context. Therefore, we propose a context query-processing framework, comprising spatio-temporal robotic context query language (ST-RCQL) and a spatio-temporal robotic context query-processing system (ST-RCQP), for service robots. We designed them based on spatio-temporal context ontology. ST-RCQL can query not only the current context knowledge, but also the past. In addition, ST-RCQL includes a variety of time operators and time constants; thus, queries can be written very efficiently. The ST-RCQP is a query-processing system equipped with a perception handler, working memory, and backward reasoner for real-time query-processing. Moreover, ST-RCQP accelerates query-processing speed by building a spatio-temporal index in the working memory, where percepts are stored. Through various qualitative and quantitative experiments, we demonstrate the high efficiency and performance of the proposed context query-processing framework.

[1]  A. Cohn,et al.  A qualitative trajectory calculus as a basis for representing moving objects in Geographical Information Systems , 2006 .

[2]  Eliseo Clementini,et al.  Qualitative Representation of Positional Information , 1997, Artif. Intell..

[3]  Hung Keng Pung,et al.  A SQL-based Context Query Language for Context-aware Systems , 2014 .

[4]  Roy M. Turner,et al.  Context-mediated behavior for intelligent agents , 1998, Int. J. Hum. Comput. Stud..

[5]  Tom Schrijvers,et al.  Under Consideration for Publication in Theory and Practice of Logic Programming Swi-prolog , 2022 .

[6]  Kurt Geihs,et al.  A Context Query Language for Pervasive Computing Environments , 2008, 2008 Sixth Annual IEEE International Conference on Pervasive Computing and Communications (PerCom).

[7]  V. S. Costa,et al.  Theory and Practice of Logic Programming , 2010 .

[8]  SeegerBernhard,et al.  The R*-tree: an efficient and robust access method for points and rectangles , 1990 .

[9]  Il Hong Suh,et al.  Ontology-Based Unified Robot Knowledge for Service Robots in Indoor Environments , 2011, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[10]  Amit P. Sheth,et al.  SPARQL-ST: Extending SPARQL to Support Spatiotemporal Queries , 2011, Geospatial Semantics and the Semantic Web.

[11]  Luis Fariñas del Cerro,et al.  A New Tractable Subclass of the Rectangle Algebra , 1999, IJCAI.

[12]  Marc Hanheide,et al.  Robot task planning and explanation in open and uncertain worlds , 2017, Artif. Intell..

[13]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[14]  Pieter Abbeel,et al.  Combined task and motion planning through an extensible planner-independent interface layer , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Douglas B. Lenat,et al.  CYC: a large-scale investment in knowledge infrastructure , 1995, CACM.

[16]  Takuichi Nishimura,et al.  Human-Robot Dialogues for Explaining Activities , 2018, IWSDS.

[17]  Verena Rieser,et al.  A review of spatial reasoning and interaction for real-world robotics , 2017, Adv. Robotics.

[18]  Anind K. Dey,et al.  Understanding and Using Context , 2001, Personal and Ubiquitous Computing.

[19]  Jörg Kaiser,et al.  SELECTSCRIPT: A query language for robotic world models and simulations , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Bernhard Nebel,et al.  Qualitative Spatial Reasoning about Relative Position: The Tradeoff between Strong Formal Properties and Successful Reasoning about Route Graphs , 2003, Spatial Cognition.

[21]  Sebti Foufou,et al.  Intention recognition in manufacturing applications , 2015 .

[22]  Hans-Peter Kriegel,et al.  The R*-tree: an efficient and robust access method for points and rectangles , 1990, SIGMOD '90.

[23]  J. Gregory Trafton,et al.  Spatial Representation and Reasoning for Human-Robot Collaboration , 2007, AAAI.

[24]  Xiaoli Zhang,et al.  Context-specific intention awareness through web query in robotic caregiving , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[25]  Anthony G. Cohn,et al.  Qualitative Spatial Representation and Reasoning with the Region Connection Calculus , 1997, GeoInformatica.

[26]  Moritz Tenorth,et al.  Representations for robot knowledge in the KnowRob framework , 2017, Artif. Intell..

[27]  Paulo Menezes,et al.  The Role of Context Information in Human-Robot Interaction , 2014 .

[28]  Séverin Lemaignan,et al.  Artificial cognition for social human-robot interaction: An implementation , 2017, Artif. Intell..

[29]  Amit P. Sheth,et al.  Geospatial Semantics and the Semantic Web - Foundations, Algorithms, and Applications , 2011, Geospatial Semantics and the Semantic Web.

[30]  Antonin Guttman,et al.  R-trees: a dynamic index structure for spatial searching , 1984, SIGMOD '84.

[31]  Dave Kolas,et al.  Enabling the geospatial Semantic Web with Parliament and GeoSPARQL , 2012, Semantic Web.

[32]  Daniele Nardi,et al.  Context in Robotics and Information Fusion , 2016, Context-Enhanced Information Fusion.

[33]  Anthony G. Cohn,et al.  QSRlib: a software library for online acquisition of qualitative spatial relations from video , 2016 .

[34]  Lauro Snidaro,et al.  Context-Enhanced Information Fusion , 2016, Advances in Computer Vision and Pattern Recognition.

[35]  Andrew U. Frank,et al.  Qualitative Spatial Reasoning: Cardinal Directions as an Example , 1996, Int. J. Geogr. Inf. Sci..