Monitoring the execution of robot plans using semantic knowledge

Even the best laid plans can fail, and robot plans executed in real world domains tend to do so often. The ability of a robot to reliably monitor the execution of plans and detect failures is essential to its performance and its autonomy. In this paper, we propose a technique to increase the reliability of monitoring symbolic robot plans. We use semantic domain knowledge to derive implicit expectations of the execution of actions in the plan, and then match these expectations against observations. We present two realizations of this approach: a crisp one, which assumes deterministic actions and reliable sensing, and uses a standard knowledge representation system (LOOM); and a probabilistic one, which takes into account uncertainty in action effects, in sensing, and in world states. We perform an extensive validation of these realizations through experiments performed both in simulation and on real robots.

[1]  Karen Zita Haigh,et al.  Planning, Execution and Learning in a Robotic Agent , 1998, AIPS.

[2]  Richard Fikes,et al.  Learning and Executing Generalized Robot Plans , 1993, Artif. Intell..

[3]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[4]  Alessandro Saffiotti,et al.  Model-Free Execution Monitoring in Behavior-Based Robotics , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  John A. Bateman,et al.  Dialog-Based 3D-Image Recognition Using a Domain Ontology , 2006, Spatial Cognition.

[6]  Froduald Kabanza,et al.  History checking of temporal fuzzy logic formulas for monitoring behavior-based mobile robots , 2000, Proceedings 12th IEEE Internationals Conference on Tools with Artificial Intelligence. ICTAI 2000.

[7]  Michael Beetz,et al.  Fast Probabilistic Plan Debugging , 1997, ECP.

[8]  Cipriano Galindo,et al.  Multi-hierarchical semantic maps for mobile robotics , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Alessandro Saffiotti,et al.  Active execution monitoring using planning and semantic knowledge , 2007 .

[10]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[11]  Diego Calvanese,et al.  The Description Logic Handbook: Theory, Implementation, and Applications , 2003, Description Logic Handbook.

[12]  Alessandro Saffiotti,et al.  Handling uncertainty in semantic-knowledge based execution monitoring , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Jeff Heflin,et al.  Large Scale Knowledge Base Systems: An Empirical Evaluation Perspective , 2006, AAAI.

[14]  Andrew Lucas,et al.  JACK Intelligent Agents – Summary of an Agent Infrastructure , 2001 .

[15]  Alon Y. Halevy,et al.  P-CLASSIC: A Tractable Probablistic Description Logic , 1997, AAAI/IAAI.

[16]  Abdelbaki Bouguerra,et al.  Robust execution of robot task-plans: a knowledge-based approach , 2008 .

[17]  Arturo Espinosa-Romero,et al.  Talking to Godot: dialogue with a mobile robot , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Anand S. Rao,et al.  An architecture for real-time reasoning and system control , 1992, IEEE Expert.

[19]  Wolfram Burgard,et al.  Particle Filters for Mobile Robot Localization , 2001, Sequential Monte Carlo Methods in Practice.

[20]  Alessandro Saffiotti,et al.  A Multivalued Logic Approach to Integrating Planning and Control , 1995, Artif. Intell..

[21]  Alessandro Saffiotti,et al.  Semantic Knowledge-Based Execution Monitoring for Mobile Robots , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[22]  Reid G. Simmons,et al.  Robust execution monitoring for navigation plans , 1998, Proceedings. 1998 IEEE/RSJ International Conference on Intelligent Robots and Systems. Innovations in Theory, Practice and Applications (Cat. No.98CH36190).

[23]  Rachid Alami,et al.  An Architecture for Autonomy , 1998, Int. J. Robotics Res..

[24]  Alessandro Saffiotti,et al.  PEIS ecologies: ambient intelligence meets autonomous robotics , 2005, sOc-EUSAI '05.

[25]  Martha E. Pollack,et al.  Towards Focused Plan Monitoring: A Technique and an Application to Mobile Robots , 2000, Auton. Robots.

[26]  R. James Firby,et al.  Building symbolic primitives with continuous control routines , 1992 .

[27]  Gordon Fraser,et al.  Plan execution in dynamic environments , 2005 .

[28]  Michael Thielscher,et al.  Intelligent Execution Monitoring in Dynamic Environments , 2003, Fundam. Informaticae.

[29]  S. Thrun,et al.  Particle Filters for Rover Fault Diagnosis , 2004 .

[30]  Volker Haarslev,et al.  On the Scalability of Description Logic Instance Retrieval , 2006, KI.

[31]  Ola Pettersson,et al.  Execution monitoring in robotics: A survey , 2005, Robotics Auton. Syst..

[32]  Félix Ingrand,et al.  Interleaving Temporal Planning and Execution in Robotics Domains , 2004, AAAI.

[33]  Nando de Freitas,et al.  Sequential Monte Carlo Methods in Practice , 2001, Statistics for Engineering and Information Science.

[34]  Joachim Hertzberg,et al.  3D Mapping with Semantic Knowledge , 2005, RoboCup.

[35]  Michael Beetz,et al.  Plan-Based Control of Robotic Agents , 2002, Lecture Notes in Computer Science.

[36]  Roland Siegwart,et al.  A Tale of Two Object Recognition Methods for Mobile Robots , 2008, ICVS.

[37]  Giuseppe De Giacomo,et al.  Execution Monitoring of High-Level Robot Programs , 1998, KR.

[38]  Thomas Lukasiewicz,et al.  Expressive probabilistic description logics , 2008, Artif. Intell..

[39]  Joaquín Lopez Fernández,et al.  PROBABILISTIC MODELS FOR MONITORING AND FAULT DIAGNOSIS: APPLICATION AND EVALUATION IN A MOBILE ROBOT , 2004, Appl. Artif. Intell..

[40]  Andrew Howard,et al.  Design and use paradigms for Gazebo, an open-source multi-robot simulator , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).