A unified representation for reasoning about robot actions, processes, and their effects on objects

Mobile manipulation robots are becoming more and more common and begin to extend their task spectrum towards more general housework activities. The sequence of actions needed to accomplish such tasks can be obtained from instructions on the Internet originally written for humans. While giving valuable information about the types of actions and some of their parameters, these instructions usually lack information that humans consider to be obvious. In this paper, we investigate how we can equip robots with sufficient knowledge and inference mechanisms to competently detect and fill such knowledge gaps in descriptions of everyday activities. We present methods for projecting the effects of actions and processes, for inferring action parameters like the objects and locations to be used, and introduce representations for reasoning about object transformations resulting from the effects of actions.

[1]  Michael Beetz,et al.  Using Physics- and Sensor-based Simulation for High-Fidelity Temporal Projection of Realistic Robot Behavior , 2009, ICAPS.

[2]  A. T. Schreiber,et al.  Prolog-based infrastructure for RDF: performance and scalability , 2003 .

[3]  Yarden Katz,et al.  Pellet: A practical OWL-DL reasoner , 2007, J. Web Semant..

[4]  Dejan Pangercic,et al.  Web-enabled Robots -- Robots that Use the Web as an Information Resource , 2011, ICRA 2011.

[5]  Kenneth D. Forbus.  Qualitative Process Theory , 1984, Artif. Intell..

[6]  Moritz Tenorth,et al.  CRAM — A Cognitive Robot Abstract Machine for everyday manipulation in human environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Chitta Baral,et al.  On Representing Actions in Multi-agent Domains , 2011, Logic Programming, Knowledge Representation, and Nonmonotonic Reasoning.

[8]  M Tenorth,et al.  Web-Enabled Robots , 2011, IEEE Robotics & Automation Magazine.

[9]  Shuichi Nishio,et al.  Cloud networked robotics , 2012, IEEE Network.

[10]  Jiayu Zhou,et al.  Using inverse λ and generalization to translate English to formal languages , 2011 .

[11]  Volker Haarslev,et al.  RACER System Description , 2001, IJCAR.

[12]  Dejan Pangercic,et al.  Robotic roommates making pancakes , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[13]  Moritz Tenorth,et al.  KNOWROB — knowledge processing for autonomous personal robots , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Moritz Tenorth,et al.  Understanding and executing instructions for everyday manipulation tasks from the World Wide Web , 2010, 2010 IEEE International Conference on Robotics and Automation.

[15]  Mir Saman Rahimi Mousavi,et al.  Optimal Trajectory Planning for Brachiation Robot on Ladder With Irregular Branches , 2011 .

[16]  Luke S. Zettlemoyer,et al.  A Joint Model of Language and Perception for Grounded Attribute Learning , 2012, ICML.

[17]  Boris Motik,et al.  OWL 2 Web Ontology Language: structural specification and functional-style syntax , 2008 .

[18]  Drew McDermott,et al.  Robot Planning , 1991, AI Mag..

[19]  Ufuk Topcu,et al.  Correct, Reactive, High-Level Robot Control , 2011, IEEE Robotics & Automation Magazine.

[20]  Michael Beetz,et al.  Simulation-based temporal projection of everyday robot object manipulation , 2011, AAMAS.

[21]  Luke S. Zettlemoyer,et al.  Reading between the Lines: Learning to Map High-Level Instructions to Commands , 2010, ACL.

[22]  Douglas B. Lenat,et al.  CYC: a large-scale investment in knowledge infrastructure , 1995, CACM.

[23]  John Eric Anderson,et al.  Constraint-directed improvisation for everyday activities , 1995 .

[24]  Jiayu Zhou,et al.  Using Inverse lambda and Generalization to Translate English to Formal Languages , 2011, IWCS.

[25]  Michael Beetz,et al.  Parameterizing actions to have the appropriate effects , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[27]  James A. Hendler,et al.  HTN Planning: Complexity and Expressivity , 1994, AAAI.

[28]  Hadas Kress-Gazit,et al.  Temporal-Logic-Based Reactive Mission and Motion Planning , 2009, IEEE Transactions on Robotics.

[29]  Boris Motik,et al.  HermiT: A Highly-Efficient OWL Reasoner , 2008, OWLED.

[30]  Moritz Tenorth,et al.  KNOWROB-MAP - knowledge-linked semantic object maps , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[31]  Michael Beetz,et al.  Towards semantic robot description languages , 2011, 2011 IEEE International Conference on Robotics and Automation.

[32]  Dejan Pangercic,et al.  Combining perception and knowledge processing for everyday manipulation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[33]  Moritz Tenorth,et al.  Learning organizational principles in human environments , 2012, 2012 IEEE International Conference on Robotics and Automation.