Representation and Integration: Combining Robot Control, High-Level Planning, and Action Learning

We describe an approach to integrated robot control, high-level planning, and action effect learning that attempts to overcome the representational difficulties that exist between these diverse areas. Our approach combines ideas from robot vision, knowledgelevel planning, and connectionist machine learning, and focuses on the representational needs of these components. We also make use of a simple representational unit called an instantiated state transition fragment (ISTF) and a related structure called an object-action complex (OAC). The goal of this work is a general approach for inducing high-level action specifications, suitable for planning, from a robot’s interactions with the world. We present a detailed overview of our approach and show how it supports the learning of certain aspects of a high-level representation from low-level world state information.

[1]  Danica Kragic,et al.  Early reactive grasping with second order 3D feature relations , 2007 .

[2]  Benjamin Kuipers,et al.  Where Do Actions Come From? Autonomous Robot Learning of Objects and Actions , 2007, AAAI Spring Symposium: Control Mechanisms for Spatial Knowledge Processing in Cognitive / Intelligent Systems.

[3]  Fahiem Bacchus,et al.  A Knowledge-Based Approach to Planning with Incomplete Information and Sensing , 2002, AIPS.

[4]  F ROSENBLATT,et al.  The perceptron: a probabilistic model for information storage and organization in the brain. , 1958, Psychological review.

[5]  Danica Kragic,et al.  Birth of the Object: Detection of Objectness and Extraction of Object Shape through Object-Action complexes , 2008, Int. J. Humanoid Robotics.

[6]  Danica Kragic,et al.  Vision for robotic object manipulation in domestic settings , 2005, Robotics Auton. Syst..

[7]  Fahiem Bacchus,et al.  Extending the Knowledge-Based Approach to Planning with Incomplete Information and Sensing , 2004, ICAPS.

[8]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[9]  Xuemei Wang,et al.  Learning by Observation and Practice: An Incremental Approach for Planning Operator Acquisition , 1995, ICML.

[10]  Christopher W. Geib,et al.  Object Action Complexes as an Interface for Planning and Robot Control , 2006 .

[11]  Justus H. Piater,et al.  Probabilistic Pose Recovery Using Learned Hierarchical Object Models , 2009, ICVW.

[12]  Maya Cakmak,et al.  From primitive behaviors to goal-directed behavior using affordances , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Florentin Wörgötter,et al.  Multi-modal Scene Reconstruction using Perceptual Grouping Constraints , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[14]  Charles Lee Isbell,et al.  Schema Learning: Experience-Based Construction of Predictive Action Models , 2004, NIPS.

[15]  Alex M. Andrew,et al.  Knowledge in Action: Logical Foundations for Specifying and Implementing Dynamical Systems , 2002 .

[16]  Yoav Freund,et al.  Large Margin Classification Using the Perceptron Algorithm , 1998, COLT' 98.

[17]  Mark Steedman,et al.  Exploration and Planning in a Three-Level Cognitive Architecture , 2008 .

[18]  Florentin Wörgötter,et al.  Editorial: ECOVISION: Challenges in Early-Cognitive Vision , 2007, International Journal of Computer Vision.

[19]  Rocco A. Servedio,et al.  Efficiency versus Convergence of Boolean Kernels for On-Line Learning Algorithms , 2001, NIPS.

[20]  Ken Sadohara,et al.  Learning of Boolean Functions Using Support Vector Machines , 2001, ALT.

[21]  L. P. Kaelbling,et al.  Learning Symbolic Models of Stochastic Domains , 2007, J. Artif. Intell. Res..

[22]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[23]  Edwin P. D. Pednault,et al.  ADL: Exploring the Middle Ground Between STRIPS and the Situation Calculus , 1989, KR.

[24]  Roni Khardon,et al.  Noise Tolerant Variants of the Perceptron Algorithm , 2007, J. Mach. Learn. Res..

[25]  Mark Steedman,et al.  Plans, Affordances, And Combinatory Grammar , 2002 .

[26]  Dafna Shahaf,et al.  Learning Partially Observable Action Schemas , 2006, AAAI.

[27]  Yolanda Gil,et al.  Learning by Experimentation: Incremental Refinement of Incomplete Planning Domains , 1994, International Conference on Machine Learning.

[28]  Mark Steedman,et al.  Using Kernel Perceptrons to Learn Action Effects for Planning , 2008 .

[29]  Simon Parsons,et al.  Knowledge in action: Logical foundations for specifying and implementing dynamical systems by Raymond Reiter, MIT Press, 0-262-18218-1, 448 pp., $60.00/£38.95 , 2005, The Knowledge Engineering Review.

[30]  Albert B Novikoff,et al.  ON CONVERGENCE PROOFS FOR PERCEPTRONS , 1963 .

[31]  M. Aizerman,et al.  Theoretical Foundations of the Potential Function Method in Pattern Recognition Learning , 1964 .

[32]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .