Combining analysis, imitation, and experience-based learning to acquire a concept of reachability in robot mobile manipulation

Analytic modeling, imitation, and experience-based learning are three approaches that enable robots to acquire models of their morphology and skills. In this paper, we combine these three approaches to efficiently gather training data to learn a model of reachability for a typical mobile manipulation task: approaching a worksurface in order to grasp an object. The core of the approach is experience-based learning. For more effective exploration, we use capability maps [20] as analytic models of the robot's dexterity to constrain the area in which the robot gathers training data. Furthermore, we acquire a human model of reachability from human motion data [17] and use it to bias exploration. The acquired training data is used to learn Action-Related Places [16]. In an empirical evaluation we demonstrate that combining the three approaches enables the robot to acquire accurate models with far less data than with our previous exploration strategy.

[1]  Michael Beetz,et al.  Tracking humans interacting with the environment using efficient hierarchical sampling and layered observation models , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[2]  Dmitry Berenson,et al.  An optimization approach to planning for mobile manipulation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[3]  Moritz Tenorth,et al.  KNOWROB — knowledge processing for autonomous personal robots , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Oliver Brock,et al.  BiSpace Planning: Concurrent Multi-Space Exploration , 2009 .

[5]  Michael Beetz,et al.  Generality and legibility in mobile manipulation , 2010, Auton. Robots.

[6]  Gerd Hirzinger,et al.  Capturing robot workspace structure: representing robot capabilities , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Alcherio Martinoli,et al.  A quantitative method for comparing trajectories of mobile robots using point distribution models , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[8]  Stephen Hart,et al.  A Framework for Learning Declarative Structure , 2006 .

[9]  Masayuki Inaba,et al.  Vision based behavior verification system of humanoid robot for daily environment tasks , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[10]  Seth Hutchinson,et al.  Using manipulability to bias sampling during the construction of probabilistic roadmaps , 2003, IEEE Trans. Robotics Autom..

[11]  Moritz Tenorth,et al.  The TUM Kitchen Data Set of everyday manipulation activities for motion tracking and action recognition , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[12]  Martin A. Riedmiller,et al.  Learning Situation Dependent Success Rates of Actions in a RoboCup Scenario , 2000, PRICAI.

[13]  E. Torres-Jara,et al.  Challenges for Robot Manipulation in Human Environments , 2006 .

[14]  Charles C. Kemp,et al.  Challenges for robot manipulation in human environments [Grand Challenges of Robotics] , 2007, IEEE Robotics & Automation Magazine.

[15]  Bernd Radig,et al.  Learning Local Objective Functions for Robust Face Model Fitting , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  N. Kruger,et al.  Learning object-specific grasp affordance densities , 2009, 2009 IEEE 8th International Conference on Development and Learning.

[17]  Siddhartha S. Srinivasa,et al.  Manipulation planning with Workspace Goal Regions , 2009, 2009 IEEE International Conference on Robotics and Automation.

[18]  Michael Beetz,et al.  Action-related place-based mobile manipulation , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Michael Beetz,et al.  3D model selection from an internet database for robotic vision , 2009, 2009 IEEE International Conference on Robotics and Automation.

[20]  Benjamin Kuipers,et al.  Bootstrap learning of foundational representations , 2006, Connect. Sci..

[21]  Michael Beetz,et al.  Refining the Execution of Abstract Actions with Learned Action Models , 2008, J. Artif. Intell. Res..