Imitation Learning of Whole-Body Grasps

A system is detailed here for using imitation learning to teach a robot to grasp objects using both hand and whole-body grasps, which use the arms and torso as well as hands. Demonstration grasp trajectories are created by teleoperating a simulated robot to pick up simulated objects, modeled as combinations of up to three aligned primitives - boxes, cylinders, and spheres. When presented with a target object, the system compares it against the objects in a stored database to pick a demonstrated grasp used on a similar object. By considering the target object to be a transformed version of the demonstration object, contact points are mapped from one object to the other. The most promising grasp candidate is chosen with the aid of a grasp quality metric. To test the success of the chosen grasp, a collision-free grasp trajectory is found and an attempt is made to execute it in simulation. The implemented system successfully picks up 92 out of 100 randomly generated test objects in simulation

[1]  S. Shankar Sastry,et al.  Task-oriented optimal grasping by multifingered robot hands , 1987, IEEE J. Robotics Autom..

[2]  Van-Duc Nguyen,et al.  Constructing Force- Closure Grasps , 1988, Int. J. Robotics Res..

[3]  R. Howe,et al.  Human grasp choice and robotic grasp analysis , 1990 .

[4]  Christine L. MacKenzie,et al.  Opposition space and human prehension , 1990 .

[5]  GirardMichael,et al.  Computer animation of knowledge-based human grasping , 1991 .

[6]  Katsushi Ikeuchi,et al.  A Framework for Recognizing Grasps , 1991 .

[7]  Michael Girard,et al.  Computer animation of knowledge-based human grasping , 1991, SIGGRAPH.

[8]  Patrick A. O'Donnell,et al.  HANDEY: A Robot Task Planner , 1992 .

[9]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[10]  Katsushi Ikeuchi,et al.  Toward automatic robot instruction from perception-recognizing a grasp from observation , 1993, IEEE Trans. Robotics Autom..

[11]  Huan Liu,et al.  Knowledge-based control of grasping in robot hands using heuristics from human motor skills , 1993, IEEE Trans. Robotics Autom..

[12]  Daniel Thalmann,et al.  A Hand Control and Automatic Grasping System for Synthetic Actors , 1994, Comput. Graph. Forum.

[13]  Antonio Bicchi,et al.  On the problem of decomposing grasp and manipulation forces in multiple whole-limb manipulation , 1994, Robotics Auton. Syst..

[14]  Jian L. Zhou,et al.  User's Guide for CFSQP Version 2.0: A C Code for Solving (Large Scale) Constrained Nonlinear (Minimax) Optimization Problems, Generating Iterates Satisfying All Inequality Constraints , 1994 .

[15]  Tomoichi Takahashi,et al.  Robotic assembly operation teaching in a virtual environment , 1994, IEEE Trans. Robotics Autom..

[16]  Masayuki Inaba,et al.  Learning by watching: extracting reusable task knowledge from visual observation of human performance , 1994, IEEE Trans. Robotics Autom..

[17]  Avinash C. Kak,et al.  Automatic learning of assembly tasks using a DataGlove system , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[18]  Shimon Edelman,et al.  Learning to grasp using visual information , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[19]  B. Faverjon,et al.  Probabilistic Roadmaps for Path Planning in High-Dimensional Con(cid:12)guration Spaces , 1996 .

[20]  G. V. Paul,et al.  Modelling human assembly actions from observation , 1996, 1996 IEEE/SICE/RSJ International Conference on Multisensor Fusion and Integration for Intelligent Systems (Cat. No.96TH8242).

[21]  Nancy S. Pollard,et al.  Synthesizing grasps from generalized prototypes , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[22]  Matthew Brand,et al.  Understanding manipulation in video , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[23]  Jean-Daniel Boissonnat,et al.  On Computing Four-Finger Equilibrium and Force-Closure Grasps of Polyhedral Objects , 1997, Int. J. Robotics Res..

[24]  Laurent Moccozet,et al.  Virtual hand interactions with 3D world , 1997 .

[25]  Jerome A. Feldman,et al.  Extending Embodied Lexical Development , 1998 .

[26]  Gerd Hirzinger,et al.  A fast and robust grasp planner for arbitrary 3D objects , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[27]  Stefan Schaal,et al.  Is imitation learning the route to humanoid robots? , 1999, Trends in Cognitive Sciences.

[28]  Antonio Bicchi,et al.  Hands for dexterous manipulation and robust grasping: a difficult road toward simplicity , 2000, IEEE Trans. Robotics Autom..

[29]  Gérard G. Medioni,et al.  3D structures for generic object recognition , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[30]  Jeffrey Mark Siskind,et al.  Visual Event Classification via Force Dynamics , 2000, AAAI/IAAI.

[31]  Maja J. Matarić,et al.  Primitive-Based Movement Classification for Humanoid Imitation , 2000 .

[32]  Xiangyang Zhu,et al.  A quantitative measure for multi-fingered grasps , 2001, 2001 IEEE/ASME International Conference on Advanced Intelligent Mechatronics. Proceedings (Cat. No.01TH8556).

[33]  Justus H. Piater,et al.  Developing haptic and visual perceptual categories for reaching and grasping with a humanoid robot , 2001, Robotics Auton. Syst..

[34]  Robert Platt,et al.  Nullspace composition of control laws for grasping , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[35]  R. Dillmann,et al.  Programming service tasks in household environments by human demonstration , 2002, Proceedings. 11th IEEE International Workshop on Robot and Human Interactive Communication.

[36]  S. Sitharama Iyengar,et al.  Experience-based language acquisition: a computational model of human language acquisition , 2002 .

[37]  Henrik I. Christensen,et al.  Automatic grasp planning using shape primitives , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[38]  Robert Platt,et al.  Extending fingertip grasping to whole body grasping , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[39]  W. Press,et al.  Numerical Recipes in C++: The Art of Scientific Computing (2nd edn)1 Numerical Recipes Example Book (C++) (2nd edn)2 Numerical Recipes Multi-Language Code CD ROM with LINUX or UNIX Single-Screen License Revised Version3 , 2003 .

[40]  Morten Strandberg,et al.  Robot path planning : an object-oriented approach , 2004 .

[41]  Thierry Siméon,et al.  Manipulation Planning with Probabilistic Roadmaps , 2004, Int. J. Robotics Res..

[42]  Ying Li,et al.  A shape matching algorithm for synthesizing humanlike enveloping grasps , 2005, 5th IEEE-RAS International Conference on Humanoid Robots, 2005..