Demonstration-based learning and control for automatic grasping

We present a method for automatic grasp generation based on object shape primitives in a Programming by Demonstration framework. The system first recognizes the grasp performed by a demonstrator as well as the object it is applied on and then generates a suitable grasping strategy on the robot. We start by presenting how to model and learn grasps and map them to robot hands. We continue by performing dynamic simulation of the grasp execution with a focus on grasping objects whose pose is not perfectly known.

[1]  J. Napier.  The prehensile movements of the human hand. , 1956, The Journal of bone and joint surgery. British volume.

[2]  Mark R. Cutkosky,et al.  On grasp choice, grasp models, and the design of hands for manufacturing tasks , 1989, IEEE Trans. Robotics Autom..

[3]  Thomas B. Sheridan,et al.  Variable force and visual feedback effects on teleoperator man/machine performance , 1989 .

[4]  Richard Volpe,et al.  A theoretical and experimental investigation of explicit force control strategies for manipulators , 1993, IEEE Trans. Autom. Control..

[5]  Robert D. Howe,et al.  Tactile sensing and control of robotic manipulation , 1993, Adv. Robotics.

[6]  Nancy S. Pollard,et al.  Parallel methods for synthesizing whole-hand grasps from generalized prototypes , 1994 .

[7]  Thea Iberall,et al.  Human Prehension and Dexterous Robot Hands , 1997, Int. J. Robotics Res..

[8]  Rüdiger Dillmann,et al.  Interactive Robot Programming Based on Human Demonstration and Advice , 1998, Sensor Based Intelligent Robots.

[9]  Mark Lee,et al.  Review Article Tactile sensing for mechatronics—a state of the art survey , 1999 .

[10]  Peter K. Allen,et al.  GraspIt!: A Versatile Simulator for Grasp Analysis , 2000, Dynamic Systems and Control: Volume 2.

[11]  Dan Ding,et al.  Computing 3-D optimal form-closure grasps , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[12]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[13]  Henrik I. Christensen,et al.  Automatic grasp planning using shape primitives , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[14]  Robert Platt,et al.  Extending fingertip grasping to whole body grasping , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[15]  Yoshiro Imai,et al.  Development of a high-speed multifingered hand system and its application to catching , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[16]  Hong Liu,et al.  DLR hand II: experiments and experience with an anthropomorphic hand , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[17]  Danica Kragic,et al.  Vision and tactile sensing for real world tasks , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[18]  Antonio Morales,et al.  Using Experience for Assessing Grasp Reliability , 2004, Int. J. Humanoid Robotics.

[19]  Nancy S. Pollard,et al.  Closure and Quality Equivalence for Efficient Synthesis of Grasps from Examples , 2004, Int. J. Robotics Res..

[20]  Stefano Caselli,et al.  Leveraging on a virtual environment for robot programming by demonstration , 2004, Robotics Auton. Syst..

[21]  Danica Kragic,et al.  Receptive field cooccurrence histograms for object detection , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  Danica Kragic,et al.  Grasp Recognition for Programming by Demonstration , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[23]  Danica Kragic,et al.  Object recognition and pose estimation using color cooccurrence histograms and geometric modeling , 2005, Image Vis. Comput..

[24]  Jan Wikander,et al.  Tactile sensing in intelligent robotic manipulation - a review , 2005, Ind. Robot.

[25]  Danica Kragic,et al.  Learning Task Models from Multiple Human Demonstrations , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[26]  Luca Viganò,et al.  Modelling and simulation of a gripper with Dymola , 2006 .

[27]  Volker Schmirgel,et al.  Mobile Manipulation Based on Generic Object Knowledge , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[28]  Robert Platt,et al.  Learning and generalizing control-based grasping and manipulation skills , 2006 .

[29]  Jan Wikander,et al.  A FRAMEWORK FOR GRASP SIMULATION AND CONTROL IN DOMESTIC ENVIRONMENTS , 2006 .

[30]  Paul Ciprian Patic,et al.  THE BARRETTHAND GRASPER - PROGRAMMABLY FLEXIBLE PART HANDLING AND ASSEMBLY , 2006 .

[31]  Rainer Palm,et al.  A Hand State Approach to Imitation with a Next-State-Planner for Industrial Manipulators , 2008 .

[32]  M. Shimojo,et al.  A system for simultaneously measuring grasping posture and pressure distribution , 1995, Proceedings of 1995 IEEE International Conference on Robotics and Automation.