Robot Grasp Learning by Demonstration without Predefined Rules

A learning-based approach to autonomous robot grasping is presented. Pattern recognition techniques are used to measure the similarity between a set of previously stored example grasps and all the possible candidate grasps for a new object. Two sets of features are defined in order to characterize grasps: point attributes describe the surroundings of a contact point; point-set attributes describe the relationship between the set of n contact points (assuming an n-fingered robot gripper is used). In the experiments performed, the nearest neighbour classifier outperforms other approaches like multilayer perceptrons, radial basis functions or decision trees, in terms of classification accuracy, while computational load is not excessive for a real time application (a grasp is fully synthesized in 0.2 seconds). The results obtained on a synthetic database show that the proposed system is able to imitate the grasping behaviour of the user (e.g. the system learns to grasp a mug by its handle). All the code has been made available for testing purposes.

[1]  Raúl Suárez,et al.  On 2D 4-finger frictionless optimal grasps , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[2]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[3]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[4]  J. Burdick,et al.  A configuration space analysis of bodies in contact. I: 1st order mobility , 1995 .

[5]  Shraga Shoval,et al.  On the Passive Force Closure Set of Planar Grasps and Fixtures , 2010, Int. J. Robotics Res..

[6]  Danica Kragic,et al.  Interactive grasp learning based on human demonstration , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[7]  Ian H. Witten,et al.  Generating Accurate Rule Sets Without Global Optimization , 1998, ICML.

[8]  Shimon Edelman,et al.  Learning visually guided grasping: a test case in sensorimotor learning , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[9]  Christos H. Papadimitriou,et al.  Optimum Grip of a Polygon , 1987, Int. J. Robotics Res..

[10]  Máximo A. Roa,et al.  Computation of Independent Contact Regions for Grasping 3-D Objects , 2009, IEEE Transactions on Robotics.

[11]  Nancy S. Pollard,et al.  Synthesizing grasps from generalized prototypes , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[12]  Shimon Edelman,et al.  Learning to grasp using visual information , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[13]  Kenneth Y. Goldberg,et al.  D-space and deform closure: a framework for holding deformable parts , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[14]  John F. Canny,et al.  Easily computable optimum grasps in 2-D and 3-D , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[15]  Robert Platt,et al.  Null-Space Grasp Control: Theory and Experiments , 2010, IEEE Transactions on Robotics.

[16]  R. Howe,et al.  Human grasp choice and robotic grasp analysis , 1990 .

[17]  Luis Payá,et al.  Grasp feasibility computation based on cascading filters. application to a three fingered gripper , 2005, ICINCO.

[18]  Tomás Lozano-Pérez,et al.  Grasp stability and feasibility for an arm with an articulated hand , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[19]  Arthur C. Sanderson,et al.  Reachable grasps on a polygon: The convex rope algorithm , 1986, IEEE J. Robotics Autom..

[20]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[21]  Micha Sharir,et al.  On the existence and synthesis of multifinger positive grips , 2015, Algorithmica.

[22]  Philippe Martinet,et al.  Biologically-inspired 3D grasp synthesis based on visual exploration , 2008, Auton. Robots.

[23]  Jean-Daniel Boissonnat,et al.  On Computing Four-Finger Equilibrium and Force-Closure Grasps of Polyhedral Objects , 1997, Int. J. Robotics Res..

[24]  Jiawei Li,et al.  On Computing Three-Finger Force-Closure Grasps , 2003 .

[25]  Van-Duc Nguyen,et al.  Constructing force-closure grasps , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[26]  Antonio Morales,et al.  Using Experience for Assessing Grasp Reliability , 2004, Int. J. Humanoid Robotics.

[27]  Mark H. Overmars,et al.  Computing Immobilizing Grasps of Polygonal Parts , 2000, Int. J. Robotics Res..

[28]  Danica Kragic,et al.  Grasp recognition and mapping on humanoid robots , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[29]  B. Mishra Robotics,et al.  Grasp Metrics: Optimality and Complexity , 1995 .