On the evolution of fingertip grasping manifolds

Efficient and accurate planning of fingertip grasps is essential for dexterous in-hand manipulation. In this work, we present a system for fingertip grasp planning that incrementally learns a heuristic for hand reachability and multi-fingered inverse kinematics. The system consists of an online execution module and an offline optimization module. During execution the system plans and executes fingertip grasps using Canny's grasp quality metric and a learned random forest based hand reachability heuristic. In the offline module, this heuristic is improved based on a grasping manifold that is incrementally learned from the experiences collected during execution. The system is evaluated both in simulation and on a Schunk-SDH dexterous hand mounted on a KUKA-KR5 arm. We show that, as the grasping manifold is adapted to the system's experiences, the heuristic becomes more accurate, which results in an improved performance of the execution module. The improvement is not only observed for experienced objects, but also for previously unknown objects of similar sizes.

[1]  Gerd Hirzinger,et al.  Calculating hand configurations for precision and pinch grasps , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[3]  D. joyce.  On manifolds with corners , 2009, 0910.3518.

[4]  Gerd Hirzinger,et al.  Online generation of reachable grasps for dexterous manipulation using a representation of the reachable workspace , 2009, 2009 International Conference on Advanced Robotics.

[5]  Anis Sahbani,et al.  An overview of 3D object grasp synthesis algorithms , 2012, Robotics Auton. Syst..

[6]  Antonio Criminisi,et al.  Decision Forests: A Unified Framework for Classification, Regression, Density Estimation, Manifold Learning and Semi-Supervised Learning , 2012, Found. Trends Comput. Graph. Vis..

[7]  Takeo Kanade,et al.  Automated Construction of Robotic Manipulation Programs , 2010 .

[8]  Danica Kragic,et al.  Data-Driven Grasp Synthesis—A Survey , 2013, IEEE Transactions on Robotics.

[9]  Rafael Aracil,et al.  Kinematic Redundancy in Robot Grasp Synthesis. An Efficient Tree-based Representation , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[10]  Giorgio Metta,et al.  Three-finger precision grasp on incomplete 3D point clouds , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Dmitry Berenson,et al.  Humanoid motion planning for dual-arm manipulation and re-grasping tasks , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[13]  Gerd Hirzinger,et al.  Grasping the dice by dicing the grasp , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[14]  Anis Sahbani,et al.  A new strategy combining empirical and analytical approaches for grasping unknown 3D objects , 2010, Robotics Auton. Syst..

[15]  Daniel Sidobre,et al.  Efficient models for grasp planning with a multi-fingered hand , 2012, Robotics Auton. Syst..

[16]  Danica Kragic,et al.  Friction coefficients and grasp synthesis , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Aude Billard,et al.  Iterative learning of grasp adaptation through human corrections , 2012, Robotics Auton. Syst..

[18]  Máximo A. Roa,et al.  Computation of Independent Contact Regions for Grasping 3-D Objects , 2009, IEEE Transactions on Robotics.

[19]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[20]  Aude Billard,et al.  Bridging the Gap: One shot grasp synthesis approach , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Danica Kragic,et al.  SimTrack: A simulation-based framework for scalable real-time object pose detection and tracking , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[22]  Danica Kragic,et al.  Hierarchical Fingertip Space for multi-fingered precision grasping , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Hongguang Wang,et al.  Kinematic feasibility analysis of 3-D multifingered grasp , 2009, 2009 Chinese Control and Decision Conference.

[24]  Danica Kragic,et al.  Classical grasp quality evaluation: New algorithms and theory , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Josep M. Porta,et al.  Finding all valid hand configurations for a given precision grasp , 2008, 2008 IEEE International Conference on Robotics and Automation.

[26]  Tamim Asfour,et al.  Bimanual grasp planning , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[27]  Máximo A. Roa,et al.  Planning in-hand object manipulation with multifingered hands considering task constraints , 2013, 2013 IEEE International Conference on Robotics and Automation.