Hierarchical Fingertip Space: A Unified Framework for Grasp Planning and In-Hand Grasp Adaptation

We present a unified framework for grasp planning and in-hand grasp adaptation using visual, tactile, and proprioceptive feedback. The main objective of the proposed framework is to enable fingertip grasping by addressing problems of changed weight of the object, slippage, and external disturbances. For this purpose we introduce the Hierarchical Fingertip Space as a representation enabling optimization for both efficient grasp synthesis and online finger gaiting. Grasp synthesis is followed by a grasp adaptation step that consists of both grasp force adaptation through impedance control and regrasping/finger gaiting when the former is not sufficient. Experimental evaluation is conducted on an Allegro hand mounted on a Kuka LWR arm.

[1]  Tsuneo Yoshikawa,et al.  Manipulability of Robotic Mechanisms , 1985 .

[2]  Tiberiu T. Cocias,et al.  Multiple-superquadrics based object surface estimation for grasping in service robotics , 2012, 2012 13th International Conference on Optimization of Electrical and Electronic Equipment (OPTIM).

[3]  Masatsugu Iribe,et al.  Adaptive grasping by multi fingered hand with tactile sensor based on robust force and position control , 2008, 2008 IEEE International Conference on Robotics and Automation.

[4]  A. Morales,et al.  An Experiment in the Use of Manipulation Primitives and Tactile Perception for Reactive Grasping , 2007 .

[5]  Aude Billard,et al.  Bridging the Gap: One shot grasp synthesis approach , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Peter K. Allen,et al.  An SVM learning approach to robotic grasping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[7]  Stefano Caselli,et al.  A 3D shape segmentation approach for robot grasping by parts , 2012, Robotics Auton. Syst..

[8]  Anis Sahbani,et al.  Dexterous manipulation planning using probabilistic roadmaps in continuous grasp subspaces , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[9]  Danica Kragic,et al.  Learning of grasp adaptation through experience and tactile sensing , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Sachin Chitta,et al.  Human-Inspired Robotic Grasp Control With Tactile Sensing , 2011, IEEE Transactions on Robotics.

[11]  Jeffrey C. Trinkle,et al.  Dextrous manipulation by rolling and finger gaiting , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[12]  Kai Huebner.  BADGr - A toolbox for box-based approximation, decomposition and GRasping , 2012, Robotics Auton. Syst..

[13]  Danica Kragic,et al.  Combinatorial optimization for hierarchical contact-level grasping , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[14]  Hideki Hashimoto,et al.  Dextrous hand grasping force optimization , 1996, IEEE Trans. Robotics Autom..

[15]  Peter K. Allen,et al.  Blind grasping: Stable robotic grasping using tactile feedback and hand kinematics , 2011, 2011 IEEE International Conference on Robotics and Automation.

[16]  S. Shankar Sastry,et al.  Grasping and Coordinated Manipulation by a Multifingered Robot Hand , 1989, Int. J. Robotics Res..

[17]  Leifur Leifsson,et al.  Surrogate-Based Methods , 2011, Computational Optimization, Methods and Algorithms.

[18]  Danica Kragic,et al.  Classical grasp quality evaluation: New algorithms and theory , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Hong Liu,et al.  Cartesian impedance control for the DLR Hand , 1999, Proceedings 1999 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human and Environment Friendly Robots with High Intelligence and Emotional Quotients (Cat. No.99CH36289).

[20]  Aude Billard,et al.  Learning object-level impedance control for robust grasping and dexterous manipulation , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[21]  Josep M. Porta,et al.  Finding all valid hand configurations for a given precision grasp , 2008, 2008 IEEE International Conference on Robotics and Automation.

[22]  Masayuki Nakajima,et al.  Database guided computer animation of human grasping using forward and inverse kinematics , 1999, Comput. Graph..

[23]  Jun Wang,et al.  Grasping-force optimization for multifingered robotic hands using a recurrent neural network , 2004, IEEE Transactions on Robotics and Automation.

[24]  Máximo A. Roa,et al.  Computation of Independent Contact Regions for Grasping 3-D Objects , 2009, IEEE Transactions on Robotics.

[25]  Gerd Hirzinger,et al.  Grasping the dice by dicing the grasp , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[26]  Danica Kragic,et al.  Integrated motion and clasp planning with virtual linking , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Danica Kragic,et al.  A probabilistic framework for task-oriented grasp stability assessment , 2013, 2013 IEEE International Conference on Robotics and Automation.

[28]  Aude Billard,et al.  Iterative learning of grasp adaptation through human corrections , 2012, Robotics Auton. Syst..

[29]  Aude Billard,et al.  Learning a real time grasping strategy , 2013, 2013 IEEE International Conference on Robotics and Automation.

[30]  Peter K. Allen,et al.  Grasp adjustment on novel objects using tactile experience from similar local geometry , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Tamim Asfour,et al.  Bimanual grasp planning , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[32]  Stanley A. Schneider,et al.  Object impedance control for cooperative manipulation: theory and experimental results , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[33]  Markus Vincze,et al.  Efficient 3D Object Detection by Fitting Superquadrics to Range Image Data for Robot's Object Manipulation , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[34]  Tsuneo Yoshikawa,et al.  Coordinated Dynamic Hybrid Position/Force Control for Multiple Robot Manipulators Handling One Constrained Object , 1993, Int. J. Robotics Res..

[35]  Karun B. Shimoga,et al.  Robot Grasp Synthesis Algorithms: A Survey , 1996, Int. J. Robotics Res..

[36]  Daniel Sidobre,et al.  Efficient models for grasp planning with a multi-fingered hand , 2012, Robotics Auton. Syst..

[37]  Danica Kragic,et al.  Data-Driven Grasp Synthesis—A Survey , 2013, IEEE Transactions on Robotics.

[38]  Florian Schmidt,et al.  Sequential trajectory re-planning with tactile information gain for dexterous grasping under object-pose uncertainty , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[39]  Anis Sahbani,et al.  An overview of 3D object grasp synthesis algorithms , 2012, Robotics Auton. Syst..

[40]  Giorgio Metta,et al.  Three-finger precision grasp on incomplete 3D point clouds , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[41]  Gerd Hirzinger,et al.  Grasp planning: how to choose a suitable task wrench space , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[42]  Máximo A. Roa,et al.  Planning in-hand object manipulation with multifingered hands considering task constraints , 2013, 2013 IEEE International Conference on Robotics and Automation.

[43]  John F. Canny,et al.  Easily computable optimum grasps in 2-D and 3-D , 1994, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[44]  Robert Platt,et al.  Null-Space Grasp Control: Theory and Experiments , 2010, IEEE Transactions on Robotics.

[45]  Suguru Arimoto,et al.  Dynamic object manipulation using a virtual frame by a triple soft-fingered robotic hand , 2010, 2010 IEEE International Conference on Robotics and Automation.

[46]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[47]  Josep M. Porta,et al.  Grasp Optimization Under Specific Contact Constraints , 2013, IEEE Transactions on Robotics.

[48]  Alin Albu-Schäffer,et al.  Comparison of object-level grasp controllers for dynamic dexterous manipulation , 2012, Int. J. Robotics Res..

[49]  Danica Kragic,et al.  On the evolution of fingertip grasping manifolds , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[50]  Youlun Xiong,et al.  Neural-network based force planning for multifingered grasp , 1997, Robotics Auton. Syst..

[51]  Chris Walshaw,et al.  Multilevel Refinement for Combinatorial Optimisation Problems , 2004, Ann. Oper. Res..

[52]  Tamim Asfour,et al.  Planning grasps for robotic hands using a novel object representation based on the medial axis transform , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[53]  Matei T. Ciocarlie,et al.  Contact-reactive grasping of objects with partial shape information , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[54]  Dmitry Berenson,et al.  Grasp planning in complex scenes , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[55]  Motoji Yamamoto,et al.  Externally sensorless dynamic regrasping and manipulation by a triple-fingered robotic hand with torsional fingertip joints , 2012, 2012 IEEE International Conference on Robotics and Automation.

[56]  Aude Billard,et al.  Bimanual compliant tactile exploration for grasping unknown objects , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[57]  Tsuneo Yoshikawa,et al.  Multifingered robot hands: Control for grasping and manipulation , 2010, Annu. Rev. Control..

[58]  Vijay Kumar,et al.  Robotic grasping and contact: a review , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[59]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[60]  Danica Kragic,et al.  Grasping objects with holes: A topological approach , 2013, 2013 IEEE International Conference on Robotics and Automation.

[61]  Gerd Hirzinger,et al.  Calculating hand configurations for precision and pinch grasps , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[62]  Satoshi Kagami,et al.  Efficient prioritized inverse kinematic solutions for redundant manipulators , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[63]  Leslie Pack Kaelbling,et al.  Task-Driven Tactile Exploration , 2010, Robotics: Science and Systems.

[64]  Danica Kragic,et al.  Friction coefficients and grasp synthesis , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[65]  Danica Kragic,et al.  Hierarchical Fingertip Space for multi-fingered precision grasping , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[66]  M. Powell.  A Direct Search Optimization Method That Models the Objective and Constraint Functions by Linear Interpolation , 1994 .