Estimating tactile data for adaptive grasping of novel objects

We present an adaptive grasping method that finds stable grasps on novel objects. The main contributions of this paper is in the computation of the probability of success of grasps in the vicinity of an already applied grasp. Our method performs adaptions by simulating tactile data for grasps in the vicinity of the current grasp. The simulated data is used to evaluate hypothetical configurations and thereby guide the robot in the right direction. We demonstrate the applicability of our method by constructing a system that can plan, apply and adapt grasps on novel objects. Experiments are conducted on objects from the YCB object set, [1], and our method increases the robot's success rate from 71.4% to 88.1%. Our experiments show that the application of our grasp adaption method improves grasp stability significantly.

[1]  Imin Kao,et al.  Grasping, manipulation, and control with tactile sensing , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[2]  R S Johansson,et al.  Sensory input and control of grip. , 1998, Novartis Foundation symposium.

[3]  Tony Wong,et al.  Unsupervised feature learning for classifying dynamic tactile events using sparse coding , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Danica Kragic,et al.  Learning the tactile signatures of prototypical object parts for robust part-based grasping of novel objects , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[5]  Danica Kragic,et al.  Learning a dictionary of prototypical grasp-predicting parts from grasping experience , 2013, 2013 IEEE International Conference on Robotics and Automation.

[6]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[7]  Danica Kragic,et al.  Probabilistic consolidation of grasp experience , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Danica Kragic,et al.  ST-HMP: Unsupervised Spatio-Temporal feature learning for tactile data , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Danica Kragic,et al.  Learning of grasp adaptation through experience and tactile sensing , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[10]  Martin V. Butz,et al.  Self-supervised regrasping using spatio-temporal tactile features and reinforcement learning , 2016, IROS 2016.

[11]  Peter K. Allen,et al.  Pose error robust grasping from contact wrench space metrics , 2012, 2012 IEEE International Conference on Robotics and Automation.

[12]  Peter K. Allen,et al.  Grasp adjustment on novel objects using tactile experience from similar local geometry , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Jan Peters,et al.  Stabilizing novel objects by learning to predict tactile slip , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[14]  Peter K. Allen,et al.  Learning grasp stability , 2012, 2012 IEEE International Conference on Robotics and Automation.

[15]  Matei T. Ciocarlie,et al.  Contact-reactive grasping of objects with partial shape information , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Yunyi Jia,et al.  Data correlation approach for slippage detection in robotic manipulations using tactile sensor array , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[17]  Robert D. Howe,et al.  Limits to compliance and the role of tactile sensing in grasping , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[18]  James J. Kuffner,et al.  Physically Based Grasp Quality Evaluation Under Pose Uncertainty , 2013, IEEE Transactions on Robotics.

[19]  John Kenneth Salisbury,et al.  Augmentation of grasp robustness using intrinsic tactile sensing , 1989, Proceedings, 1989 International Conference on Robotics and Automation.

[20]  Gaurav S. Sukhatme,et al.  Force estimation and slip detection/classification for grip control using a biomimetic tactile sensor , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[21]  Aude Billard,et al.  Bimanual compliant tactile exploration for grasping unknown objects , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[22]  Danica Kragic,et al.  Analytic grasp success prediction with tactile feedback , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[23]  Robert D. Howe,et al.  Variability and predictability in tactile sensing during grasping , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[24]  Gaurav S. Sukhatme,et al.  Generalizing Regrasping with Supervised Policy Learning , 2016, ISER.

[25]  Ville Kyrki,et al.  Towards informative sensor-based grasp planning , 2014, Robotics Auton. Syst..

[26]  Gaurav S. Sukhatme,et al.  Self-supervised regrasping using spatio-temporal tactile features and reinforcement learning , 2016, 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[27]  Danica Kragic,et al.  Learning tactile characterizations of object- and pose-specific grasps , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[28]  Peter K. Allen,et al.  Stable grasping under pose uncertainty using tactile feedback , 2014, Auton. Robots.

[29]  Danica Kragic,et al.  Data-Driven Grasp Synthesis—A Survey , 2013, IEEE Transactions on Robotics.