Towards informative sensor-based grasp planning

This paper proposes a probabilistic framework for sensor-based grasping and describes how information about object attributes, such as position and orientation, can be updated using on-line sensor information gained during grasping. This allows learning about the target object even with a failed grasp, leading to replanning with improved performance at each successive attempt. Two grasp planning approaches utilizing the framework are proposed. Firstly, an approach maximizing the expected posterior stability of a grasp is suggested. Secondly, the approach is extended to use an entropy-based explorative procedure, which allows gathering more information when the current belief about the grasp stability does not allow robust grasping. In the framework, both object and grasp attributes as well as the stability of the grasp and on-line sensor information are represented by probabilistic models. Experiments show that the probabilistic treatment of grasping allows improving the probability of success in a series of grasping attempts. Moreover, experimental results on a real platform using the basic stability maximizing approach not only validate the proposed probabilistic framework but also show that under large initial uncertainties, explorative actions help to achieve successful grasps faster.

[1]  Peter Brook,et al.  Bayesian Grasp Planning , 2011 .

[2]  Ville Kyrki,et al.  Explorative Sensor-Based Grasp Planning , 2012, TAROS.

[3]  Heinz Wörn,et al.  Haptic object recognition using passive joints and haptic key features , 2010, 2010 IEEE International Conference on Robotics and Automation.

[4]  H. Haario,et al.  An adaptive Metropolis algorithm , 2001 .

[5]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[6]  Allison Ryan Information-Theoretic Tracking Control Based on Particle Filter Estimate , 2008 .

[7]  Peter K. Allen,et al.  Blind grasping: Stable robotic grasping using tactile feedback and hand kinematics , 2011, 2011 IEEE International Conference on Robotics and Automation.

[8]  M. Simandl,et al.  Differential entropy estimation by particles , 2011 .

[9]  Vijaykumar Gullapalli,et al.  Learning Control Under Extreme Uncertainty , 1992, NIPS.

[10]  Peter K. Allen,et al.  Pose error robust grasping from contact wrench space metrics , 2012, 2012 IEEE International Conference on Robotics and Automation.

[11]  Wolfram Burgard,et al.  Information Gain-based Exploration Using Rao-Blackwellized Particle Filters , 2005, Robotics: Science and Systems.

[12]  Wolfram Burgard,et al.  Recovering Particle Diversity in a Rao-Blackwellized Particle Filter for SLAM After Actively Closing Loops , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[13]  Robin Andrew Russell,et al.  Object recognition by a 'smart' tactile sensor , 2000 .

[14]  Jürgen Sturm,et al.  Tactile object class and internal state recognition for mobile manipulation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[15]  Robert Platt,et al.  Using Bayesian Filtering to Localize Flexible Materials During Manipulation , 2011, IEEE Transactions on Robotics.

[16]  Craig Corcoran,et al.  A measurement model for tracking hand-object state during dexterous manipulation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[17]  Leslie Pack Kaelbling,et al.  Task-Driven Tactile Exploration , 2010, Robotics: Science and Systems.

[18]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[19]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[20]  Oussama Khatib,et al.  Bayesian estimation for autonomous object manipulation based on tactile sensors , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[21]  Jeffrey C. Trinkle,et al.  The application of particle filtering to grasping acquisition with visual occlusion and tactile sensing , 2012, 2012 IEEE International Conference on Robotics and Automation.

[22]  Raúl Suárez Feijóo,et al.  Grasp quality measures , 2006 .

[23]  Stefan Schaal,et al.  Skill learning and task outcome prediction for manipulation , 2011, 2011 IEEE International Conference on Robotics and Automation.

[24]  Leslie Pack Kaelbling,et al.  Grasping POMDPs , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[25]  Zoubin Ghahramani,et al.  Sparse Gaussian Processes using Pseudo-inputs , 2005, NIPS.

[26]  Herman Bruyninckx,et al.  Markov techniques for object localisation with force-controlled robots , 2001 .

[27]  Jan Peters,et al.  Reinforcement Learning to Adjust Robot Movements to New Situations , 2010, IJCAI.

[28]  J. Laaksonen,et al.  Probabilistic Approach to Sensor-based Grasping , 2011 .

[29]  Michael S. Branicky,et al.  Particle filtering for localization in robotic assemblies with position uncertainty , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  John R. Hershey,et al.  Entropy-based motion selection for Touch-based registration using Rao-Blackwellized particle filtering , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[32]  Justus H. Piater,et al.  Refining grasp affordance models by experience , 2010, 2010 IEEE International Conference on Robotics and Automation.

[33]  Danica Kragic,et al.  Learning task constraints for robot grasping using graphical models , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Danica Kragic,et al.  Learning grasping affordance using probabilistic and ontological approaches , 2009, 2009 International Conference on Advanced Robotics.

[35]  Ville Kyrki,et al.  Probabilistic sensor-based grasping , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.