GP-GPIS-OPT: Grasp planning with shape uncertainty using Gaussian process implicit surfaces and Sequential Convex Programming

Computing grasps for an object is challenging when the object geometry is not known precisely. In this paper, we explore the use of Gaussian process implicit surfaces (GPISs) to represent shape uncertainty from RGBD point cloud observations of objects. We study the use of GPIS representations to select grasps on previously unknown objects, measuring grasp quality by the probability of force closure. Our main contribution is GP-GPIS-OPT, an algorithm for computing grasps for parallel-jaw grippers on 2D GPIS object representations. Specifically, our method optimizes an approximation to the probability of force closure subject to antipodal constraints on the parallel jaws using Sequential Convex Programming (SCP). We also introduce GPIS-Blur, a method for visualizing 2D GPIS models based on blending shape samples from a GPIS. We test the algorithm on a set of 8 planar objects with transparency, translucency, and specularity. Our experiments suggest that GP-GPIS-OPT computes grasps with higher probability of force closure than a planner that does not consider shape uncertainty on our test objects and may converge to a grasp plan up to 5.7×faster than using Monte-Carlo integration, a common method for grasp planning under shape uncertainty. Furthermore, initial experiments on the Willow Garage PR2 robot suggest that grasps selected with GP-GPIS-OPT are up to 90% more successful than those planned assuming a deterministic shape. Our dataset, code, and videos of our experiments are available at http://rll.berkeley.edu/icra2015grasping/.

[1]  Benjamin W. Mooring,et al.  Determination and specification of robot repeatability , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[2]  Kenneth Y. Goldberg,et al.  Bayesian grasping , 1990, Proceedings., IEEE International Conference on Robotics and Automation.

[3]  Ken Goldberg,et al.  Stochastic plans for robotic manipulation , 1991 .

[4]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[5]  Joel W. Burdick,et al.  Finding antipodal point grasps on irregularly shaped objects , 1992, IEEE Trans. Robotics Autom..

[6]  Marc Levoy,et al.  A volumetric method for building complex models from range images , 1996, SIGGRAPH.

[7]  J. Alex Stark,et al.  Adaptive image contrast enhancement using generalizations of histogram equalization , 2000, IEEE Trans. Image Process..

[8]  D K Smith,et al.  Numerical Optimization , 2001, J. Oper. Res. Soc..

[9]  Carl E. Rasmussen,et al.  Derivative Observations in Gaussian Process Models of Dynamic Systems , 2002, NIPS.

[10]  Xin Wang,et al.  On quality functions for grasp synthesis, fixture planning, and coordinated manipulation , 2004, IEEE Transactions on Automation Science and Engineering.

[11]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[12]  Bernhard Schölkopf,et al.  Support Vector Machines for 3D Shape Processing , 2005, Comput. Graph. Forum.

[13]  William J. Wilson,et al.  Multivariate Statistical Methods , 2005, Technometrics.

[14]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[15]  Andrew Fitzgibbon,et al.  Gaussian Process Implicit Surfaces , 2006 .

[16]  Stephen P. Boyd,et al.  Disciplined Convex Programming , 2006 .

[17]  Matei T. Ciocarlie,et al.  Dimensionality reduction for hand-independent dexterous robotic grasping , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Gene H. Golub,et al.  Generalized cross-validation as a method for choosing a good ridge parameter , 1979, Milestones in Matrix Computation.

[19]  Paul R. Schrater,et al.  Handling shape and contact location uncertainty in grasping two-dimensional planar objects , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Jean Ponce,et al.  Carved Visual Hulls for Image-Based Modeling , 2006, International Journal of Computer Vision.

[21]  Paul R. Schrater,et al.  Grasping Objects with Environmentally Induced Position Uncertainty , 2009, PLoS Comput. Biol..

[22]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[23]  Máximo A. Roa,et al.  Computation of Independent Contact Regions for Grasping 3-D Objects , 2009, IEEE Transactions on Robotics.

[24]  M. Roa,et al.  Finding locally optimum force-closure grasps , 2009 .

[25]  Andreas Krause,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2009, IEEE Transactions on Information Theory.

[26]  Stefan Ulbrich,et al.  OpenGRASP: A Toolkit for Robot Grasping Simulation , 2010, SIMPAR.

[27]  A. Frank van der Stappen,et al.  Output-Sensitive Computation of Force-Closure Grasps of a Semi-Algebraic Object , 2011, IEEE Transactions on Automation Science and Engineering.

[28]  Peter Brook,et al.  Bayesian Grasp Planning , 2011 .

[29]  Matei T. Ciocarlie,et al.  Collaborative grasp planning with multiple object representations , 2011, 2011 IEEE International Conference on Robotics and Automation.

[30]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[31]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[32]  Marc Toussaint,et al.  Gaussian process implicit surfaces for shape estimation and grasping , 2011, 2011 IEEE International Conference on Robotics and Automation.

[33]  Dmitry Berenson,et al.  Toward cloud-based grasping with uncertainty in shape: Estimating lower bounds on achieving force closure with zero-slip push grasps , 2012, 2012 IEEE International Conference on Robotics and Automation.

[34]  James J. Kuffner,et al.  Physically-based grasp quality evaluation under uncertainty , 2012, 2012 IEEE International Conference on Robotics and Automation.

[35]  Dmitry Berenson,et al.  Estimating part tolerance bounds based on adaptive Cloud-based grasp planning with slip , 2012, 2012 IEEE International Conference on Automation Science and Engineering (CASE).

[36]  Daniel Herrera C,et al.  Joint depth and color camera calibration with distortion correction. , 2012, IEEE transactions on pattern analysis and machine intelligence.

[37]  Peter K. Allen,et al.  Pose error robust grasping from contact wrench space metrics , 2012, 2012 IEEE International Conference on Robotics and Automation.

[38]  王军,et al.  Efficient Euclidean Distance Transform Algorithm of Binary Images in Arbitrary Dimensions , 2012 .

[39]  Geoffrey A. Hollinger,et al.  Uncertainty-driven view planning for underwater inspection , 2012, 2012 IEEE International Conference on Robotics and Automation.

[40]  Ville Kyrki,et al.  Probabilistic sensor-based grasping , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Danica Kragic,et al.  Grasp Moduli Spaces , 2013, Robotics: Science and Systems.

[42]  Danica Kragic,et al.  Enhancing visual perception of shape through tactile glances , 2013, 2013 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[43]  Marc Toussaint,et al.  Uncertainty aware grasping and tactile exploration , 2013, 2013 IEEE International Conference on Robotics and Automation.

[44]  Geoffrey A. Hollinger,et al.  Active planning for underwater inspection and the benefit of adaptivity , 2012, Int. J. Robotics Res..

[45]  Jeannette Bohg,et al.  Fusing visual and tactile sensing for 3-D object reconstruction while grasping , 2013, 2013 IEEE International Conference on Robotics and Automation.

[46]  Pieter Abbeel,et al.  Finding Locally Optimal, Collision-Free Trajectories with Sequential Convex Optimization , 2013, Robotics: Science and Systems.

[47]  Alkis Gotovos,et al.  Active Learning for Level Set Estimation , 2022 .

[48]  Florian T. Pokorny,et al.  Budgeted Multi-Armed Bandit Models for Sample-Based Grasp Planning in the Presence of Uncertainty , 2014 .

[49]  Mansoor Davoodi Monfared,et al.  Orienting Parts With Shape Variation , 2017, IEEE Transactions on Automation Science and Engineering.