Grasping novel objects with depth segmentation

We consider the task of grasping novel objects and cleaning fairly cluttered tables with many novel objects. Recent successful approaches employ machine learning algorithms to identify points on the scene that the robot should grasp. In this paper, we show that the task can be significantly simplified by using segmentation, especially with depth information. A supervised localization method is employed to select graspable segments. We also propose a shape completion and grasp planner method which takes partial 3D information and plans the most stable grasping strategy. Extensive experiments on our robot demonstrate the effectiveness of our approach.

[1]  H. Hanafusa,et al.  Stable Prehension by a Robot Hand with Elastic Fingers , 1977 .

[2]  J. Salisbury,et al.  Active stiffness control of a manipulator in cartesian coordinates , 1980, 1980 19th IEEE Conference on Decision and Control including the Symposium on Adaptive Processes.

[3]  Jr. J. Kenneth Salisbury,et al.  Kinematic and force analysis of articulated hands , 1982 .

[4]  B. Dizioglu,et al.  Mechanics of form closure , 1984 .

[5]  Mark R. Cutkosky,et al.  Mechanical Properties for the Grasp of a Robotic Hand , 1984 .

[6]  Van-Due Nguyen,et al.  Constructing stable force-closure grasps , 1986 .

[7]  Van-Duc Nguyen,et al.  Constructing Stable Grasps , 1989, Int. J. Robotics Res..

[8]  Jean Ponce,et al.  On Computing Two-Finger Force-Closure Grasps of Curved 2D Objects , 1991, Proceedings. 1991 IEEE International Conference on Robotics and Automation.

[9]  Emanuele Trucco,et al.  Introductory techniques for 3-D computer vision , 1998 .

[10]  Justus H. Piater,et al.  Developing haptic and visual perceptual categories for reaching and grasping with a humanoid robot , 2001, Robotics Auton. Syst..

[11]  Ronald Lumia,et al.  Manipulation of unmodeled objects using intelligent grasping schemes , 2003, IEEE Trans. Fuzzy Syst..

[12]  Robert B. Fisher,et al.  Ranking planar grasp configurations for a three-finger hand , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[13]  Antonio Morales Escrig.  Learning to predict grasp reliability with a multifinger robot hand by using visual features , 2004 .

[14]  Daniel P. Huttenlocher,et al.  Efficient Graph-Based Image Segmentation , 2004, International Journal of Computer Vision.

[15]  Peter K. Allen,et al.  An SVM learning approach to robotic grasping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[16]  Alireza Bab-Hadiashar,et al.  Range image segmentation using surface selection criterion , 2006, IEEE Transactions on Image Processing.

[17]  Robert Platt,et al.  Learning Grasp Context Distinctions that Generalize , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[18]  Tomás Lozano-Pérez,et al.  Imitation Learning of Whole-Body Grasps , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects , 2006, NIPS.

[20]  Charles C. Kemp,et al.  Manipulation in Human Environments , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[21]  Robert Platt,et al.  Improving Grasp Skills Using Schema Structured Learning , 2006 .

[22]  Leslie Pack Kaelbling,et al.  Grasping POMDPs , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[23]  Roland Siegwart,et al.  FAST RANGE IMAGE SEGMENTATION FOR INDOOR 3D-SLAM , 2007 .

[24]  Fernando Matía,et al.  Extraction of Geometrical Features in 3D Environments for Service Robotic Applications , 2008, HAIS.

[25]  Lawson L. S. Wong,et al.  Learning Grasp Strategies with Partial Shape Information , 2008, AAAI.

[26]  Zhe Xu,et al.  A point-and-click interface for the real world: Laser designation of objects for mobile manipulation , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[27]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[28]  H. Nguyen.  El-E: An Assistive Robot that Fetches Objects from Flat Surfaces , 2008 .

[29]  Quoc V. Le,et al.  Joint calibration of multiple sensors , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[30]  Quoc V. Le,et al.  High-accuracy 3D sensing for mobile manipulation: Improving object detection and door opening , 2009, 2009 IEEE International Conference on Robotics and Automation.

[31]  Ashutosh Saxena,et al.  Monocular depth perception and robotic grasping of novel objects , 2009 .

[32]  Quoc V. Le,et al.  Learning to grasp objects with multiple contact points , 2010, 2010 IEEE International Conference on Robotics and Automation.