A Learning Method to Determine How to Approach an Unknown Object to be Grasped

We present a learning algorithm to determine the appropriate approaching pose to grasp a novel object. Our method focuses on the computation of valid end-effector orientations in order to make contact with the object at a given point. The system achieves this goal by generalizing from positive examples provided by a human operator during an offline training session. The technique is feature-based since it extracts salient attributes of the object to be grasped rather than relying on the availability of models or trying to build one. To compute the desired orientation, the robot performs three steps at run time. Using a multi-class Support Vector Machine (SVM), it first classifies the novel object into one of the object classes defined during training. Next, it determines its orientation, and, finally, based on the classification and orientation, it extracts the most similar example from the training data and uses it to grasp the object. The method has been implemented on a full-scale humanoid robotic torso equipped with multi-fingered hands and extensive results corroborate both its effectiveness and real-time performance.

[1]  Stefano Carpin,et al.  Efficient grasping of novel objects through dimensionality reduction , 2010, 2010 IEEE International Conference on Robotics and Automation.

[2]  C. Von Hofsten,et al.  The structuring of neonatal arm movements. , 1993, Child development.

[3]  M. Jeannerod The timing of natural prehension movements. , 1984, Journal of motor behavior.

[4]  Anis Sahbani,et al.  A hybrid approach for grasping 3D objects , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[5]  Martti Juhola,et al.  Informal identification of outliers in medical data , 2000 .

[6]  Antonio Morales,et al.  An experiment in constraining vision-based finger contact selection with gripper geometry , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  L. Jakobson,et al.  A neurological dissociation between perceiving objects and grasping them , 1991, Nature.

[8]  Textured Object Detection in Stereo Images using Visual Features , 2008 .

[9]  Siddhartha S. Srinivasa,et al.  Object recognition and full pose registration from a single image for robotic manipulation , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  Kurt Hornik,et al.  Support Vector Machines in R , 2006 .

[11]  M. Arbib,et al.  Infant grasp learning: a computational model , 2004, Experimental Brain Research.

[12]  U. Castiello The neuroscience of grasping , 2005, Nature Reviews Neuroscience.

[13]  Henrik I. Christensen,et al.  Automatic grasp planning using shape primitives , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[14]  Tatsuo Arai,et al.  Interoperable RT component for object detection and 3D pose estimation for service robots , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[16]  Oliver Kroemer,et al.  Active learning using mean shift optimization for robot grasping , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  A. Meltzoff Infant Imitation After a 1-Week Delay: Long-Term Memory for Novel Acts and Multiple Stimuli. , 1988, Developmental psychology.

[18]  John J. Craig Zhu,et al.  Introduction to robotics mechanics and control , 1991 .

[19]  Hae Yong Kim,et al.  Grayscale Template-Matching Invariant to Rotation, Scale, Translation, Brightness and Contrast , 2007, PSIVT.

[20]  Matei T. Ciocarlie,et al.  Data-driven grasping with partial sensor data , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[21]  Stefano Carpin,et al.  Learning end-effector orientations for novel object grasping tasks , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[22]  Michael Beetz,et al.  Real-time perception-guided motion planning for a personal robot , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Wai Ho Li,et al.  Interactive learning of visually symmetric objects , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  Ronald Lumia,et al.  Manipulation of unmodeled objects using intelligent grasping schemes , 2003, IEEE Trans. Fuzzy Syst..

[25]  Craig M. Shakarji,et al.  Least-Squares Fitting Algorithms of the NIST Algorithm Testing System , 1998, Journal of research of the National Institute of Standards and Technology.

[26]  Wolfram Burgard,et al.  Robust on-line model-based object detection from range images , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Michael Beetz,et al.  Perception for mobile manipulation and grasping using active stereo , 2009, 2009 9th IEEE-RAS International Conference on Humanoid Robots.

[28]  Nicholas Roy,et al.  Probabilistic Models of Object Geometry for Grasp Planning , 2008, Robotics: Science and Systems.

[29]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[30]  Victoria J. Hodge,et al.  A Survey of Outlier Detection Methodologies , 2004, Artificial Intelligence Review.

[31]  C L MacKenzie,et al.  Is object texture a constraint on human prehension?: kinematic evidence. , 1991, Journal of motor behavior.

[32]  Discriminant Subspace,et al.  PATTERN ANALYSIS AND MACHINE INTELLIGENCE A publication of the IEEE Computer Society , 2007 .

[33]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[34]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[35]  Paolo Pirjanian,et al.  SIFT-ing through features with ViPR , 2006, IEEE Robotics & Automation Magazine.

[36]  Antonio Morales,et al.  Vision-based computation of three-finger grasps on unknown planar objects , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.

[37]  Niyant Krishnamurthi,et al.  A New Mobile Manipulation Platform for Automatic Coffee Retrieval , 2006 .

[38]  Claire Dune,et al.  Vision-based grasping of unknown objects to improve disabled persons autonomy , 2008 .

[39]  Manuel Ato,et al.  Force-related information and exploratory behavior in infancy , 2000 .

[40]  M. Jeannerod Intersegmental coordination during reaching at natural visual objects , 1981 .

[41]  Florentin Wörgötter,et al.  Early Cognitive Vision: Using Gestalt-Laws for Task-Dependent, Active Image-Processing , 2004, Natural Computing.

[42]  Justus Piater Learning Visual Features to Predict Hand Orientations , 2002 .

[43]  Anis Sahbani,et al.  On computing robust n-finger force-closure grasps of 3D objects , 2009, 2009 IEEE International Conference on Robotics and Automation.

[44]  Antonio Morales,et al.  Vision-based three-finger grasp synthesis constrained by hand geometry , 2006, Robotics Auton. Syst..

[45]  LinChih-Jen,et al.  A comparison of methods for multiclass support vector machines , 2002 .

[46]  M. E. McCarty,et al.  How infants use vision for grasping objects. , 2001, Child development.