Assessing Grasp Stability Based on Learning

An important ability of a robot that interacts with the environment and manipulates objects is to deal with the un- certainty in sensory data. Sensory information is necessary to, for example, perform online assessment of grasp stability. We present methods to assess grasp stability based on haptic data and machine- learning methods, including AdaBoost, support vector machines (SVMs), and hidden Markov models (HMMs). In particular, we study the effect of different sensory streams to grasp stability. This includes object information such as shape; grasp information such as approach vector; tactile measurements from fingertips; and joint configuration of the hand. Sensory knowledge affects the success of the grasping process both in the planning stage (before a grasp is executed) and during the execution of the grasp (closed-loop online control). In this paper, we study both of these aspects. We propose a probabilistic learning framework to assess grasp stability and demonstrate that knowledge about grasp stability can be inferred using information from tactile sensors. Experiments on both sim- ulated and real data are shown. The results indicate that the idea to exploit the learning approach is applicable in realistic scenarios, which opens a number of interesting venues for the future research. Index Terms—Force and tactile sensing, grasping, learning and adaptive systems.

[1]  Masatoshi Ishikawa,et al.  Design of the 100G Capturing Robot Based on Dynamic Preshaping , 2005, Int. J. Robotics Res..

[2]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[3]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[4]  Jürgen Sturm,et al.  Tactile object class and internal state recognition for mobile manipulation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[5]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[6]  Danica Kragic,et al.  Learning and Evaluation of the Approach Vector for Automatic Grasp Generation and Planning , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[7]  Danica Kragic,et al.  Grasping known objects with humanoid robots: A box-based approach , 2009, 2009 International Conference on Advanced Robotics.

[8]  Angel P. del Pobil,et al.  Vision-tactile-force integration and robot physical interaction , 2009, 2009 IEEE International Conference on Robotics and Automation.

[9]  Danica Kragic,et al.  Learning grasp stability based on haptic data , 2010 .

[10]  Heinz Wörn,et al.  Haptic object recognition using passive joints and haptic key features , 2010, 2010 IEEE International Conference on Robotics and Automation.

[11]  George A. Bekey,et al.  Intelligent Learning for Deformable Object Manipulation , 1999, Auton. Robots.

[12]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[13]  Danica Kragic,et al.  Evaluation of feature representation and machine learning methods in grasp stability learning , 2010, 2010 10th IEEE-RAS International Conference on Humanoid Robots.

[14]  Oliver Kroemer,et al.  Learning Continuous Grasp Affordances by Sensorimotor Exploration , 2010, From Motor Learning to Interaction Learning in Robots.

[15]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[16]  Raúl Suárez Feijóo,et al.  Grasp quality measures , 2006 .

[17]  Danica Kragic,et al.  Learning grasping points with shape context , 2010, Robotics Auton. Syst..

[18]  M. Shimojo,et al.  A High-Speed Mesh of Tactile Sensors Fitting Arbitrary Surfaces , 2010, IEEE Sensors Journal.

[19]  Wolfram Burgard,et al.  Object identification with tactile sensors using bag-of-features , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[21]  Oussama Khatib,et al.  Bayesian estimation for autonomous object manipulation based on tactile sensors , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[22]  Kazuaki Iwata,et al.  Static analysis of deformable object grasping based on bounded force closure , 1996, Proceedings of IEEE International Conference on Robotics and Automation.

[23]  Leslie Pack Kaelbling,et al.  Task-Driven Tactile Exploration , 2010, Robotics: Science and Systems.

[24]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[25]  Danica Kragic,et al.  A strategy for grasping unknown objects based on co-planarity and colour information , 2010, Robotics Auton. Syst..

[26]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[27]  Jimmy A. Jørgensen,et al.  RobWorkSim - an Open Simulator for Sensor based Grasping , 2010, ISR/ROBOTIK.

[28]  Danica Kragic,et al.  Grasping familiar objects using shape context , 2009, 2009 International Conference on Advanced Robotics.

[29]  Helge J. Ritter,et al.  Using entropy for dimension reduction of tactile data , 2009, 2009 International Conference on Advanced Robotics.

[30]  John Platt,et al.  Probabilistic Outputs for Support vector Machines and Comparisons to Regularized Likelihood Methods , 1999 .

[31]  Danica Kragic,et al.  An Active Vision System for Detecting, Fixating and Manipulating Objects in the Real World , 2010, Int. J. Robotics Res..

[32]  Kai Huebner BADGr - A toolbox for box-based approximation, decomposition and GRasping , 2012, Robotics Auton. Syst..

[33]  Dominiek Reynaerts,et al.  Featureless classification of tactile contacts in a gripper using neural networks , 1996 .

[34]  Henrik I. Christensen,et al.  Automatic grasp planning using shape primitives , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[35]  Peter K. Allen,et al.  Grasp Planning via Decomposition Trees , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.