VisGraB: A benchmark for vision-based grasping

We present a database and a software tool, VisGraB, for benchmarking of methods for vision-based grasping of unknown objects with no prior object knowledge. The benchmark is a combined real-world and simulated experimental setup. Stereo images of real scenes containing several objects in different configurations are included in the database. The user needs to provide a method for grasp generation based on the real visual input. The grasps are then planned, executed, and evaluated by the provided grasp simulator where several grasp-quality measures are used for evaluation. This setup has the advantage that a large number of grasps can be executed and evaluated while dealing with dynamics and the noise and uncertainty present in the real world images. VisGraB enables a fair comparison among different grasping methods. The user furthermore does not need to deal with robot hardware, focusing on the vision methods instead. As a baseline, benchmark results of our grasp strategy are included.

[1]  Henrik Gordon Petersen,et al.  Inverse kinematics by numerical and analytical cyclic coordinate descent , 2011, Robotica.

[2]  Darius Burschka,et al.  Stochastic Optimization for Rigid Point Set Registration , 2009, ISVC.

[3]  Richard Szeliski,et al.  A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms , 2001, International Journal of Computer Vision.

[4]  Jimmy A. Jørgensen,et al.  Enabling grasping of unknown objects through a synergistic use of edge and surface information , 2012, Int. J. Robotics Res..

[5]  Danica Kragic,et al.  A strategy for grasping unknown objects based on co-planarity and colour information , 2010, Robotics Auton. Syst..

[6]  Jimmy A. Jørgensen,et al.  RobWorkSim - an Open Simulator for Sensor based Grasping , 2010, ISR/ROBOTIK.

[7]  Jimmy A. Jørgensen,et al.  Accelerated Hierarchical Collision Detection for Simulation using CUDA , 2010, VRIPHYS.

[8]  Danica Kragic,et al.  Learning grasping points with shape context , 2010, Robotics Auton. Syst..

[9]  H. G. Petersen,et al.  Advanced off-line simulation framework with deformation compensation for high speed machining with robot manipulators , 2012, 2012 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM).

[10]  Jimmy A. Jørgensen,et al.  Grasp Synthesis for Dextrous Hands Optimised for Tactile Manipulation , 2010, ISR/ROBOTIK.

[11]  Stefan Ulbrich,et al.  OpenGRASP: A Toolkit for Robot Grasping Simulation , 2010, SIMPAR.

[12]  H. G. Petersen,et al.  Simulating robot handling of large scale deformable objects: Manufacturing of unique concrete reinforcement structures , 2012, 2012 IEEE International Conference on Robotics and Automation.

[13]  Jimmy A. Jørgensen,et al.  Grasping unknown objects using an Early Cognitive Vision system for general scene understanding , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Peter K. Allen,et al.  Grasp Planning via Decomposition Trees , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[15]  Dirk Kraft,et al.  Learning to grasp unknown objects based on 3D edge information , 2009, 2009 IEEE International Symposium on Computational Intelligence in Robotics and Automation - (CIRA).

[16]  Florentin Wörgötter,et al.  International Journal of Humanoid Robotics c ○ World Scientific Publishing Company Visual Primitives: Local, Condensed, Semantically Rich Visual Descriptors and their Applications in Robotics , 2022 .

[17]  Peter K. Allen,et al.  Graspit! A versatile simulator for robotic grasping , 2004, IEEE Robotics & Automation Magazine.

[18]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects using Vision , 2008, Int. J. Robotics Res..

[19]  Jimmy A. Jørgensen,et al.  Assessing Grasp Stability Based on Learning and Haptic Data , 2011, IEEE Transactions on Robotics.

[20]  Danica Kragic,et al.  Minimum volume bounding box decomposition for shape approximation in robot grasping , 2008, 2008 IEEE International Conference on Robotics and Automation.

[21]  Henrik Gordon Petersen,et al.  Industrial Robot : An International Journal Ring on the hook : placing a ring on a moving and pendulating hook based on visual input , 2016 .

[22]  Quoc V. Le,et al.  Grasping novel objects with depth segmentation , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[23]  Matei T. Ciocarlie,et al.  The Columbia grasp database , 2009, 2009 IEEE International Conference on Robotics and Automation.

[24]  Stefan Ulbrich,et al.  The OpenGRASP benchmarking suite: An environment for the comparative analysis of grasping and dexterous manipulation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[26]  Anis Sahbani,et al.  Handling Objects by Their Handles , 2008 .

[27]  Peter K. Allen,et al.  An SVM learning approach to robotic grasping , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[28]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[29]  John F. Canny,et al.  Planning optimal grasps , 1992, Proceedings 1992 IEEE International Conference on Robotics and Automation.

[30]  Rustam Stolkin,et al.  A calibration system for measuring 3D ground truth for validation and error analysis of robot vision algorithms , 2006 .

[31]  Jing Xiao,et al.  Efficient and effective grasping of novel objects through learning and adapting a knowledge base , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.