Visual servoing on unknown objects

We study visual servoing in a framework of detection and grasping of unknown objects. Classically, visual servoing has been used for applications where the object to be servoed on is known to the robot prior to the task execution. In addition, most of the methods concentrate on aligning the robot hand with the object without grasping it. In our work, visual servoing techniques are used as building blocks in a system capable of detecting and grasping unknown objects in natural scenes. We show how different visual servoing techniques facilitate a complete grasping cycle.

[1]  Ashutosh Saxena,et al.  Robotic Grasping of Novel Objects , 2006, NIPS.

[2]  Danica Kragic,et al.  Learning grasping points with shape context , 2010, Robotics Auton. Syst..

[3]  Niklas Bergström,et al.  Integration of Visual Cues for Robotic Grasping , 2009, ICVS.

[4]  Petros Maragos,et al.  Optimum design of chamfer distance transforms , 1998, IEEE Trans. Image Process..

[5]  Danica Kragic,et al.  Cue integration for visual servoing , 2001, IEEE Trans. Robotics Autom..

[6]  Ales Ude,et al.  Active 3-D vision on a humanoid head , 2009, 2009 International Conference on Advanced Robotics.

[7]  Rüdiger Dillmann,et al.  Visual servoing for humanoid grasping and manipulation tasks , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[8]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Stefan Ulbrich,et al.  OpenGRASP: A Toolkit for Robot Grasping Simulation , 2010, SIMPAR.

[10]  Ales Ude,et al.  The Karlsruhe Humanoid Head , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[11]  Danica Kragic,et al.  An Active Vision System for Detecting, Fixating and Manipulating Objects in the Real World , 2010, Int. J. Robotics Res..

[12]  Danica Kragic,et al.  Early reactive grasping with second order 3D feature relations , 2007 .

[13]  Abdul Wahid Khan,et al.  Systematic Geometric Error Modeling for Workspace Volumetric Calibration of a 5-axis Turbine Blade Grinding Machine , 2010 .

[14]  Gordon Cheng,et al.  Making Object Learning and Recognition an Active Process , 2008, Int. J. Humanoid Robotics.

[15]  Danica Kragic,et al.  Active 3D Segmentation through Fixation of Previously Unseen Objects , 2010, BMVC.

[16]  Danica Kragic,et al.  Grasping known objects with humanoid robots: A box-based approach , 2009, 2009 International Conference on Advanced Robotics.

[17]  Matei T. Ciocarlie,et al.  Contact-reactive grasping of objects with partial shape information , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Danica Kragic,et al.  Selection of robot pre-grasps using box-based shape approximation , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[19]  Antonio Morales,et al.  Vision-based grasp planning of 3D objects by extending 2D contour based algorithms , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Éric Marchand,et al.  Real-time markerless tracking for augmented reality: the virtual visual servoing framework , 2006, IEEE Transactions on Visualization and Computer Graphics.

[21]  Dariu Gavrila,et al.  Multi-feature hierarchical template matching using distance transforms , 1998, Proceedings. Fourteenth International Conference on Pattern Recognition (Cat. No.98EX170).

[22]  Danica Kragic,et al.  Scene Representation and Object Grasping Using Active Vision , 2010 .

[23]  Mario Richtsfeld,et al.  Grasping of Unknown Objects from a Table Top , 2008 .

[24]  Danica Kragic,et al.  Active 3D scene segmentation and detection of unknown objects , 2010, 2010 IEEE International Conference on Robotics and Automation.

[25]  Tamim Asfour,et al.  Stereo-based 6D object localization for grasping with humanoid robot systems , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Vincent Lepetit,et al.  Point matching as a classification problem for fast and robust object pose estimation , 2004, CVPR 2004.

[27]  Kurt Konolige,et al.  Calibrating a Multi-arm Multi-sensor Robot: A Bundle Adjustment Approach , 2010, ISER.

[28]  Javier Felip,et al.  Robust sensor-based grasp primitive for a three-finger robot hand , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[29]  Danica Kragic,et al.  Robust Real-Time Visual Tracking: Comparison, Theoretical Analysis and Performance Evaluation , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[30]  Danica Kragic,et al.  Integration of Model-based and Model-free Cues for Visual Object Tracking in 3D , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[31]  Gunilla Borgefors,et al.  Distance transformations in digital images , 1986, Comput. Vis. Graph. Image Process..

[32]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[33]  Danica Kragic,et al.  Hands in action: real-time 3D reconstruction of hands in interaction with objects , 2010, 2010 IEEE International Conference on Robotics and Automation.

[34]  Danica Kragic,et al.  Initialization and System Modeling in 3-D Pose Tracking , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[35]  Nicholas Roy,et al.  Probabilistic Models of Object Geometry for Grasp Planning , 2008, Robotics: Science and Systems.

[36]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[37]  C. Koch,et al.  Computational modelling of visual attention , 2001, Nature Reviews Neuroscience.

[38]  Bernt Schiele,et al.  Functional Object Class Detection Based on Learned Affordance Cues , 2008, ICVS.

[39]  Rama Chellappa,et al.  Fast directional chamfer matching , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[40]  Tamim Asfour,et al.  Kinematic Calibration for Saccadic Eye Movements , 2008 .

[41]  Jian Wang,et al.  Markerless, vision-assisted flight control of a quadrocopter , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.