Interoperable RT component for object detection and 3D pose estimation for service robots

Finding objects and tracking their poses are essential functions for service robots, in order to manipulate objects and interact with humans. We present an approach for object detection and 3D pose estimation for autonomous mobile robots, that is suitable for general uses in a modularized robot control system. Our apprach extracts local features from the input images, searches for the reference pattern, and then produces the 3D pose in camera coordinate system, using only a single reference image and the 6-DOF pose in it. We have created an RT(Robot Technology) component that can be used in any RT-based system, and developed an algorithm that can extend the range of detection and produce robust pose estimation. For evaluation, we have integrated our vision component in an autonomous robot system with a search-and-grasp task, and tested it with several objects that are found in ordinary domestic environment. We present the details of our approach, the design of our modular component design, and the results of the experiments in this paper.

[1]  Sukhan Lee,et al.  Real-time 3D object pose estimation and tracking for natural landmark based visual servo , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[2]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[3]  Michel Dhome,et al.  Real time 3D template matching , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[4]  Vincent Lepetit,et al.  Stable real-time 3D tracking using online and offline information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Alois Knoll,et al.  Fully Automatic Real-Time 3D Object Tracking using Active Contour and Appearance Models , 2006, J. Multim..

[6]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[8]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Jun Ota,et al.  Handling of objects with marks by a robot , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[10]  Andrea Vedaldi,et al.  Vlfeat: an open and portable library of computer vision algorithms , 2010, ACM Multimedia.

[11]  Nobuyuki Otera,et al.  ORiN: Open Robot Interface for the Network , 2002 .

[12]  Herman Bruyninckx,et al.  Open robot control software: the OROCOS project , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[13]  Éric Marchand,et al.  Robust model-based tracking for robot vision , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[14]  Takashi Suehiro,et al.  RT-middleware: distributed component middleware for RT (robot technology) , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  D HagerGregory,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998 .

[16]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[17]  Niko Sünderhauf,et al.  COMPARING SEVERAL IMPLEMENTATIONS OF TWO RECENTLY PUBLISHED FEATURE DETECTORS , 2007 .

[18]  Éric Marchand,et al.  Real time planar structure tracking for visual servoing: a contour and texture approach , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.