Robot-vision architecture for real-time 6-DOF object localization

This paper presents a new robot-vision system architecture for real-time moving object localization. The 6-DOF (3 translation and 3 rotation) motion of the objects is detected and tracked accurately in clutter using a model-based approach without information of the objects' initial positions. An object identification task and an object tracking task are combined under this architecture. The computational time-lag between the two tasks is absorbed by a large amount of frame memory. The tasks are implemented as independent software modules using stereo-vision-based methods which can deal with objects of various shapes with edges, including planar to smooth-curved objects, in cluttered environments. This architecture also leads to failure-recoverable object tracking, because the tracking processes can be automatically recovered, even if the moving objects are lost while tracking. Experimental results obtained with prototype systems demonstrate the effectiveness of the proposed architecture.

[1]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Andrew E. Johnson,et al.  Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Naokazu Yokoya,et al.  A Robust Method for Registration and Segmentation of Multiple Range Images , 1995, Comput. Vis. Image Underst..

[4]  Kazuhide Sugimoto,et al.  Object recognition in distributed computing environment , 2001 .

[5]  Donald B. Gennery,et al.  Visual tracking of known three-dimensional objects , 1992, International Journal of Computer Vision.

[6]  Takeo Kanade,et al.  Real-time 3-D pose estimation using a high-speed range sensor , 1993, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[7]  Y. Sumi.  3D Localization of Moving Free-Form Objects in Cluttered Environments , 2004 .

[8]  Jun Takamatsu,et al.  Acquisition of a symbolic manipulation task model by attention point analysis , 2003, Adv. Robotics.

[9]  Patrick Bouthemy,et al.  Robust real-time visual tracking using a 2D-3D model-based approach , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Chin Seng Chua,et al.  Point Signatures: A New Representation for 3D Object Recognition , 1997, International Journal of Computer Vision.

[11]  Berthold K. P. Horn,et al.  Closed-form solution of absolute orientation using unit quaternions , 1987 .

[12]  Masayuki Inaba,et al.  Incremental mesh modeling and hierarchical object recognition using multiple range images , 2000, Proceedings. 2000 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2000) (Cat. No.00CH37113).

[13]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[14]  David G. Lowe,et al.  Robust model-based motion tracking through the integration of search and estimation , 1992, International Journal of Computer Vision.

[15]  Mikko Sallinen,et al.  Recognition of large work objects in difficult industrial environments , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[16]  Fumiaki Tomita,et al.  Plane-based calibration algorithm for multi-camera systems via factorization of homography matrices , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[17]  Fumio Kanehiro,et al.  Humanoid robot HRP-2 , 2008, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[18]  Mark D. Wheeler,et al.  Automatic Modeling and Localization for Object Recognition , 1996 .

[19]  Hans-Hellmut Nagel,et al.  Model-Based Stereo-Tracking of Non-Polyhedral Objects for Automatic Disassembly Experiments , 2000, International Journal of Computer Vision.

[20]  Jake K. Aggarwal,et al.  Model-based object recognition in dense-range images—a review , 1993, CSUR.

[21]  Fumiaki Tomita,et al.  Hyper Frame Vision: a real-time vision system for 6-DOF object localization , 2002, Object recognition supported by user interaction for service robots.

[22]  Kosuke Sato,et al.  Real-time object tracking by rotating range sensor , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[23]  Yoshihiro Kawai,et al.  3D Object Recognition in Cluttered Environments by Segment-Based Stereo Vision , 2004, International Journal of Computer Vision.

[24]  Jake K. Aggarwal,et al.  CAD-based vision: object recognition in cluttered range images using recognition strategies , 1993 .

[25]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .

[27]  Avinash C. Kak,et al.  A robot vision system for recognition of generic shaped objects , 1991, CVGIP Image Underst..