Hyper Frame Vision: a real-time vision system for 6-DOF object localization

A system for robot vision is proposed that integrates a 3-D object recognition task and a 3-D object tracking task, enabling real-time 6-DOF localization of a known continuously moving object. A computational time-lag between the two tasks is absorbed by a large amount of frame memory. For 3-D sensing, calibrated trinocular stereo cameras are used to employ stereo-vision-based object recognition and tracking methods that allow objects of any shape to be dealt with and to provide robust performance in an environment with partial occlusions and cluttered backgrounds. The effectiveness of the system is demonstrated by experimental results.

[1]  Hans-Hellmut Nagel,et al.  3D pose estimation by fitting image gradients directly to polyhedral models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[2]  Jake K. Aggarwal,et al.  Model-based object recognition in dense-range images—a review , 1993, CSUR.

[3]  Donald B. Gennery,et al.  Visual tracking of known three-dimensional objects , 1992, International Journal of Computer Vision.

[4]  Hans-Hellmut Nagel,et al.  Combination of Edge Element and Optical Flow Estimates for 3D-Model-Based Vehicle Tracking in Traffic Image Sequences , 1999, International Journal of Computer Vision.

[5]  Fumiaki Tomita,et al.  3-D Motion Tracking of 3-D Objects Using Stereo Vision. , 2000 .

[6]  Patrick Bouthemy,et al.  Robust real-time visual tracking using a 2D-3D model-based approach , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Yoshihiro Kawai,et al.  3D Object Recognition in Cluttered Environments by Segment-Based Stereo Vision , 2004, International Journal of Computer Vision.

[8]  David G. Lowe,et al.  Robust model-based motion tracking through the integration of search and estimation , 1992, International Journal of Computer Vision.

[9]  Hans-Hellmut Nagel,et al.  Model-Based Stereo-Tracking of Non-Polyhedral Objects for Automatic Disassembly Experiments , 2000, International Journal of Computer Vision.

[10]  Kosuke Sato,et al.  Real-time object tracking by rotating range sensor , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[11]  Richard S. Stephens.  Real-time 3D object tracking , 1990, Image Vis. Comput..

[12]  William Grimson,et al.  Object recognition by computer - the role of geometric constraints , 1991 .