2D model-based tracking of complex shapes for visual servoing tasks

Visual servoing needs image data as input to realize robotics tasks such as positioning, docking or mobile target pursuit. This often requires to track the 2D projection of the object of interest in the image sequence. To increase the versatility of visual servoing, objects cannot be assumed to carry landmarks. We have developed an original method for 2D tracking of complex objects which can be approximately modeled by a polyhedral shape. The proposed method fulfills real-time constraints as well as reliability and robustness requirements. Real experiments and results on a positioning task with respect to different objects are presented.

[1]  Patrick Bouthemy,et al.  Exploiting Image Motion for Active Vision in a Visual Servoing Framework , 1996, Int. J. Robotics Res..

[2]  Michael Isard,et al.  Contour Tracking by Stochastic Propagation of Conditional Density , 1996, ECCV.

[3]  Patrick Bouthemy,et al.  A Maximum Likelihood Framework for Determining Moving Edges , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  F DementhonDaniel,et al.  Model-based object pose in 25 lines of code , 1995 .

[5]  Michel Dhome,et al.  Determination of the Attitude of 3D Objects from a Single Perspective View , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Patrick Rives,et al.  A new approach to visual servoing in robotics , 1992, IEEE Trans. Robotics Autom..

[7]  Charles Kervrann,et al.  A hierarchical statistical framework for the segmentation of deformable objects in image sequences , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Allen R. Hanson,et al.  Robust methods for estimating pose and a sensitivity analysis , 1994 .

[9]  Chahab Nastar,et al.  Robust Fitting of 3D CAD Models to Video Streams , 1997, ICIAP.

[10]  David G. Lowe,et al.  Three-Dimensional Object Recognition from Single Two-Dimensional Images , 1987, Artif. Intell..

[11]  Peter I. Corke,et al.  A tutorial on visual servo control , 1996, IEEE Trans. Robotics Autom..

[12]  Gregory D. Hager,et al.  X Vision: A Portable Substrate for Real-Time Vision Applications , 1998, Comput. Vis. Image Underst..