Robust real time tracking of 3D objects

In this article the problem of tracking rigid 3D objects is addressed. The contribution of the proposed approach is an algorithm which combines: efficiency (i.e. the algorithm is designed before all to be real time using standard architecture), robustness (occlusions are allowed) and accuracy (sub-pixel accuracy is obtained). It is devoted to the tracking of 3D rigid objects, assuming that the 3D geometry as well as the texture of the surface is known. Such performances can be obtained through a two levels scheme: the core of the approach consists in an efficient 2D patch tracker whose results are combined robustly to compute the 3D object pose. This article provides experimental results proving the soundness of the proposed approach.

[1]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[2]  Michel Dhome,et al.  Determination of the Attitude of 3D Objects from a Single Perspective View , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  David J. Fleet,et al.  Robust online appearance models for visual tracking , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[5]  Michel Dhome,et al.  Real time 3D template matching , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Roberto Cipolla,et al.  Real-time tracking of complex structures with on-line camera calibration , 2002, Image Vis. Comput..

[7]  David G. Lowe,et al.  Robust model-based motion tracking through the integration of search and estimation , 1992, International Journal of Computer Vision.

[8]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[9]  François Chaumette,et al.  Une loi de commande par asservissement visuel robuste aux mesures abérrantes , 2004 .