Tracking 3D Object using Flexible Models

This article proposes a flexible tracker which can estimate motion and deformations of 3D objects by considering their appearances as nonrigid surfaces. In this approach, a flexible model is built by matching features (key points) over training sequences and by learning the deformations of a spline based model. This statistical model captures the variations in the appearance of objects caused by 3D pose variations. Visual tracking is then possible, for each new frame, by matching local features of the model according to their local appearances as well as optimal optimization of the constraints provided by the flexible model. The approach is demonstrated on real-world images sequences.

[1]  Vincent Lepetit,et al.  Stable real-time 3D tracking using online and offline information , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Jan Wieghardt,et al.  Learning the Topology of Object Views , 2002, ECCV.

[3]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Michel Dhome,et al.  Robust real time tracking of 3D objects , 2004, ICPR 2004.

[5]  Serge J. Belongie,et al.  A Feature-Based Approach for Determining Dense Long Range Correspondences , 2004, ECCV.

[6]  David G. Lowe,et al.  Fitting Parameterized Three-Dimensional Models to Images , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Gabriele Peters,et al.  A view based approach to three-dimensional object perception , 2002 .

[8]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[9]  Richard Szeliski,et al.  Spline-Based Image Registration , 1997, International Journal of Computer Vision.

[10]  Joachim M. Buhmann,et al.  Distortion Invariant Object Recognition in the Dynamic Link Architecture , 1993, IEEE Trans. Computers.

[11]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Michel Dhome,et al.  Real time tracking of 3D objects: an efficient and robust approach , 2002, Pattern Recognit..

[13]  Roberto Cipolla,et al.  Real-Time Visual Tracking of Complex Structures , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.