Robust 3D Head Tracking by Online Feature Registration

This paper presents a robust method for tracking the position and orientation of a head in videos. The proposed method can overcome occlusions and divergence problems. We introduce an online registration technique to detect and register feature point of the head while tracking. A set of point features is registered and updated for each reference pose serving a multi-view head detector. The online feature registration rectifies error accumulation and provides fast recovery after occlusion has ended, while preventing divergence problem which frequently occurs in conventional frame-to-frame tracking methods. The robustness of the proposed tracker is experimentally shown with video sequences that include occlusions and large pose variations.

[1]  Zhiwei Zhu,et al.  Real Time 3D Face Pose Tracking From an Uncalibrated Camera , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[2]  Richard M. Murray,et al.  A Mathematical Introduction to Robotic Manipulation , 1994 .

[3]  Gregory D. Hager,et al.  Efficient Region Tracking With Parametric Models of Geometry and Illumination , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Yi Zhou,et al.  Bayesian tangent shape model: estimating shape and pose parameters via Bayesian inference , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[5]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Lisa M. Brown,et al.  3D head tracking using motion adaptive texture-mapping , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Alex Pentland,et al.  Motion regularization for model-based head tracking , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[8]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[9]  Marius Malciu,et al.  A robust model-based approach for 3D head tracking in video sequences , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[10]  Horst Bischof,et al.  Learning Features for Tracking , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[11]  Michael J. Black,et al.  Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion , 1997, International Journal of Computer Vision.

[12]  Marco La Cascia,et al.  Fast, Reliable Head Tracking under Varying Illumination: An Approach Based on Registration of Texture-Mapped 3D Models , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Gregory D. Hager,et al.  A Particle Filter without Dynamics for Robust 3D Face Tracking , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[14]  Rama Chellappa,et al.  3D Facial Pose Tracking in Uncalibrated Videos , 2005, PReMI.

[15]  Jing Xiao,et al.  Robust full-motion recovery of head by dynamic templates and re-registration techniques , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[16]  Vincent Lepetit,et al.  Feature Harvesting for Tracking-by-Detection , 2006, ECCV.