A head pose and facial actions tracking method based on effecient online appearance models

Target modeling and model fitting are the two important parts of the problem of object tracking. The former has to provide a good reference for the latter. Online appearance models (OAM) has been successfully used for facial features tracking on account of their strong ability to adapt to variations, however, it suffers from time-consuming model fitting. Inverse Compositional Image Alignment (ICIA) algorithm has been proved to be an efficient, robust and accurate fitting algorithm. In this work, we introduce an efficient online appearance models based on ICIA, and apply it to track head pose and facial actions in video. A 3d parameterized model, CANDIDE model, is used to model the face and facial expression, a weak perspective projection method is used to model the head pose, an adaptive appearance model is built on shape free texture, and then the efficient fitting algorithm is taken to track parameters of head pose and facial actions. Experiments demonstrate that the tracking algorithm is robust and efficient.

[1]  Fadi Dornaika,et al.  On Appearance Based Face and Facial Action Tracking , 2006, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Rama Chellappa,et al.  Visual tracking and recognition using appearance-adaptive models in particle filters , 2004, IEEE Transactions on Image Processing.

[3]  J. Ahlberg.  REAL-TIME FACIAL FEATURE TRACKING USING AN ACTIVE MODEL WITH FAST IMAGE WARPING , 2001 .

[4]  Sami Romdhani,et al.  Efficient, robust and accurate fitting of a 3D morphable model , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[5]  David J. Fleet,et al.  Robust Online Appearance Models for Visual Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Simon Baker,et al.  Equivalence and efficiency of image alignment algorithms , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[7]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[8]  Yangsheng Wang,et al.  Weighted Active Appearance Models , 2007, ICIC.

[9]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[10]  Jörgen Ahlberg,et al.  CANDIDE-3 - An Updated Parameterised Face , 2001 .

[11]  Shai Avidan,et al.  Support vector tracking , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Datong Chen,et al.  Robust Object Tracking Via Online Dynamic Spatial Bias Appearance Models , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Shaogang Gong,et al.  Tracking colour objects using adaptive mixture models , 1999, Image Vis. Comput..

[14]  Shaogang Gong,et al.  Object Tracking Using Adaptive Color Mixture Models , 1998, ACCV.

[15]  W. Eric L. Grimson,et al.  Adaptive background mixture models for real-time tracking , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[16]  Andrew Blake,et al.  Separability of pose and expression in facial tracking and animation , 1998, Sixth International Conference on Computer Vision (IEEE Cat. No.98CH36271).

[17]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Sami Romdhani,et al.  Selective vs . Global Recovery of Rigid and Non-Rigid Motion , 2003 .