Automatic Facial Landmark Tracking in Video Sequences Using Kalman Filter Assisted Active Shape Models

In this paper we address the problem of automatically locating the facial landmarks of a single person across frames of a video sequence. We propose two methods that utilize Kalman filter based approaches to assist an Active Shape Model (ASM) in achieving this goal. The use of Kalman filtering not only aids in better initialization of the ASM by predicting landmark locations in the next frame but also helps in refining its search results and hence in producing improved fitting accuracy. We evaluate our tracking methods on frames from three video sequences and quantitatively demonstrate their reliability and accuracy.

[1]  Timothy F. Cootes,et al.  Statistical models of appearance for computer vision , 1999 .

[2]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[3]  Bernd Neumann,et al.  Computer Vision — ECCV’98 , 1998, Lecture Notes in Computer Science.

[4]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Seong-Won Lee,et al.  Hierarchical active shape model with motion prediction for real-time tracking of non-rigid objects , 2007 .

[6]  J. Gower.  Generalized procrustes analysis , 1975 .

[7]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Stan Z. Li,et al.  Advances in Biometrics, International Conference, ICB 2007, Seoul, Korea, August 27-29, 2007, Proceedings , 2007, ICB.

[9]  Timothy F. Cootes,et al.  Use of active shape models for locating structures in medical images , 1994, Image Vis. Comput..

[10]  Takeo Kanade,et al.  A Generative Shape Regularization Model for Robust Face Alignment , 2008, ECCV.

[11]  Bruce A. Draper,et al.  Overview of the Multiple Biometrics Grand Challenge , 2009, ICB.

[12]  Adam Baumberg.  Hierarchical shape fitting using an iterated linear filter , 1998, Image Vis. Comput..

[13]  David C. Hogg,et al.  An efficient method for contour tracking using active shape models , 1994, Proceedings of 1994 IEEE Workshop on Motion of Non-rigid and Articulated Objects.

[14]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[15]  T. Başar,et al.  A New Approach to Linear Filtering and Prediction Problems , 2001 .

[16]  Se-Young Oh,et al.  Real-time Recognition of Facial Expression using Active Appearance Model with Second Order Minimization and Neural Network , 2006, 2006 IEEE International Conference on Systems, Man and Cybernetics.

[17]  Timothy F. Cootes,et al.  The Use of Active Shape Models for Locating Structures in Medical Images , 1993, IPMI.

[18]  Marleen de Bruijne,et al.  Adapting Active Shape Models for 3D Segmentation of Tubular Structures in Medical Images , 2003, IPMI.

[19]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[20]  Jörgen Ahlberg,et al.  An Active Model for Facial Feature Tracking , 2002, EURASIP J. Adv. Signal Process..

[21]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[22]  Marios Savvides,et al.  Robust modified Active Shape Model for automatic facial landmark annotation of frontal faces , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[23]  尚弘 島影.  National Institute of Standards and Technologyにおける超伝導研究及び生活 , 2001 .

[24]  Timothy F. Cootes,et al.  Face Recognition Using Active Appearance Models , 1998, ECCV.

[25]  Thia Kirubarajan,et al.  Estimation with Applications to Tracking and Navigation: Theory, Algorithms and Software , 2001 .

[26]  Yongsheng Gao,et al.  Automated Face Pose Estimation Using Elastic Energy Models , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[27]  Pheng-Ann Heng,et al.  Video Facial Feature Tracking with Enhanced ASM and Predicted Meanshift , 2010, 2010 Second International Conference on Computer Modeling and Simulation.

[28]  Timothy F. Cootes,et al.  Active Shape Models: Evaluation of a Multi-Resolution Method for Improving Image Search , 1994, BMVC.