An ASM fitting method based on machine learning that provides a robust parameter initialization for AAM fitting

Due to their use of information contained in texture, active appearance models (AAM) generally outperform active shape models (ASM) in terms of fitting accuracy. Although many extensions and improvements over the original AAM have been proposed, on of the main drawbacks of AAMs remains its dependence on good initial model parameters to achieve accurate fitting results. In this paper, we determine the initial model parameters for AAM fitting with ASM fitting, and use machine learning techniques to improve the scope and accuracy of ASM fitting. Combining the precision of AAM fitting with the large radius of convergence of learned ASM fitting improves the results by an order of magnitude, as our empirical evaluation on a database of publicly available benchmark images demonstrates.

[1]  Klaus J. Kirchberg,et al.  Robust Face Detection Using the Hausdorff Distance , 2001, AVBPA.

[2]  Simon Baker,et al.  Active Appearance Models Revisited , 2004, International Journal of Computer Vision.

[3]  J. R. Quinlan.  Learning With Continuous Classes , 1992 .

[4]  Sridha Sridharan,et al.  Initialised eigenlip estimator for fast lip tracking using linear regression , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[5]  Wen Gao,et al.  An improved active shape model for face alignment , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[6]  Rasmus Larsen,et al.  Multi-band modelling of appearance , 2003, Image Vis. Comput..

[7]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[8]  Timothy F. Cootes,et al.  Facial feature detection and tracking with automatic template selection , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[9]  Björn Stenger,et al.  Multivariate Relevance Vector Machines for Tracking , 2006, ECCV.

[10]  Roland Göcke,et al.  A Nonlinear Discriminative Approach to AAM Fitting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[11]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Stan Z. Li,et al.  Direct appearance models , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[13]  Andrew Blake,et al.  Sparse Bayesian learning for efficient visual tracking , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Bernd Radig,et al.  Learning Local Objective Functions for Robust Face Model Fitting , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Horst Bischof,et al.  Active Feature Models , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[16]  Mikkel B. Stegmann,et al.  Active appearance models: Theory and cases , 2000 .

[17]  Bernd Radig,et al.  Tailoring Model-Based Techniques to Facial Expression Interpretation , 2008, First International Conference on Advances in Computer-Human Interaction.

[18]  Horst Bischof,et al.  Fast Active Appearance Model Search Using Canonical Correlation Analysis , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[19]  Aziz Umit Batur,et al.  Adaptive active appearance models , 2005, IEEE Transactions on Image Processing.

[20]  P. Kittipanya-ngam,et al.  The effect of texture representations on AAM performance , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[21]  Haizhou Ai,et al.  Texture-Constrained Shape Prediction for Mouth Contour Extraction and its State Estimation , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[22]  Ankur Agarwal,et al.  Recovering 3D human pose from monocular images , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  C. Taylor,et al.  Active shape models - 'Smart Snakes'. , 1992 .

[24]  Simon Baker,et al.  Lucas-Kanade 20 Years On: A Unifying Framework , 2004, International Journal of Computer Vision.

[25]  Sami Romdhani,et al.  Face image analysis using a multiple features fitting strategy , 2005 .