View-based active appearance models

We demonstrate that a small number of 2D statistical models are sufficient to capture the shape and appearance of a face from any viewpoint (full profile to front-to-parallel). Each model is linear and can be matched rapidly to new images using the active appearance model algorithm. We show how such a set of models can be used to estimate head pose, to track faces through large angles of head rotation and to synthesize faces from unseen viewpoints.

[1]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[2]  Hiroshi Murase,et al.  Learning and recognition of 3D objects from appearance , 1993, [1993] Proceedings IEEE Workshop on Qualitative Vision.

[3]  Alex Pentland,et al.  Face recognition using view-based and modular eigenspaces , 1994, Optics & Photonics.

[4]  Thomas Vetter,et al.  Learning novel views to a single face image , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[5]  Christoph von der Malsburg,et al.  Tracking and learning graphs and pose on image sequences of faces , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[6]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Timothy F. Cootes,et al.  Interpreting face images using active appearance models , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[8]  D. B. Graham,et al.  Face recognition from unfamiliar views: subspace methods and pose dependency , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[9]  Shaogang Gong,et al.  Learning Support Vector Machines for A Multi-View Face Model , 1999, BMVC.

[10]  Shaogang Gong,et al.  Understanding Pose Discrimination in Similarity Space , 1999, BMVC.

[11]  Nicholas Costen,et al.  Automatic extraction of the face identity-subspace , 2002, Image and Vision Computing.

[12]  Shaogang Gong,et al.  A Multi-View Nonlinear Active Shape Model Using Kernel PCA , 1999, BMVC.

[13]  Timothy F. Cootes,et al.  Advances in active appearance models , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[14]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Nicholas Costen,et al.  Automatic extraction of the face identity-subspace , 2002, Image Vis. Comput..