2D Face Alignment and Pose Estimation Based on 3D Facial Models

Face alignment and head pose estimation has become a thriving research field with various applications for the past decade. Several approaches process on 2D texture image but most of them perform decently only with small pose variation. Recently, many approaches apply depth information to align objects. However, applications are restricted because depth cameras are more expensive than common cameras, and many original image resources contain no depth information. Therefore, we propose a 3D face alignment algorithm in 2D image based on Active Shape Model, and use Speeded-Up Robust Features (SURF) descriptors as local texture model. We train a 3D shape model with different view-based local texture models from a 3D database, and then fit a face in a 2D image by these models. We also improve the performance by two-stage search strategy. Furthermore, the head pose can be estimated by the alignment result of the proposed 3D model. Finally, we demonstrate some applications applied by our method.

[1]  Milan Sonka,et al.  Segmentation of cardiac MR images: an active appearance model approach , 2000, Medical Imaging: Image Processing.

[2]  Bernadette Dorizzi,et al.  3D Active Shape Model for Automatic Facial Landmark Location Trained with Automatically Generated Landmark Points , 2010, 2010 20th International Conference on Pattern Recognition.

[3]  Jing Xiao,et al.  Real-time combined 2D+3D active appearance models , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[4]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[5]  D. Petrovska-Delacretaz,et al.  Automatic landmark location with a Combined Active Shape Model , 2009, 2009 IEEE 3rd International Conference on Biometrics: Theory, Applications, and Systems.

[6]  Matthew Turk,et al.  A Morphable Model For The Synthesis Of 3D Faces , 1999, SIGGRAPH.

[7]  K. S. Arun,et al.  Least-Squares Fitting of Two 3-D Point Sets , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[10]  Binoy Pinto,et al.  Speeded Up Robust Features , 2011 .

[11]  Timothy F. Cootes,et al.  Active Appearance Models , 1998, ECCV.

[12]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[13]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Chieh-Chih Wang,et al.  3D active appearance model for aligning faces in 2D images , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Takeo Kanade,et al.  3D Alignment of Face in a Single Image , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).