A 3D Statistical Facial Feature Model and Its Application on Locating Facial Landmarks

3D face landmarking aims at automatic localization of 3D facial features and has a wide range of applications, including face recognition, face tracking, facial expression analysis. Methods so far developed for 2D images were shown sensitive to lighting condition changes. In this paper, we propose a learning-based approach for reliable locating of face landmarks in 3D. Our approach relies on a statistical model, called 3D Statistical Facial feAture Model(SFAM) in the paper, which learns both global variations in 3D face morphology and local ones around the 3D face landmarks in terms of local texture and shape. Experimented on FRGC v1.0 dataset, our approach shows its effectiveness and achieves 99.09% of locating accuracy in 10mm precision. The mean error and standard deviation of each landmark are respectively less than 5mm and 4.

[1]  L. Akarun,et al.  3D Facial Landmarking under Expression, Pose, and Occlusion Variations , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.

[2]  Tieniu Tan,et al.  Combining local features for robust nose location in 3D facial data , 2006, Pattern Recognit. Lett..

[3]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[4]  Patrick J. Flynn,et al.  Rotated Profile Signatures for robust 3D feature detection , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[5]  Patrick J. Flynn,et al.  Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[7]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[8]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Zhengyou Zhang,et al.  Iterative point matching for registration of free-form curves and surfaces , 1994, International Journal of Computer Vision.

[10]  Thomas Vetter,et al.  A morphable model for the synthesis of 3D faces , 1999, SIGGRAPH.

[11]  Cristina Conde,et al.  3D Facial Normalization with Spin Images and Influence of Range Data Calculation over Face Verification , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[12]  Anil K. Jain,et al.  Automatic feature extraction for multiview 3D face recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[13]  Anil K. Jain,et al.  Detection of Anchor Points for 3D Face Veri.cation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[14]  Pierre Soille,et al.  Morphological Image Analysis: Principles and Applications , 2003 .

[15]  B. Dorizzi,et al.  Precise Localization of Landmarks on 3D Faces using Gabor Wavelets , 2007, 2007 First IEEE International Conference on Biometrics: Theory, Applications, and Systems.

[16]  Vitoantonio Bevilacqua,et al.  Extending Hough Transform to a Points' Cloud for 3D-Face Nose-Tip Detection , 2008, ICIC.

[17]  David Cristinacce,et al.  Automatic feature localisation with constrained local models , 2008, Pattern Recognit..

[18]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[19]  A. Bovik,et al.  Automated Facial Feature Detection from Portrait and Range Images , 2008, 2008 IEEE Southwest Symposium on Image Analysis and Interpretation.

[20]  Bülent Sankur,et al.  Robust facial landmarking for registration , 2007, Ann. des Télécommunications.

[21]  M. Romero-Huertas,et al.  3D Facial Landmark Localisation by Matching Simple Descriptors , 2008, 2008 IEEE Second International Conference on Biometrics: Theory, Applications and Systems.