3D Face Landmarking Method under Pose and Expression Variations

A robust method is presented for 3D face landmarking with facial pose and expression variations. This method is based on Multi-level Partition of Unity (MPU) Implicits without relying on texture, pose, orientation and expression information. The MPU Implicits reconstruct 3D face surface in a hierarchical way. From lower to higher reconstruction levels, the local shapes can be reconstructed gradually according to their significance. For 3D faces, three landmarks, nose, left eyehole and right eyehole, can be detected uniquely with the analysis of curvature features at lower levels. Experimental results on GavabDB database show that this method is invariant to pose, holes, noise and expression. The overall performance of 98.59% is achieved under pose and expression variations.

[1]  Ramesh C. Jain,et al.  Invariant surface characteristics for 3D object recognition in range images , 1985, Comput. Vis. Graph. Image Process..

[2]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[3]  José F. Vélez,et al.  Face recognition using 3D surface extracted descriptors , 2003 .

[4]  Gaile G. Gordon,et al.  Face recognition based on depth and curvature features , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Hans-Peter Seidel,et al.  Multi-level partition of unity implicits , 2005, SIGGRAPH Courses.

[6]  Xun Gong,et al.  Automatic 3D Face Segmentation Based on Facial Feature Extraction , 2006, 2006 IEEE International Conference on Industrial Technology.

[7]  Patrick J. Flynn,et al.  Overview of the face recognition grand challenge , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[8]  Albert Ali Salah,et al.  3D Facial Feature Localization for Registration , 2006, MRCS.

[9]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[10]  T. Banchoff,et al.  Differential Geometry of Curves and Surfaces , 2010 .

[11]  Cristina Conde,et al.  3D Facial Feature Location with Spin Images , 2005, MVA.

[12]  Raimondo Schettini,et al.  3D face detection using curvature analysis , 2006, Pattern Recognit..