Automatic landmarking of faces in 3D - ALF 3D

We present an algorithm for automatic localization of landmarks on 3D faces. An active shape model, ASM, is used as a statistical joint location model for configurations of facial features. The ASM is adapted to individual faces via a guided search whereby landmark specific shape index models are matched to local surface patches. The algorithm is trained and tested on 912 3D face images from the face recognition grand challenge dataset. Results demonstrate that the automatic procedure successfully and reliably locates landmarks and, compared with an iterative closest point (ICP) algorithm, reduces the mean error for location of landmarks by nearly a half. ©2008 The Institution of Engineering and Technology.

[1]  Zhaohui Wu,et al.  3D face recognition using local shape map , 2004, 2004 International Conference on Image Processing, 2004. ICIP '04..

[2]  Yunhong Wang,et al.  A 3D Facial Feature Point Localization Method Based on Statistical Shape Model , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[3]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Aly A. Farag,et al.  Surfacing Signatures: An Orientation Independent Free-Form Surface Representation Scheme for the Purpose of Objects Registration and Matching , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  S. Hashimoto,et al.  Automated feature extraction of face image and its applications , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[6]  Chitra Dorai,et al.  COSMOS - A Representation Scheme for 3D Free-Form Objects , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[8]  신형철 3D face recognition with geometrically localized surface shape indexes , 2006 .

[9]  Seong-Whan Lee,et al.  Face Detection and Facial Component Extraction by Wavelet Decomposition and Support Vector Machines , 2003, AVBPA.

[10]  Timothy F. Cootes,et al.  Active Shape Model Search using Local Grey-Level Models: A Quantitative Evaluation , 1993, BMVC.

[11]  Ioannis A. Kakadiaris,et al.  Three-Dimensional Face Recognition in the Presence of Facial Expressions: An Annotated Deformable Model Approach , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Anil K. Jain,et al.  Automatic feature extraction for multiview 3D face recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[13]  Maurício Pamplona Segundo,et al.  Automatic 3D facial segmentation and landmark detection , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[14]  Andrew W. Fitzgibbon Robust registration of 2D and 3D point sets , 2003, Image Vis. Comput..

[15]  Adrian Hilton,et al.  A Validated Method for Dense Non-rigid 3D Face Registration , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[16]  Chin-Seng Chua,et al.  Facial feature detection and face recognition from 2D and 3D images , 2002, Pattern Recognit. Lett..

[17]  Patrick J. Flynn,et al.  Multiple Nose Region Matching for 3D Face Recognition under Varying Facial Expression , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.