A fast and robust method for the identification of face landmarks in profile images

Several applications in Computer Vision, like recognition, identification, automatic 3D modeling and animation and non conventional human computer interaction require the precise identification of landmark points in facial images. Here we present a fast and robust algorithm capable of identifying a specific set of landmarks on face profile images. First, the face is automatically segmented from the image. Then, the face landmarks are extracted. The algorithm is based on the local curvature of the profile contour and on the local analysis of the face features. The robustness of the presented approach is demonstrated by a set of experiments were ground truth data are compared with the result of our algorithm. A percentage of 92% correct identification and a mean error of 3.5 pixels demonstrate the robustness of the approach, which is of paramount importance for several applications.

[1]  Cristina Manresa-Yee,et al.  Face-Based Perceptual Interface for Computer- Human interaction , 2006 .

[2]  Andrea Giuseppe Bottino.  Real time head and facial features tracking from uncalibrated monocular views , 2002 .

[3]  Ilse Ravyse,et al.  Robust Shape-Based Head Tracking , 2007, ACIVS.

[4]  Sylvie Lelandais,et al.  Face detection by neural network trained with Zernike moments , 2007 .

[5]  Kuo-Young Cheng,et al.  An automatic construction of a person's face model from the person's two orthogonal views , 2002, Geometric Modeling and Processing. Theory and Applications. GMP 2002. Proceedings.

[6]  David Machin.  Real-Time Facial Analysis for Virtual Teleconferencing , 1996 .

[7]  Frans Vos,et al.  On Normalized Convolution to Measure Curvature Features for Automatic Polyp Detection , 2004, MICCAI.

[8]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Rama Chellappa,et al.  Gabor attributes tracking for face verification , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[10]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[11]  Marcel J. T. Reinders,et al.  Locating facial features in image sequences using neural networks , 1996, Proceedings of the Second International Conference on Automatic Face and Gesture Recognition.

[12]  Ashok Samal,et al.  Face recognition using landmark-based bidimensional regression , 2005, Fifth IEEE International Conference on Data Mining (ICDM'05).

[13]  Juan Zapata,et al.  A hybrid snake for selective contour detection , 2007 .

[14]  Weiwei Zhang,et al.  Face-tracking as an augmented input in video games: enhancing presence, role-playing and control , 2006, CHI.

[15]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[16]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[17]  Aldo Laurentini,et al.  A New Computer-aided Technique for Planning the Aesthetic Outcome of Plastic Surgery , 2008, WSCG 2008.

[18]  Ashok Samal,et al.  How effective are landmarks and their geometry for face recognition? , 2006, Comput. Vis. Image Underst..

[19]  D. Jimenez.  Craniofacial Anthropometry: Practical Measurement of the Head and Face for Clinical, Surgical and Research Use , 1998 .

[20]  Gary Bradski,et al.  Computer Vision Face Tracking For Use in a Perceptual User Interface , 1998 .

[21]  Youngjoon Han,et al.  Face region detection using DCT and homomorphic filter , 2007 .

[22]  Wei-Ying Ma,et al.  Realistic 3D Face Modeling by Fusing Multiple 2D Images , 2005, 11th International Multimedia Modelling Conference.

[23]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[24]  Michael T. Longaker.  Craniofacial Anthropometry, Practical Measurement of the Head and Face for Clinical Surgical and Research Use , 1998 .

[25]  Yuxiao Hu,et al.  Automatic 3D reconstruction for face recognition , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[26]  Gerhard Rigoll,et al.  Recognition of JPEG compressed face images based on statistical methods , 2000, Image Vis. Comput..

[27]  Raymond N. J. Veldhuis,et al.  A landmark paper in face recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).