Automatic Detailed Localization of Facial Features

We propose a complete framework for automatic detailed facial feature localization. Feature points and contours of the eyes, the nose, the mouth and the chin are of interest. Face detection is performed followed by the region detection that locates a rough bounding box of each facial component, and detailed features are then extracted within each bounding box. Since the feature points lie on the shape contours, we start from shape contour extraction, and then detect the feature points from the extracted contours. Experimental results show the robustness and accuracy of our methods. The main application of our work is automatic diagnosis based on facial features.

[1]  Alice Caplier,et al.  Accurate and quasi-automatic lip tracking , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[2]  Jie Yang,et al.  A robust method for eye features extraction on color image , 2005, Pattern Recognit. Lett..

[3]  Timothy F. Cootes,et al.  A Multi-Stage Approach to Facial Feature Detection , 2004, BMVC.

[4]  Mutsuo Sano,et al.  A parametric template method and its application to robust matching , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[5]  Wai-kuen Cham,et al.  Extracting eyebrow contour and chin contour for face recognition , 2007, Pattern Recognit..

[6]  Hyeonjoon Moon,et al.  The FERET Evaluation Methodology for Face-Recognition Algorithms , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Jianbo Su,et al.  Face contour detection using geometric active contours , 2002, Proceedings of the 4th World Congress on Intelligent Control and Automation (Cat. No.02EX527).

[8]  Ashwin B. Dalal,et al.  Morphometric analysis of face in dysmorphology , 2007, Comput. Methods Programs Biomed..

[9]  Guangda Su,et al.  The research of chin contour in fronto-parallel images , 2003, Proceedings of the 2003 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.03EX693).

[10]  Richard O. Duda,et al.  Use of the Hough transformation to detect lines and curves in pictures , 1972, CACM.

[11]  Osamu Yamaguchi,et al.  Facial feature localization using weighted vector concentration approach , 2010, Image Vis. Comput..

[12]  Vladimir Vezhnevets,et al.  Robust and Accurate Eye Contour Extraction , 2003 .

[13]  Liya Ding,et al.  Precise detailed detection of faces and facial features , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  Ioannis Pitas,et al.  Facial feature detection using distance vector fields , 2009, Pattern Recognit..

[15]  Markus Kampmann,et al.  MAP Estimation of Chin and Cheek Contours in Video Sequences , 2004, EURASIP J. Adv. Signal Process..

[16]  Shu Hung Leung,et al.  Lip segmentation by fuzzy clustering incorporating with shape function , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[17]  Ulrich Canzler,et al.  Extraction of Non Manual Features for Videobased Sign Language Recognition , 2002, MVA.

[18]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[19]  Tobias Vollmar,et al.  Syndrome identification based on 2D analysis software , 2006, European Journal of Human Genetics.

[20]  A proposal of improved lip contour extraction method using deformable template matching and its application to dental treatment , 2007 .

[21]  Karl Rohr,et al.  Localization of anatomical point landmarks in 3D medical images by fitting 3D parametric intensity models , 2006, Medical Image Anal..

[22]  Shu Hung Leung,et al.  Automatic lip contour extraction from color images , 2004, Pattern Recognit..

[23]  Hong Yan,et al.  An Analytic-to-Holistic Approach for Face Recognition Based on a Single Frontal View , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Jianbo Su,et al.  Multiple face contour detection based on geometric active contours , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[25]  James L. Crowley,et al.  Facial features detection robust to pose, illumination and identity , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[26]  Christoph von der Malsburg,et al.  Computer-based recognition of dysmorphic faces , 2003, European Journal of Human Genetics.

[27]  Rogério Schmidt Feris,et al.  Hierarchical wavelet networks for facial feature localization , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[28]  Harry Wechsler,et al.  The FERET database and evaluation procedure for face-recognition algorithms , 1998, Image Vis. Comput..

[29]  Kentaro Toyama,et al.  Wavelet Hierarchical Wavelet Networks for Facial Feature Localization , 2002 .

[30]  K. Boyer,et al.  Perceptual Organization for Artificial Vision Systems , 2000 .