AUTOMATIC EXTRACTION OF FRONTAL FACIAL FEATURES

This paper describes algorithms for face and facial features detection in still frontal images. It is designed for the task of automatic image-based 3-D face modelling. This requires the detection to be accurate enough to produce exact facial features and robust to images of widely varying quality and picture taking conditions. The facial feature detection task is solved in several steps. First, facial area is detected using a novel method based on skin color segmentation and adaptive ellipse fitting. Next, eye positions are estimated by finding eye-shaped and eye-sized areas of red channel sharp changes. Finally, exact facial contours of eyes, eyebrows, nose, mouth, chin, and cheek are estimated by employing deformable models, template matching, and color segmentation. The main contribution of this paper is a set of innovations in face and facial feature detection algorithms that achieve high detection robustness and accuracy.

[1]  Mubarak Shah,et al.  Automatic Feature Detection and Pose Recovery for Faces , 2002 .

[2]  Jj Orgen Ahlberg,et al.  A System for Face Localization and Facial Feature Extraction , 1999 .

[3]  Lijun Yin,et al.  Nose shape estimation and tracking for model-based coding , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[4]  Volkan Atalay,et al.  Projection based method for segmentation of human face and its evaluation , 2002, Pattern Recognit. Lett..

[5]  José Santos-Victor,et al.  Active face and feature tracking , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[6]  Markus Kampmann,et al.  Estimation of eye, eyebrow and nose features in videophone sequences , 1998 .

[7]  Markus Kampmann Estimation of the chin and cheek contours for precise face model adaptation , 1997, Proceedings of International Conference on Image Processing.

[8]  Vladimir Vezhnevets,et al.  Robust and Accurate Eye Contour Extraction , 2003 .

[9]  Vladimir Vezhnevets,et al.  A Survey on Pixel-Based Skin Color Detection Techniques , 2003 .

[10]  Kentaro Toyama,et al.  “Look, Ma – No Hands!” Hands-Free Cursor Control with Real-Time 3D Face Tracking , 1998 .

[11]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Jianping Fan,et al.  Towards facial feature extraction and verification for omni-face detection in video/images , 2002, Proceedings. International Conference on Image Processing.

[13]  Pong C. Yuen,et al.  Multi-cues eye detection on gray intensity image , 2001, Pattern Recognit..