Facial features extraction in color images using enhanced active shape model

In this paper, we present an improved active shape model (ASM) for facial feature extraction. The original ASM method developed by Cootes et al. highly relies on the initialization and the representation of the local structure of the facial features in the image. We use color information to improve the ASM approach for facial feature extraction. The color information is used to localize the centers of the mouth and the eyes to assist the initialization step. Moreover, we model the local structure of the feature points in the RGB color space. Besides, we use 2D affine transformation to align facial features that are perturbed by head pose variations. In fact, the 2D affine transformation compensates for the effects of both head pose variations and the projection of 3D data to 2D. Experiments on a face database of 50 subjects show that our approach outperforms the standard ASM and is successful in facial feature extraction

[1]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[2]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[3]  A-Nasser Ansari,et al.  Automatic facial feature extraction and 3D face modeling using two orthogonal views with application to 3D face recognition , 2005, Pattern Recognit..

[4]  Se-Young Oh,et al.  Facial feature extraction using PCA and wavelet multi-resolution images , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[5]  Harry Shum,et al.  Face alignment using statistical models and wavelet features , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Wen Gao,et al.  An improved active shape model for face alignment , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[7]  Wen Gao,et al.  Constraint Shape Model Using Edge Constraint and Gabor Wavelet Based Search , 2003, AVBPA.

[8]  Alejandro F Frangi,et al.  A non-linear gray-level appearance model improves active shape model segmentation , 2001, Proceedings IEEE Workshop on Mathematical Methods in Biomedical Image Analysis (MMBIA 2001).

[9]  King Ngi Ngan,et al.  An energy function for facial feature extraction , 2001, Proceedings of 2001 International Symposium on Intelligent Multimedia, Video and Speech Processing. ISIMP 2001 (IEEE Cat. No.01EX489).

[10]  Ioannis Pitas,et al.  Facial feature extraction using adaptive Hough transform, template matching and active contour models , 1997, Proceedings of 13th International Conference on Digital Signal Processing.

[11]  Timothy F. Cootes,et al.  Automatic Interpretation and Coding of Face Images Using Flexible Models , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Ju-Jang Lee,et al.  Face detection and facial feature extraction using color snake , 2002 .

[13]  Rogério Schmidt Feris,et al.  Active Wavelet Networks for Face Alignment , 2003, BMVC.

[14]  Gary G. Yen,et al.  Facial feature extraction using genetic algorithm , 2002, Proceedings of the 2002 Congress on Evolutionary Computation. CEC'02 (Cat. No.02TH8600).

[15]  Seong-Whan Lee,et al.  Face Detection and Facial Component Extraction by Wavelet Decomposition and Support Vector Machines , 2003, AVBPA.

[16]  F.G.B. De Natale,et al.  A symmetry-based approach to facial features extraction , 1997, Proceedings of 13th International Conference on Digital Signal Processing.

[17]  S. Hashimoto,et al.  Automated feature extraction of face image and its applications , 1995, Proceedings 4th IEEE International Workshop on Robot and Human Communication.

[18]  Anil K. Jain,et al.  Face Detection in Color Images , 2002, IEEE Trans. Pattern Anal. Mach. Intell..