Parametric models for facial features segmentation

In this paper, we are dealing with the problem of facial features segmentation (mouth, eyes and eyebrows). A specific parametric model is defined for each deformable feature, each model being able to take into account all the possible deformations. In order to initialize each model, some characteristic points are extracted on each image to be processed (for example, eyes corners, mouth corners and brows corners). In order to fit the model with the contours to be extracted, a gradient flow (of luminance or chrominance) through the estimated contour is maximized because at each point of the searched contour, the gradient (of luminance or chrominance) is normal. The definition of a model associated to each feature offers the possibility to introduce a regularization constraint. However, the chosen models are flexible enough to produce realistic contours for the mouth, the eyes and the eyebrows. This facial features segmentation is the first step of a set of multi-media applications.

[1]  Yannis Avrithis,et al.  Efficient face detection for multimedia applications , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[2]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[3]  Demetri Terzopoulos,et al.  Snakes: Active contour models , 2004, International Journal of Computer Vision.

[4]  Lorenzo Torresani,et al.  2D Deformable Models for Visual Speech Analysis , 1996 .

[5]  Narendra Ahuja,et al.  Gaussian mixture model for human skin color and its applications in image and video databases , 1998, Electronic Imaging.

[6]  Timothy F. Cootes,et al.  Active Shape Models-Their Training and Application , 1995, Comput. Vis. Image Underst..

[7]  David G. Stork,et al.  Using deformable templates to infer visual speech dynamics , 1994, Proceedings of 1994 28th Asilomar Conference on Signals, Systems and Computers.

[8]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[9]  Ioannis Pitas,et al.  Looking for Faces and Facial Features in Color Images , 1997 .

[10]  Mark A. Clements,et al.  Visual speech feature extraction for improved speech recognition , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[11]  Alice Caplier,et al.  A parametric model for realistic lip segmentation , 2002, 7th International Conference on Control, Automation, Robotics and Vision, 2002. ICARCV 2002..

[12]  Alice Caplier,et al.  New color transformation for lips segmentation , 2001, 2001 IEEE Fourth Workshop on Multimedia Signal Processing (Cat. No.01TH8564).

[13]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[14]  Tomaso A. Poggio,et al.  Learning a Color Algorithm from Examples , 1987, NIPS.

[15]  Alan L. Yuille,et al.  Feature extraction from faces using deformable templates , 2004, International Journal of Computer Vision.

[16]  Tomaso Poggio,et al.  Synthesizing a color algorithm from examples , 1988 .

[17]  T. Poggio,et al.  Synthesizing a color algorithm from examples. , 1988, Science.

[18]  Alice Caplier,et al.  Jumping snakes and parametric model for lip segmentation , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[19]  Demetri Terzopoulos,et al.  Analysis and Synthesis of Facial Image Sequences Using Physical and Anatomical Models , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[20]  Narendra Ahuja,et al.  Detecting Faces in Images: A Survey , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  Stéphane Mancini,et al.  An IIR based 2D adaptive and predictive cache for image processing , 2004 .

[22]  Zakia Hammal,et al.  Belief Theory Applied to Facial Expressions Classification , 2005, ICAPR.

[23]  Jeffrey F. Cohn,et al.  Robust Lip Tracking by Combining Shape, Color and Motion , 2007 .

[24]  Takeo Kanade,et al.  Dual-state parametric eye tracking , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[25]  Yao Wang,et al.  Facial feature extraction and tracking in video sequences , 1997, Proceedings of First Signal Processing Society Workshop on Multimedia Signal Processing.

[26]  Aggelos K. Katsaggelos,et al.  Audio-Visual Speech Recognition Using MPEG-4 Compliant Visual Features , 2002, EURASIP J. Adv. Signal Process..

[27]  Erik Hjelmås,et al.  Face Detection: A Survey , 2001, Comput. Vis. Image Underst..

[28]  Kevin P. Murphy,et al.  A coupled HMM for audio-visual speech recognition , 2002, 2002 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[29]  Marie-Odile Berger,et al.  Towards autonomy in active contour models , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.