Facial expression recognition based on Haar-like feature detection

In this paper we propose a novel approach for facial feature detection in color image sequences using Haar-like classifiers. The feature extraction is initialized without manual input and has the capability to fulfill the real time requirement. For facial expression recognition, we use geometrical measurement and simple texture analysis in detecting facial regions based on the prior detected facial feature points. For expression classification we used a three layer feed forward artificial neural network. The efficiency of the suggested approach is demonstrated under real world conditions.

[1]  Ian R. Fasel,et al.  Fully Automatic Coding of Basic Expressions from Video , 2002 .

[2]  Franck Davoine,et al.  Statistical modeling for facial expression analysis and synthesis , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[3]  Pengfei Shi,et al.  Facial Components Detection with Boosting and Geometric Constraints , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[4]  John D. Fernandez,et al.  Facial feature detection using Haar classifiers , 2006 .

[5]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Stefanos D. Kollias,et al.  Intelligent Facial Analysis and Expression Recognition , 2006, The 2006 IEEE International Joint Conference on Neural Network Proceedings.

[7]  Nicu Sebe,et al.  Emotion Recognition Based on Joint Visual and Audio Cues , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[8]  Ahmed M. Elgammal,et al.  Nonlinear Shape and Appearance Models for Facial Expression Analysis and Synthesis , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[9]  Robert Fischer,et al.  Recognizing Expressions in a New Database Containing Played and Natural Expressions , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[10]  Fadi Dornaika,et al.  Facial Expression Recognition using Auto-regressive Models , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[12]  F. Wallhoff,et al.  The Facial Expressions and Emotions Database Homepage (FEEDTUM) , 2005 .

[13]  Peter W. McOwan,et al.  A real-time automated system for the recognition of human facial expressions , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).