Automatic Facial Feature Extraction and Facial Expression Recognition

In this paper, we present an automatic algorithm for facial expression recognition. We first propose a method for automatic facial feature extraction, based on the analysis of outputs of local Gabor filters. Such analysis is done using a spatial adaptive triangulation of the magnitude of the filtered images. Then, we propose a classification procedure for facial expression recognition, considering the internal part of registered still faces. Principal Component Analysis allows to represent faces in a low-dimensional space, defined by basis functions that are adapted to training sets of facial expressions. We show how to select the best basis functions for facial expression recognition, providing a good linear discrimination: results prove the robustness of the recognition method.

[1]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Patrick Pérez,et al.  Generalized likelihood ratio-based face detection and extraction of mouth features , 1997, Pattern Recognit. Lett..

[3]  Hyeonjoon Moon,et al.  The FERET verification testing protocol for face recognition algorithms , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[4]  Franck Davoine,et al.  A solution for facial expression representation and recognition , 2002, Signal Process. Image Commun..

[5]  J. N. Bassili Emotion recognition: the role of facial movement and the relative importance of upper and lower areas of the face. , 1979, Journal of personality and social psychology.

[6]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[7]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[8]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[9]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Larry S. Davis,et al.  Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow , 1996, IEEE Trans. Pattern Anal. Mach. Intell..