Rotation invariant Facial Expression Recognition in image sequences

Facial Expression Recognition has mostly been done on frontal or near frontal faces. However, most of the faces in real life are non-frontal. This paper deals with in-plane rotation of faces in image sequences and considers the six universal facial expressions. The proposed approach does not need to rotate the image to frontal position. FER by rotating images to frontal is sensitive to determination of rotation angle and can involve errors in tracking facial points. Directions of motion of Facial Feature Points(FFPs) is used for feature extraction. In training for six expressions, Gaussian Mixture Models are fit to the distribution of angles representing these directions of motion. These models are used for further classification of test sequences using SVM. Gaussian Mixture Modeling is experimentally found to be robust to errors in position of FFPs. For dimensionality reduction, feature selection is performed using Fisher ratio test.

[1]  Thomas S. Huang,et al.  A novel approach to expression recognition from non-frontal face images , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[2]  J. Cohn,et al.  Deciphering the Enigmatic Face , 2005, Psychological science.

[3]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[4]  Sholom M. Weiss,et al.  Predictive data mining - a practical guide , 1997 .

[5]  Jing Xiao,et al.  Automatic analysis and recognition of brow actions and head motion in spontaneous facial behavior , 2004, 2004 IEEE International Conference on Systems, Man and Cybernetics (IEEE Cat. No.04CH37583).

[6]  Masakazu Matsugu,et al.  Subject independent facial expression recognition with robust face detection using a convolutional neural network , 2003, Neural Networks.

[7]  Surendra Ranganath,et al.  Tracking facial features under occlusions and recognizing facial expressions in sign language , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[8]  Chung-Lin Huang,et al.  Facial Expression Recognition Using Model-Based Feature Extraction and Action Parameters Classification , 1997, J. Vis. Commun. Image Represent..

[9]  Lijun Yin,et al.  A study of non-frontal-view facial expressions recognition , 2008, 2008 19th International Conference on Pattern Recognition.

[10]  Richard Bowden,et al.  The Effect of Pose on Facial Expression Recognition , 2009, BMVC.

[11]  Takeo Kanade,et al.  Rotation Invariant Neural Network-Based Face Detection , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).