Facial Emotion Recognition Using PHOG and a Hierarchical Expression Model

In this paper, we propose a fast approach to detecting human facial emotions, using a hierarchical multiple stage scheme and only the PHOG feature descriptors basing on frontal images of human faces. In this model, the facial expression is the composition of a set of expressive facial regions which can be evaluated with the trained emotional templates. Within this framework, the proposed algorithm is able to achieve acceptable detection accuracy for Cohn-Kanade dataset, with less time and space complexities compared with the approaches in other research literature, making it applicable to low cost hardware such as mobile device. In addition, the experiments illustrated that the approach presented in this paper has good robustness and extendibility.

[1]  Gwen Littlewort,et al.  Recognizing facial expression: machine learning and application to spontaneous behavior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[2]  Ioannis Pitas,et al.  Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines , 2007, IEEE Transactions on Image Processing.

[3]  Ioannis Pitas,et al.  Application of non-negative and local non negative matrix factorization to facial expression recognition , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[4]  Ralph Gross,et al.  Constructing and Fitting Active Appearance Models With Occlusion , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[5]  Vinay Bettadapura,et al.  Face Expression Recognition and Analysis: The State of the Art , 2012, ArXiv.

[6]  Ming-Hsuan Yang,et al.  Gender classification with support vector machines , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[7]  Franck Davoine,et al.  Facial expression recognition and synthesis based on an appearance model , 2004, Signal Process. Image Commun..

[8]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[9]  Aggelos K. Katsaggelos,et al.  Automatic facial expression recognition using facial animation parameters and multistream HMMs , 2006, IEEE Transactions on Information Forensics and Security.

[10]  Tamás D. Gedeon,et al.  Emotion recognition using PHOG and LPQ features , 2011, Face and Gesture 2011.

[11]  Ioannis A. Kakadiaris,et al.  3D facial expression recognition: A perspective on promises and challenges , 2011, Face and Gesture 2011.

[12]  Masahide Kaneko,et al.  Face and expression recognition based on bag of words method considering holistic and local image features , 2010, 2010 10th International Symposium on Communications and Information Technologies.

[13]  Ioannis Pitas,et al.  An analysis of facial expression recognition under partial facial image occlusion , 2008, Image Vis. Comput..

[14]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[15]  Zou Bei-ji,et al.  An Improved AAM Fitting Algorithm for Extracting Human Facial Features , 2006 .

[16]  Jie Cao,et al.  PAD Model Based Facial Expression Analysis , 2008, ISVC.

[17]  Fernando De la Torre,et al.  Facial Expression Analysis , 2011, Visual Analysis of Humans.

[18]  Andrew Zisserman,et al.  Representing shape with a spatial pyramid kernel , 2007, CIVR '07.

[19]  Michael Beetz,et al.  Model Based Analysis of Face Images for Facial Feature Extraction , 2009, CAIP.

[20]  Y. V. Venkatesh,et al.  Facial expression recognition using radial encoding of local Gabor features and classifier synthesis , 2012, Pattern Recognit..

[21]  Takeo Kanade,et al.  Facial Expression Analysis , 2011, AMFG.

[22]  Nicu Sebe,et al.  Authentic Facial Expression Analysis , 2004, FGR.