Subject-Independent Facial Expression Recognition with Biologically Inspired Features

Despite of much research for facial expression recognition, recognizing facial expressions across different persons is still a challenging computer vision task. However, facial expression analysis seems naturally for human visual system. Motivated by visual biology, this paper proposes an invariant feature extraction method for subject-independent facial expression recognition. In particular, we extract the biologically inspired facial features using extended visual cortex model-HMAX which consist of a template matching and a maximum pooling operation. We carefully organized the facial features and achieve subject-independent facial expression recognition using a sparse representation based classifier. The experiments on Yale database and JAFFE database demonstrate the significance of our proposed method for subject-independent facial expression recognition.

[1]  Gwen Littlewort,et al.  Analysis of Machine Learning Methods for Real-Time Recognition of Facial Expressions from Video , 2003 .

[2]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[3]  Hasan Demirel,et al.  Facial Expression Recognition Using 3D Facial Feature Distances , 2007, ICIAR.

[4]  Zhigang Luo,et al.  Online Nonnegative Matrix Factorization With Robust Stochastic Approximation , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Beat Fasel,et al.  Automatic facial expression analysis: a survey , 2003, Pattern Recognit..

[6]  Sridha Sridharan,et al.  Person-independent facial expression detection using Constrained Local Models , 2011, Face and Gesture 2011.

[7]  MengChu Zhou,et al.  Image Ratio Features for Facial Expression Recognition Application , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[8]  Zhigang Luo,et al.  NeNMF: An Optimal Gradient Method for Nonnegative Matrix Factorization , 2012, IEEE Transactions on Signal Processing.

[9]  Dacheng Tao,et al.  Sparse transfer learning for interactive video search reranking , 2012, TOMCCAP.

[10]  Victor-Emil Neagoe,et al.  Subject-independent emotion recognition from facial expressions using a Gabor feature RBF neural classifier trained with virtual samples generated by concurrent self-organizing maps , 2011 .

[11]  Zhigang Luo,et al.  Non-Negative Patch Alignment Framework , 2011, IEEE Transactions on Neural Networks.

[12]  Otman A. Basir,et al.  Dynamic Facial Expression Recognition Using Fuzzy Hidden Markov Models , 2005, 2005 IEEE International Conference on Systems, Man and Cybernetics.

[13]  Myung Jin Chung,et al.  Efficient rectangle feature extraction for real-time facial expression recognition based on AdaBoost , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[14]  Xuelong Li,et al.  General Tensor Discriminant Analysis and Gabor Features for Gait Recognition , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Thomas Serre,et al.  Robust Object Recognition with Cortex-Like Mechanisms , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[17]  Matthieu Cord,et al.  HMAX-S: Deep scale representation for biologically inspired image categorization , 2011, 2011 18th IEEE International Conference on Image Processing.

[18]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Vinay Bettadapura,et al.  Face Expression Recognition and Analysis: The State of the Art , 2012, ArXiv.

[20]  Chun Chen,et al.  Three-Dimensional Face Reconstruction From a Single Image by a Coupled RBF Network , 2012, IEEE Transactions on Image Processing.

[21]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.