A Facial Expression Recognition Method by Fusing Multiple Sparse Representation Based Classifiers

We develop a new method to recognize facial expressions. Sparse representation based classification (SRC) is used as the classifier in this method, because of its robustness to occlusion. Histograms of Oriented Gradient (HOG) descriptors and Local Binary Patterns are used to extract features. Since the results of HOG+SRC and LBP+SRC are complimentary, we use a classifier combination strategy to fuse these two results. Experiments on Cohn-Kanade database show that the proposed method gives better performance than existing methods such as Eigen+SRC, LBP+SRC and so on. Furthermore, the proposed method is robust to assigned occlusion.

[1]  Ming-Wei Huang,et al.  The performance study of facial expression recognition via sparse representation , 2010, 2010 International Conference on Machine Learning and Cybernetics.

[2]  C. Izard.  The face of emotion , 1971 .

[3]  Mohammed Yeasin,et al.  From facial expression to level of interest: a spatio-temporal approach , 2004, CVPR 2004.

[4]  Jacob Whitehill,et al.  Haar features for FACS AU recognition , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[5]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Jun Ou,et al.  Automatic Facial Expression Recognition Using Gabor Filter and Expression Analysis , 2010, 2010 Second International Conference on Computer Modeling and Simulation.

[7]  Zi-Lu Ying,et al.  A new method for facial expression recognition based on sparse representation plus LBP , 2010, 2010 3rd International Congress on Image and Signal Processing.

[8]  Shaogang Gong,et al.  Robust facial expression recognition using local binary patterns , 2005, IEEE International Conference on Image Processing 2005.

[9]  Shane F. Cotter.  Recognition of occluded facial expressions using a Fusion of Localized Sparse Representation Classifiers , 2011, 2011 Digital Signal Processing and Signal Processing Education Meeting (DSP/SPE).

[10]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[11]  Qingshan Liu,et al.  Exploring facial expressions with compositional features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[12]  Shane F. Cotter,et al.  Sparse Representation for accurate classification of corrupted and occluded facial expressions , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Jiri Matas,et al.  On Combining Classifiers , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Y. V. Venkatesh,et al.  Facial expression recognition using radial encoding of local Gabor features and classifier synthesis , 2012, Pattern Recognit..

[17]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.