Facial expression recognition using LBP and LPQ based on Gabor wavelet transform

In this paper, a novel facial expression recognition method using local binary pattern (LBP) and local phase quantization (LPQ) based on Gabor face image is proposed. To capture the salient visual properties, the Gabor filter is firstly adopted to extract features of the face image among five scales and eight orientations. Then the Gabor image is encoded by the LBP operator and LPQ operator, respectively. Two-stage principal component analysis and linear discriminant analysis (PCA-LDA) approach are used to reduce the dimension of the fused feature combined by the Gabor LBP feature and Gabor LPQ feature. In the experiment, the classification is done by the multi-class SVM classifiers based on the Japanese female facial expression (JAFFE) database. The result shows that the proposed method outperforms many other approaches in this paper in terms of accuracy.

[1]  Shi Dongcheng,et al.  Facial Expression Recognition Based on Gabor Wavelet Phase Features , 2013, 2013 Seventh International Conference on Image and Graphics.

[2]  Yehoshua Y. Zeevi,et al.  The Generalized Gabor Scheme of Image Representation in Biological and Machine Vision , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  R. Azmi,et al.  Facial expression recognition in the presence of occlusion using local Gabor binary patterns , 2012, 20th Iranian Conference on Electrical Engineering (ICEE2012).

[4]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[5]  Zhen Wang,et al.  Facial Expression Recognition Based on Local Phase Quantization and Sparse Representation , 2012, ICNC.

[6]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Zilu Ying,et al.  Facial expression recognition by fusion of gabor texture features and local phase quantization , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[8]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Quan-You Zhao,et al.  Facial expression recognition based on fusion of Gabor and LBP features , 2008, 2008 International Conference on Wavelet Analysis and Pattern Recognition.

[10]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Peng Wu,et al.  Face Expression Recognition Based on Feature Fusion , 2009, 2009 International Workshop on Intelligent Systems and Applications.

[12]  Yan Zhang,et al.  Facial Expression Recognition under Partial Occlusion Based on Gabor Multi-orientation Features Fusion and Local Gabor Binary Pattern Histogram Sequence , 2013, 2013 Ninth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[13]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..