Facial expression recognition based on completed local binary pattern and SRC

In this paper, we propose an effective algorithm for facial expression recognition (FER), which is based on completed local binary pattern (CLBP) and sparse representation. The new method solves sparse representations on both gray facial expression images and completed local binary pattern (CLBP) of these images. Afterwards, we obtain the both expression recognition results on both of expression features by sparse representation classification (SRC) method. Finally, the final expression recognition is obtained by fusion of the both results via comparing the residue ratios of sparse representations. The proposed method is experimented on Japanese Female Facial Expression (JAFFE) database. The experiment results show that the performance improves obviously by fusion approach. The proposed fusion algorithm is also assessed in comparison with the well known algorithms such as KPCA+SVM, LDA+SVM etc. The results illustrate that the proposed method has better performance than those traditional algorithms.

[1]  Haibin Ling,et al.  Robust Visual Tracking and Vehicle Classification via Sparse Representation , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  David L Donoho,et al.  Compressed sensing , 2006, IEEE Transactions on Information Theory.

[4]  Saumil Srivastava.  Real time facial expression recognition using a novel method , 2012, ArXiv.

[5]  Maja Pantic,et al.  Facial Expression Recognition , 2009, Encyclopedia of Biometrics.

[6]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Tanaya Guha,et al.  Learning Sparse Representations for Human Action Recognition , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Ammad Ali,et al.  Face Recognition with Local Binary Patterns , 2012 .

[9]  Ying Zilu,et al.  Facial Expression Recognition Based on NMF and SVM , 2009, 2009 International Forum on Information Technology and Applications.

[10]  E.J. Candes.  Compressive Sampling , 2022 .

[11]  Maja Pantic,et al.  Fully Automatic Recognition of the Temporal Phases of Facial Actions , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[12]  D. Donoho.  For most large underdetermined systems of equations, the minimal 𝓁1‐norm near‐solution approximates the sparsest near‐solution , 2006 .

[13]  Zhenhua Guo,et al.  A Completed Modeling of Local Binary Pattern Operator for Texture Classification , 2010, IEEE Transactions on Image Processing.