Facial expression recognition using expression-specific local binary patterns and layer denoising mechanism

In this paper, a novel framework for facial expression recognition is proposed, which improves the conventional feature extraction technique to further exploit distinctive characters for each label. To reduce the effect from unrelated features for facial expression recognition, a denoising mechanism is introduced. After denoising, to keep the connection between expression labels and whiten features as well as reduce the amount of computation, a manifold learning algorithm is applied, which finding a meaningful low-dimensional structure hidden in the whiten feature space. Finally, the features in the low-dimensional space are fed into the well know classifier such as the support vector machine and k-Nearest Neighbors. Simulations show that the proposed framework achieves the best recognition performance against existing methods in facial expression recognition.

[1]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  Maja Pantic,et al.  The first facial expression recognition and analysis challenge , 2011, Face and Gesture 2011.

[4]  Michael I. Jordan,et al.  Advances in Neural Information Processing Systems 30 , 1995 .

[5]  Ioannis Pitas,et al.  ICA and Gabor representation for facial expression recognition , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[6]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[7]  Ying Zilu,et al.  Combining LBP and Adaboost for facial expression recognition , 2008, 2008 9th International Conference on Signal Processing.

[8]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[9]  Yue Gao.  Probabilistic Principle Component Analysis on Time Lapse images , 2010 .

[10]  Ioannis Pitas,et al.  Facial Expression Recognition in Image Sequences Using Geometric Deformation Features and Support Vector Machines , 2007, IEEE Transactions on Image Processing.

[11]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Stephen Lin,et al.  Marginal Fisher Analysis and Its Variants for Human Gait Recognition and Content- Based Image Retrieval , 2007, IEEE Transactions on Image Processing.

[13]  Jiliu Zhou,et al.  Geometric feature based facial expression recognition using multiclass support vector machines , 2009, 2009 IEEE International Conference on Granular Computing.

[14]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Michael E. Tipping,et al.  Probabilistic Principal Component Analysis , 1999 .

[16]  Guodong Guo,et al.  Simultaneous feature selection and classifier training via linear programming: a case study for face expression recognition , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[17]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..