Robust facial expression recognition based on RPCA and AdaBoost

In this paper, we consider the problem of robust facial expression recognition and propose a novel scheme for facial expression recognition under facial occlusion. There are two main contributions in this work. Firstly, a novel method for facial occlusion detection based on robust principal component analysis (RPCA) and saliency detection performs efficiently to detect facial occlusions. Secondly, a novel method based on occlusion reconstruction and reweighted AdaBoost classification is prosed for facial expression recognition. Experimental results have shown the effectiveness of our proposed method for robust facial expression recognition.

[1]  Michael J. Black,et al.  A Framework for Robust Subspace Learning , 2003, International Journal of Computer Vision.

[2]  Ioannis Pitas,et al.  Facial expression analysis under partial occlusion , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[3]  Christine L. Lisetti,et al.  Automatic facial expression interpretation: Where human-computer interaction, artificial intelligence and cognitive science intersect , 2000 .

[4]  Michael Brady,et al.  Saliency, Scale and Image Description , 2001, International Journal of Computer Vision.

[5]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[6]  Claude C. Chibelushi,et al.  Robust facial expression recognition using a state-based model of spatially-localised facial dynamics , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[7]  Claude C. Chibelushi,et al.  Recognition of Facial Expressions in the Presence of Occlusion , 2001, BMVC.

[8]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[9]  Fan Zhang,et al.  Beihang University Facial Expression Database and Multiple Facial Expression Recognition , 2006, 2006 International Conference on Machine Learning and Cybernetics.

[10]  Mel Slater,et al.  Reconstruction and Recognition of Occluded Facial Expressions Using PCA , 2007, ACII.

[11]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[12]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[13]  Ralph Gross,et al.  Active appearance models with occlusion , 2006, Image Vis. Comput..