A New Appearance-Based Facial Expression Recognition System with Expression Transition Matrices

In this study, we propose a novel image-based facial expression recognition method called "expression transition" to identify six kinds of facial expressions (anger, fear, happiness, neutral, sadness, and surprise) at low-resolution images. The boosted tree classifiers and template matching are used to locate and crop the effective face region that may characterize the facial expressions. Then, the expression transformed images via a set of expression transition matrices are matched with the real facial images to identify the facial expressions. The proposed system can recognize the facial expressions with the speed of 0.24 seconds per frame and accuracy. above 86%.

[1]  Bo Wu,et al.  Real time facial expression recognition with AdaBoost , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[2]  Hyeran Byun,et al.  A Simple Illumination Normalization Algorithm for Face Recognition , 2002, PRICAI.

[3]  Leonardo Trujillo,et al.  Automatic Feature Localization in Thermal Images for Facial Expression Recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05) - Workshops.

[4]  Gwen Littlewort,et al.  Recognizing facial expression: machine learning and application to spontaneous behavior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  Chung-Lin Huang,et al.  Facial Expression Recognition Using Model-Based Feature Extraction and Action Parameters Classification , 1997, J. Vis. Commun. Image Represent..

[7]  Shaogang Gong,et al.  Recognizing facial expressions at low resolution , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[8]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[9]  Steven J. Leon.  Linear Algebra With Applications , 1980 .

[10]  Shaogang Gong,et al.  Robust facial expression recognition using local binary patterns , 2005, IEEE International Conference on Image Processing 2005.

[11]  Ioannis Pitas,et al.  Real time facial expression recognition from image sequences using support vector machines , 2005, IEEE International Conference on Image Processing 2005.

[12]  Akira Utsumi,et al.  Human detection using geometrical pixel value structures , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[13]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Zhi-Hua Zhou,et al.  Projection functions for eye detection , 2004, Pattern Recognit..

[15]  Kyunghee Lee,et al.  Eye and face detection using SVM , 2004, Proceedings of the 2004 Intelligent Sensors, Sensor Networks and Information Processing Conference, 2004..

[16]  George N. Votsis,et al.  Emotion recognition in human-computer interaction , 2001, IEEE Signal Process. Mag..

[17]  Pengfei Shi,et al.  A Robust and Accurate Method for Pupil Features Extra , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[18]  Hirotake Yamazoe,et al.  Adaptation of Appearance Model for Human Tracking Using Geometorical Pixel Value Distributions , 2003 .

[19]  Ying Zi Lu,et al.  Facial expression recognition based on wavelet transform and MLP neural network , 2004, Proceedings 7th International Conference on Signal Processing, 2004. Proceedings. ICSP '04. 2004..