Emotion recognition from color facial images based on multilinear image analysis and Log-Gabor filters

A novel approach is proposed for emotion recognition from low resolution color facial images. The 3D color images are unfolded to 2D matrix based on multilinear algebra. Then, the features are extracted from them by Log-Gabor filters. The optimum features are selected based on mutual information. These features are classified using linear discriminant analysis (LDA) classifier. Experimental results carry out that the proposed method has large improvement in emotion recognition for 3D color facial images. Furthermore, the color subspace has a great impact in the rate of emotion recognition from low resolution images.

[1]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[2]  P. Ekman Facial expressions of emotion: an old controversy and new findings. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[3]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[6]  Demetri Terzopoulos,et al.  Multilinear image analysis for facial recognition , 2002, Object recognition supported by user interaction for service robots.

[7]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[8]  Rafael C. González,et al.  Digital image processing using MATLAB , 2006 .

[9]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Senthil Kumar,et al.  Face Recognition Using a Color Subspace LDA Approach , 2008, 2008 20th IEEE International Conference on Tools with Artificial Intelligence.

[11]  Lijun Yin,et al.  A high-resolution 3D dynamic facial expression database , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[12]  Zahir M. Hussain,et al.  Automatic facial expression recognition: feature extraction and selection , 2010, Signal, Image and Video Processing.