Gabor Feature Selection and Improved Radial Basis Function Networks for Facial Expression Recognition

This paper presents an improved radial basis function neural network with effective Gabor features for recognizing the seven basic facial expressions (anger, disgust, fear, happiness, sadness, surprise and neutral) from static images. The proposed improved RBF networks adopt a sigmoid function as their kernel due to its flexible decision boundary over the conventional Gaussian kernel. This study uses an M-estimator instead of the least-mean square criterion in the network updating procedure to enhance the network robustness. A growing and pruning algorithm adjusts the network size dynamically according to the neuron significance. Additionally, entropy criterion selects informative and non-redundant Gabor features. This feature selection reduces the feature dimension without losing much information and also decreases computation and storage requirements. The proposed improved RBF networks have demonstrated superior performance compared to conventional RBF networks. Experiment results show that our approach can accurately and robustly recognize facial expressions.

[1]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[2]  Jiang Wei,et al.  Application of Wavelet Energy Feature in Facial Expression Recognition , 2007, 2007 International Workshop on Anti-Counterfeiting, Security and Identification (ASID).

[3]  C. Darwin The Expression of the Emotions in Man and Animals , .

[4]  Narasimhan Sundararajan,et al.  An efficient sequential learning algorithm for growing and pruning RBF (GAP-RBF) networks , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[5]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[6]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[7]  T. Sejnowski,et al.  Measuring facial expressions by computer image analysis. , 1999, Psychophysiology.

[8]  Ashok Samal,et al.  Automatic recognition and analysis of human faces and facial expressions: a survey , 1992, Pattern Recognit..

[9]  Maja Pantic,et al.  Automatic Analysis of Facial Expressions: The State of the Art , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[11]  W. Liejun,et al.  Facial Expression Recognition Using Improved Support Vector Machine by Modifying Kernels , 2009 .

[12]  Patrick Shen-Pei Wang,et al.  Performance Comparisons of Facial Expression Recognition in Jaffe Database , 2008, Int. J. Pattern Recognit. Artif. Intell..

[13]  Qiuqi Ruan,et al.  Facial expression recognition based on two-dimensional discriminant locality preserving projections , 2008, Neurocomputing.

[14]  Siu-Yeung Cho,et al.  Expression recognition using fuzzy spatio-temporal modeling , 2008, Pattern Recognit..

[15]  Marian Stewart Bartlett,et al.  Classifying Facial Actions , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Jennifer S. Beer,et al.  Facial expression of emotion. , 2003 .

[17]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Ying Wang,et al.  Time series study of GGAP-RBF network: predictions of Nasdaq stock and nitrate contamination of drinking water , 2005, Proceedings. 2005 IEEE International Joint Conference on Neural Networks, 2005..

[19]  S. Demleitner [Communication without words]. , 1997, Pflege aktuell.

[20]  Thomas S. Huang,et al.  Facial expression recognition: A clustering-based approach , 2003, Pattern Recognit. Lett..

[21]  Xinhe Xu,et al.  Facial expression recognition based on PCA and NMF , 2008, 2008 7th World Congress on Intelligent Control and Automation.

[22]  Hua Yu,et al.  A direct LDA algorithm for high-dimensional data - with application to face recognition , 2001, Pattern Recognit..