Facial Expression Recognition Based on Discrete Separable Shearlet Transform and Feature Selection

In this paper, a novel approach to facial expression recognition based on the discrete separable shearlet transform (DSST) and normalized mutual information feature selection is proposed. The approach can be divided into five steps. First, all test and training images are preprocessed. Second, DSST is applied to the preprocessed facial expression images, and all the transformation coefficients are obtained as the original feature set. Third, an improved normalized mutual information feature selection is proposed to find the optimal feature subset of the original feature set, thus we can retain the key classification information of the original data. Fourth, the feature extraction and selection of the feature space is reduced by employing linear discriminant analysis. Finally, a support vector machine is used to recognize the expressions. In this study, experimental verification was carried out on four open facial expression databases. The results show that this method can not only improve the recognition rate of facial expressions, but also significantly reduce the computational complexity and improve the system efficiency.

[1]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[2]  Shigang Wang,et al.  A novel approach of facial expression recognition based on shearlet transform , 2017, 2017 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[3]  Ivan W. Selesnick,et al.  Wavelets, a modern tool for signal processing , 2007 .

[4]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[5]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[6]  Oksam Chae,et al.  Local Directional Number Pattern for Face Analysis: Face and Expression Recognition , 2013, IEEE Transactions on Image Processing.

[7]  Yoav Shoham,et al.  Fab: content-based, collaborative recommendation , 1997, CACM.

[8]  Symeon Papavassiliou,et al.  A holistic approach for personalization, relevance feedback & recommendation in enriched multimedia content , 2016, Multimedia Tools and Applications.

[9]  Huimin Lu,et al.  Facial Emotion Recognition Based on Biorthogonal Wavelet Entropy, Fuzzy Support Vector Machine, and Stratified Cross Validation , 2016, IEEE Access.

[10]  Lin Ma,et al.  Multimodal learning for facial expression recognition , 2015, Pattern Recognit..

[11]  Mohammad Reza Mohammadi,et al.  PCA-based dictionary building for accurate facial expression recognition via sparse representation , 2014, J. Vis. Commun. Image Represent..

[12]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[13]  李海波 Li Haibo,et al.  Research on Recognition for Facial Expression of Pain in Neonates , 2008 .

[14]  张强 Zhang Qiang,et al.  Fusion of Global and Local Various Feature for Facial Expression Recognition , 2014 .

[15]  Symeon Papavassiliou,et al.  Personalized multimedia content retrieval through relevance feedback techniques for enhanced user experience , 2015, 2015 13th International Conference on Telecommunications (ConTEL).

[16]  Jacek M. Zurada,et al.  Normalized Mutual Information Feature Selection , 2009, IEEE Transactions on Neural Networks.

[17]  Yassine Ruichek,et al.  Facial decomposition for expression recognition using texture/shape descriptors and SVM classifier , 2017, Signal Process. Image Commun..

[18]  Ioan Marius Bilasco,et al.  Impact of the face registration techniques on facial expressions recognition , 2018, Signal Process. Image Commun..

[19]  Yibin Li,et al.  Facial Expression Recognition with Fusion Features Extracted from Salient Facial Areas , 2017, Sensors.

[20]  Yi Wei,et al.  Research on Fault Diagnosis of a Marine Fuel System Based on the SaDE-ELM Algorithm , 2018, Algorithms.

[21]  Cüneyt Güzelis,et al.  A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering , 2014, Neural Computing and Applications.

[22]  Wang-Q Lim,et al.  The Discrete Shearlet Transform: A New Directional Transform and Compactly Supported Shearlet Frames , 2010, IEEE Transactions on Image Processing.

[23]  Roberto Battiti,et al.  Using mutual information for selecting features in supervised neural net learning , 1994, IEEE Trans. Neural Networks.

[24]  Deepak Ghimire,et al.  Geometric Feature-Based Facial Expression Recognition in Image Sequences Using Multi-Class AdaBoost and Support Vector Machines , 2013, Sensors.

[25]  Feng Chen,et al.  Facial expression recognition and its application based on curvelet transform and PSO-SVM , 2013 .

[26]  Ying-Yi Hong,et al.  Day-Ahead Electricity Price Forecasting Using a Hybrid Principal Component Analysis Network , 2012 .

[27]  Yanan Yu,et al.  A Prediction of Precipitation Data Based on Support Vector Machine and Particle Swarm Optimization (PSO-SVM) Algorithms , 2017, Algorithms.

[28]  Yudong Zhang,et al.  Facial Emotion Recognition via Discrete Wavelet Transform, Principal Component Analysis, and Cat Swarm Optimization , 2017, IScIDE.

[29]  Biao Hou,et al.  SAR Image Despeckling Based on Nonsubsampled Shearlet Transform , 2012, IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing.