Automated emotion recognition employing a novel modified binary quantum-behaved gravitational search algorithm with differential mutation

The present paper proposes a supervised learning based automated human facial emotion recognition strategy with a feature selection scheme employing a novel variation of the gravitational search algorithm GSA. The initial feature set is generated from the facial images by using the 2-D discrete cosine transform DCT and then the proposed modified binary quantum GSA with differential mutation MBQGSA-DM is utilized to select a sub-set of features with high discriminative power. This is achieved by minimising the cost function formulated as the ratio of the within class and interclass distances. The overall system performs its final classification task based on selected feature inputs, utilising a back propagation based artificial neural network ANN. Extensive experimental evaluations are carried out utilising a standard, benchmark emotion database, that is, Japanese Female Facial Expresssion JAFFE database and the results clearly indicate that the proposed method outperforms several existing techniques, already known in literature for solving similar problems. Further validation has also been carried out on a facial expression database developed at Jadavpur University, Kolkata, India and the results obtained further strengthen the notion of superiority of the proposed method.

[1]  Patrick Shen-Pei Wang,et al.  Performance Comparisons of Facial Expression Recognition in Jaffe Database , 2008, Int. J. Pattern Recognit. Artif. Intell..

[2]  Qiuqi Ruan,et al.  Facial expression recognition based on two-dimensional discriminant locality preserving projections , 2008, Neurocomputing.

[3]  Shu Liao,et al.  Facial Expression Recognition using Advanced Local Binary Patterns, Tsallis Entropies and Global Appearance Features , 2006, 2006 International Conference on Image Processing.

[4]  Fei Cheng,et al.  Facial Expression Recognition in JAFFE Dataset Based on Gaussian Process Classification , 2010, IEEE Transactions on Neural Networks.

[5]  Songfeng Lu,et al.  An improved quantum-behaved particle swarm optimization method for short-term combined economic emission hydrothermal scheduling , 2010 .

[6]  Ganesh K. Venayagamoorthy,et al.  Recognition of facial expressions using Gabor wavelets and learning vector quantization , 2008, Eng. Appl. Artif. Intell..

[7]  Luiz Eduardo Soares de Oliveira,et al.  2D Principal Component Analysis for Face and Facial-Expression Recognition , 2011, Computing in Science & Engineering.

[8]  Kyandoghere Kyamakya,et al.  Non-intrusive car driver's emotion recognition using thermal camera , 2011, Proceedings of the Joint INDS'11 & ISTET'11.

[9]  Aliaa A. A. Youssif,et al.  Automatic Facial Expression Recognition System Based on Geometric and Appearance Features , 2011, Comput. Inf. Sci..

[10]  Weifeng Liu,et al.  Facial Expression Recognition Based on Fusion of Multiple Gabor Features , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[11]  Amitava Chatterjee,et al.  A novel local extrema based gravitational search algorithm and its application in face recognition using one training image per class , 2014, Eng. Appl. Artif. Intell..

[12]  Shervin Shirmohammadi,et al.  Driver drowsiness monitoring based on yawning detection , 2011, 2011 IEEE International Instrumentation and Measurement Technology Conference.

[13]  Mann Oo. Hay Emotion recognition in human-computer interaction , 2012 .

[14]  M. Milanova,et al.  Recognition of Emotional states in Natural Human-Computer Interaction , 2008, 2008 IEEE International Symposium on Signal Processing and Information Technology.

[15]  Zhengyou Zhang,et al.  Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[16]  Amitava Chatterjee,et al.  A novel binary adaptive weight GSA based feature selection for face recognition using local gradient patterns, modified census transform, and local binary patterns , 2014, Eng. Appl. Artif. Intell..

[17]  Beat Fasel,et al.  Automatic facial expression analysis: a survey , 2003, Pattern Recognit..

[18]  Dimitrios I. Fotiadis,et al.  An automatic region based methodology for facial expression recognition , 2008, 2008 IEEE International Conference on Systems, Man and Cybernetics.

[19]  Venu Govindaraju,et al.  Direct and Indirect Human Computer Interaction Based Biometrics , 2007, J. Comput..

[20]  Sachin S. Pande,et al.  A Survey on: Emotion Recognition with respect to Database and Various Recognition Techniques , 2012 .

[21]  Hossein Nezamabadi-pour,et al.  A Quantum Behaved Gravitational Search Algorithm , 2012 .

[22]  Danny Crookes,et al.  Multimodal Biometric Human Recognition for Perceptual Human–Computer Interaction , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[23]  Daijin Kim,et al.  Robust face detection using local gradient patterns and evidence accumulation , 2012, Pattern Recognit..

[24]  Li-Yeh Chuang,et al.  Feature Selection using PSO-SVM , 2007, IMECS.

[25]  F. Khoshahval,et al.  Quantum behaved Particle Swarm Optimization with Differential Mutation operator applied to WWER-1000 in-core fuel management optimization , 2013 .

[26]  Hossein Nezamabadi-pour,et al.  GSA: A Gravitational Search Algorithm , 2009, Inf. Sci..

[27]  Amit Konar,et al.  A Computational Intelligence Approach to Emotion Recognition from the Lip-Contour of a Subject , 2013 .