Improved GA and Pareto optimization-based facial expression recognition

Purpose The purpose of this paper is to improve the accuracy of the facial expression recognition by using genetic algorithm (GA) with an appropriate fitness evaluation function and Pareto optimization model with two new objective functions. Design/methodology/approach To achieve facial expression recognition with high accuracy, the Haar-like features representation approach and the bilateral filter are first used to preprocess the facial image. Second, the uniform local Gabor binary patterns are used to extract the facial feature so as to reduce the feature dimension. Third, an improved GA and Pareto optimization approach are used to select the optimal significant features. Fourth, the random forest classifier is chosen to achieve the feature classification. Subsequently, some comparative experiments are implemented. Finally, the conclusion is drawn and some future research topics are pointed out. Findings The experiment results show that the proposed facial expression recognition algorithm outperforms ones in the existing literature in terms of both the actuary and computational time. Originality/value The GA and Pareto optimization algorithm are combined to select the optimal significant feature. To improve the accuracy of the facial expression recognition, the GA is improved by adjusting an appropriate fitness evaluation function, and a new Pareto optimization model is proposed that contains two objective functions indicating the achievements in minimizing within-class variations and in maximizing between-class variations.

[1]  Çigdem Eroglu Erdem,et al.  Gaussian mixture model based estimation of the neutral face shape for emotion recognition , 2014, Digit. Signal Process..

[2]  Derui Ding,et al.  Event-triggered consensus control for discrete-time stochastic multi-agent systems: The input-to-state stability in probability , 2015, Autom..

[3]  David Robinson,et al.  Ambient intelligence for optimal manufacturing and energy efficiency , 2015 .

[4]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[5]  Huijun Gao,et al.  Finite-horizon estimation of randomly occurring faults for a class of nonlinear time-varying systems , 2014, Autom..

[6]  Ville Ojansivu,et al.  Blur Insensitive Texture Classification Using Local Phase Quantization , 2008, ICISP.

[7]  Hasan Demirel,et al.  Improved SIFT matching for pose robust facial expression recognition , 2011, Face and Gesture 2011.

[8]  Qingshan Liu,et al.  Learning active facial patches for expression analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Kevin Hapeshi,et al.  A new method for face detection in colour images for emotional bio-robots , 2010 .

[10]  Bo Shen A survey on the applications of the Krein-space theory in signal estimation , 2014 .

[11]  Kamlesh Mistry,et al.  Intelligent Appearance and shape based facial emotion recognition for a humanoid robot , 2014, The 8th International Conference on Software, Knowledge, Information Management and Applications (SKIMA 2014).

[12]  Tomoyuki Hiroyasu,et al.  SPEA2+: Improving the Performance of the Strength Pareto Evolutionary Algorithm 2 , 2004, PPSN.

[13]  Kamlesh Mistry,et al.  Intelligent facial emotion recognition using a layered encoding cascade optimization model , 2015, Appl. Soft Comput..

[14]  Bir Bhanu,et al.  Facial expression recognition using emotion avatar image , 2011, Face and Gesture 2011.

[15]  El-Houssaine Aghezzaf,et al.  A model predictive control framework for centralised management of a supply chain dynamical system , 2014 .

[16]  Wen-Yang Chang,et al.  Illumination characteristics and image stitching for automatic inspection of bicycle part , 2014 .

[17]  James Lam,et al.  Finite-Horizon ${\cal H}_{\infty}$ Control for Discrete Time-Varying Systems With Randomly Occurring Nonlinearities and Fading Measurements , 2015, IEEE Transactions on Automatic Control.

[18]  Stan Z. Li,et al.  Face recognition using the nearest feature line method , 1999, IEEE Trans. Neural Networks.

[19]  Zidong Wang,et al.  H∞ state estimation with fading measurements, randomly varying nonlinearities and probabilistic distributed delays , 2015 .

[20]  Lothar Thiele,et al.  Multiobjective evolutionary algorithms: a comparative case study and the strength Pareto approach , 1999, IEEE Trans. Evol. Comput..

[21]  Norbert Krüger,et al.  Face Recognition by Elastic Bunch Graph Matching , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[23]  Xiaobo Lu,et al.  Boosting local Gabor binary patterns for gender recognition , 2013, 2013 Ninth International Conference on Natural Computation (ICNC).

[24]  Wen Gao,et al.  Local Gabor Binary Patterns Based on Mutual Information for Face Recognition , 2007, Int. J. Image Graph..

[25]  S. R. Khot,et al.  Facial Expression Recognition Using Principal Component Analysis , 2013 .

[26]  Kyung-Joong Jeong,et al.  Face recognition by weighted multi-resolution uniform local Gabor binary patterns , 2012, 2012 12th International Conference on Control, Automation and Systems.

[27]  Y. V. Venkatesh,et al.  Facial expression recognition using radial encoding of local Gabor features and classifier synthesis , 2012, Pattern Recognit..

[28]  Kamlesh Mistry,et al.  Adaptive facial point detection and emotion recognition for a humanoid robot , 2015, Comput. Vis. Image Underst..

[29]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Huijun Gao,et al.  Finite-horizon reliable control with randomly occurring uncertainties and nonlinearities subject to output quantization , 2015, Autom..

[31]  Rainer Müller,et al.  Inspector Robot – A new collaborative testing system designed for the automotive final assembly line , 2014 .