Facial Emotion Recognition System Based on PCA and Gradient Features

AbstractAn efficient framework is proposed to deal with the facial emotions recognition problem. Since facial expressions result from facial muscle deformations, gradient features are exceptionally sensitive to the object deformations, so apply the gradients to encode these facial components as features. Then further it is joined by the testing process that classifies emotions and results are measured in terms of false acceptance rate, false rejection rate, and recognition accuracy. Proposed system was trained using random forest classifier to recognize the facial emotions. Japanese Female Facial Emotion (JAFFE) database consist of 5 typical emotions, namely, sad, happy, angry, neutral and surprise is considered for experimental results. Proposed framework can be used in real life applications like electroencephalogram in collaboration with brain computer interfaces. The average classification rate on the JAFEE dataset reaches 91.3%. In the proposed system hybridization of Gradient filter, PCA and PSO has been done for facial emotion recognition which has never been used earlier and this hybridization produces performs better than already existing techniques. Experimental results demonstrate the competitive classification accuracy of our proposed method.

[1]  Uros Mlakar,et al.  Automated facial expression recognition based on histograms of oriented gradient feature vector differences , 2015, Signal Image Video Process..

[2]  Tamás D. Gedeon,et al.  Emotion Recognition In The Wild Challenge 2014: Baseline, Data and Protocol , 2014, ICMI.

[3]  Alessandro Lameiras Koerich,et al.  Facial expression recognition using a pairwise feature selection and classification approach , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[4]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[5]  Ravindra C. Thool,et al.  Automatic facial feature extraction and expression recognition based on neural network , 2012, ArXiv.

[6]  Ninad Thakoor,et al.  Facial emotion recognition in continuous video , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[7]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[8]  S. R. Khot,et al.  Facial Expression Recognition Using Principal Component Analysis , 2013 .

[9]  V. U. Deshmukh,et al.  Geometric Approach for Human Emotion Recognition using Facial Expression , 2015 .

[10]  Nicu Sebe,et al.  Facial expression recognition from video sequences: temporal and static modeling , 2003, Comput. Vis. Image Underst..

[11]  Jingtian Li,et al.  Facial Expression Recognition Based on Geometric Features and Geodesic Distance , 2014 .

[12]  Antonio Frisoli,et al.  Real-time emotion recognition novel method for geometrical facial features extraction , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).