A Face Emotion Recognition Method Using Convolutional Neural Network and Image Edge Computing

To avoid the complex process of explicit feature extraction in traditional facial expression recognition, a face expression recognition method based on a convolutional neural network (CNN) and an image edge detection is proposed. Firstly, the facial expression image is normalized, and the edge of each layer of the image is extracted in the convolution process. The extracted edge information is superimposed on each feature image to preserve the edge structure information of the texture image. Then, the dimensionality reduction of the extracted implicit features is processed by the maximum pooling method. Finally, the expression of the test sample image is classified and recognized by using a Softmax classifier. To verify the robustness of this method for facial expression recognition under a complex background, a simulation experiment is designed by scientifically mixing the Fer-2013 facial expression database with the LFW data set. The experimental results show that the proposed algorithm can achieve an average recognition rate of 88.56% with fewer iterations, and the training speed on the training set is about 1.5 times faster than that on the contrast algorithm.

[1]  Qirong Mao,et al.  Hierarchical Bayesian Theme Models for Multipose Facial Expression Recognition , 2017, IEEE Transactions on Multimedia.

[2]  V. Magudeeswaran,et al.  Contrast limited fuzzy adaptive histogram equalization for enhancement of brain images , 2017, Int. J. Imaging Syst. Technol..

[3]  Haifeng Hu,et al.  Facial expression recognition with FRR-CNN , 2017 .

[4]  Yong Man Ro,et al.  Intra-Class Variation Reduction Using Training Expression Images for Sparse Representation Based Facial Expression Recognition , 2014, IEEE Transactions on Affective Computing.

[5]  Qiang Wu,et al.  A survey: facial micro-expression recognition , 2017, Multimedia Tools and Applications.

[6]  Yongzhao Zhan,et al.  Spatially Coherent Feature Learning for Pose-Invariant Facial Expression Recognition , 2018, ACM Trans. Multim. Comput. Commun. Appl..

[7]  Xin Yang,et al.  3D palmprint recognition using shape index representation and fragile bits , 2016, Multimedia Tools and Applications.

[8]  Mehmet Siraç Özerdem,et al.  Emotion recognition based on EEG features in movie clips with channel selection , 2017, Brain Informatics.

[9]  David Harvey,et al.  The behaviour of dark matter associated with four bright cluster galaxies in the 10 kpc core of Abell 3827 , 2015, 1504.03388.

[10]  Keun Ho Ryu,et al.  Semantic-Emotion Neural Network for Emotion Recognition From Text , 2019, IEEE Access.

[11]  Takeo Kanade,et al.  Guest Editorial: The Computational Face , 2018, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  Turgay Celik,et al.  FER‐Net: facial expression recognition using densely connected convolutional network , 2019, Electronics Letters.

[13]  Sang Hyun Park,et al.  Facial expression recognition based on local region specific features and support vector machines , 2016, Multimedia Tools and Applications.

[14]  Xiaolu Li,et al.  Pupil localization algorithm combining convex area voting and model constraint , 2017, Pattern Recognition and Image Analysis.

[15]  Ruoyu Du,et al.  Optimal Feature Selection and Deep Learning Ensembles Method for Emotion Recognition From Human Brain EEG Sensors , 2017, IEEE Access.

[16]  Zhigang Zhu,et al.  A recursive framework for expression recognition: from web images to deep models to game dataset , 2017, Machine Vision and Applications.

[17]  Maja Pantic,et al.  Fast Algorithms for Fitting Active Appearance Models to Unconstrained Images , 2016, International Journal of Computer Vision.

[18]  Ignazio Infantino,et al.  Person identification through entropy oriented mean shift clustering of human gaze patterns , 2015, Multimedia Tools and Applications.

[19]  John Cosmas,et al.  Time-Delay Neural Network for Continuous Emotional Dimension Prediction From Facial Expression Sequences , 2016, IEEE Transactions on Cybernetics.

[20]  Fei Yang,et al.  Is Interactional Dissynchrony a Clue to Deception? Insights From Automated Analysis of Nonverbal Visual Cues , 2015, IEEE Transactions on Cybernetics.

[21]  Wenming Zheng,et al.  MPED: A Multi-Modal Physiological Emotion Database for Discrete Emotion Recognition , 2019, IEEE Access.

[22]  Teng Li,et al.  Facial Expression Recognition with Faster R-CNN , 2017 .

[23]  Rajendran Parthiban,et al.  Joint facial expression recognition and intensity estimation based on weighted votes of image sequences , 2017, Pattern Recognit. Lett..

[24]  Shan Li,et al.  Reliable Crowdsourcing and Deep Locality-Preserving Learning for Unconstrained Facial Expression Recognition , 2019, IEEE Transactions on Image Processing.

[25]  Deepshikha Bhargava,et al.  A scheme of features fusion for facial expression analysis: A facial action recognition , 2017 .

[26]  Jun Cai,et al.  Facial Expression Recognition Method Based on Sparse Batch Normalization CNN , 2018, 2018 37th Chinese Control Conference (CCC).

[27]  A. V. Savchenko Deep neural networks and maximum likelihood search for approximate nearest neighbor in video-based image recognition , 2017, Optical Memory and Neural Networks.