Feature Acquisition for Facial Expression Recognition Using Deep Convolutional Neural Network

We present a convolutional neural network for facial expression recognition based on feature acquisition. The proposed method adopts the structure of dual-channel convolution neural network, the network structure of each channel is designed according to the input sets, the extracted face and the extracted mouth are used as input to two channels simultaneously. Experiments are carried out on two different data sets include JEFFA and FER-2013 to determine the recognition accuracy, and we build a set to test our model, and we compare the generalization performance by using the confusion matrix, then we compared and analyzed the experiment results of recognition accuracy under different facial expressions. Finally, our facial expression recognition system got an accuracy of 82% and 78% respectively, and learning meta face recognition in unseen domains should be researched in the future.

[1]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[2]  Hui Wang,et al.  Deep Convolutional Neural Network for Facial Expression Recognition Using Facial Parts , 2017, 2017 IEEE 15th Intl Conf on Dependable, Autonomic and Secure Computing, 15th Intl Conf on Pervasive Intelligence and Computing, 3rd Intl Conf on Big Data Intelligence and Computing and Cyber Science and Technology Congress(DASC/PiCom/DataCom/CyberSciTech).

[3]  Zhang Yi,et al.  Evolving Unsupervised Deep Neural Networks for Learning Meaningful Representations , 2017, IEEE Transactions on Evolutionary Computation.

[4]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[5]  George D. C. Cavalcanti,et al.  Facial expression Recognition based on Motion Estimation , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[6]  Amit Konar,et al.  General and Interval Type-2 Fuzzy Face-Space Approach to Emotion Recognition , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[7]  Haifeng Hu,et al.  Facial Expression Recognition Using Hierarchical Features With Deep Comprehensive Multipatches Aggregation Convolutional Neural Networks , 2019, IEEE Transactions on Multimedia.

[8]  Luc Van Gool,et al.  Covariance Pooling for Facial Expression Recognition , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[9]  Martin Kampel,et al.  Facial Expression Recognition using Convolutional Neural Networks: State of the Art , 2016, ArXiv.

[10]  Tong Zhang,et al.  A Deep Neural Network-Driven Feature Learning Method for Multi-view Facial Expression Recognition , 2016, IEEE Transactions on Multimedia.

[11]  Alexander Binder,et al.  Evaluating the Visualization of What a Deep Neural Network Has Learned , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[12]  P. Ekman,et al.  What the face reveals : basic and applied studies of spontaneous expression using the facial action coding system (FACS) , 2005 .

[13]  Tamás D. Gedeon,et al.  Collecting Large, Richly Annotated Facial-Expression Databases from Movies , 2012, IEEE MultiMedia.

[14]  Jinhua She,et al.  Information-Driven Multirobot Behavior Adaptation to Emotional Intention in Human–Robot Interaction , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[15]  Edmund Y. Lam,et al.  Facial expression recognition using deep neural networks , 2015, 2015 IEEE International Conference on Imaging Systems and Techniques (IST).

[16]  Ting Zhang,et al.  Facial Expression Recognition Based on Deep Learning: A Survey , 2017 .

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[19]  Min Wu,et al.  Weight-Adapted Convolution Neural Network for Facial Expression Recognition in Human–Robot Interaction , 2019, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[20]  Thomas S. Huang,et al.  Facial expression recognition: A clustering-based approach , 2003, Pattern Recognit. Lett..

[21]  Jaeyeon Lee,et al.  Facial Attribute Recognition by Recurrent Learning With Visual Fixation , 2019, IEEE Transactions on Cybernetics.

[22]  Razvan Pascanu,et al.  Combining modality specific deep neural networks for emotion recognition in video , 2013, ICMI '13.

[23]  Nan Xiao,et al.  Real-Time Facial Expression Recognition Using Deep Convolutional Neural Network , 2019, 2019 IEEE International Conference on Mechatronics and Automation (ICMA).

[24]  Liton Chandra Paul,et al.  Face recognition using Principal Component Analysis method , 2012 .