Facial expression recognition based on CNN

Facial expression recognition has been an active research area recently, and many kinds of methods have been proposed. In this project, we mainly used two mainstream Convolutional Neural Networks, AlexNet and GoogLeNet, to recognize human facial expression and emotion. CNNs are capable of extracting powerful information about a facial image by using multiple layers of feature detectors. Based on the two CNNs, some novel and helpful methods are used in data preprocessing and model optimization. The recognition results show that the CNNs used in this project has a good performance in terms of accuracy.

[1]  David Zhang,et al.  Deep Cascade Model-Based Face Recognition: When Deep-Layered Learning Meets Small Data , 2020, IEEE Transactions on Image Processing.

[2]  Gang Wang,et al.  Joint Feature Learning for Face Recognition , 2015, IEEE Transactions on Information Forensics and Security.

[3]  Zhengyou Zhang,et al.  Comparison between geometry-based and Gabor-wavelets-based facial expression recognition using multi-layer perceptron , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[4]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[5]  Jiwen Lu,et al.  Simultaneous Feature and Dictionary Learning for Image Set Based Face Recognition , 2014, IEEE Transactions on Image Processing.

[6]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[7]  Keun-Chang Kwak,et al.  Facial Expression Recognition Using 3D Convolutional Neural Network , 2014 .

[8]  Yajie Tian,et al.  Handbook of face recognition , 2003 .

[9]  Jake K. Aggarwal,et al.  Facial expression recognition with temporal modeling of shapes , 2011, 2011 IEEE International Conference on Computer Vision Workshops (ICCV Workshops).

[10]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[11]  Jiann-Der Lee,et al.  Halftone Image Classification Using LMS Algorithm and Naive Bayes , 2011, IEEE Transactions on Image Processing.

[12]  Josiane Zerubia,et al.  A Level Set Model for Image Classification , 1999, International Journal of Computer Vision.

[13]  Soo-Young Lee,et al.  Hierarchical committee of deep convolutional neural networks for robust facial expression recognition , 2016, Journal on Multimodal User Interfaces.

[14]  C. Darwin,et al.  The Expression of the Emotions in Man and Animals , 1956 .

[15]  Jiwen Lu,et al.  Single Sample Face Recognition via Learning Deep Supervised Autoencoders , 2015, IEEE Transactions on Information Forensics and Security.

[16]  Ping Liu,et al.  Facial Expression Recognition via a Boosted Deep Belief Network , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Luca Maria Gambardella,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Flexible, High Performance Convolutional Neural Networks for Image Classification , 2022 .

[18]  Stan Z. Li,et al.  Regularized Transfer Boosting for Face Detection Across Spectrum , 2012, IEEE Signal Processing Letters.