Facial Expression Recognition Based on Improved LeNet-5 CNN

Aiming at the influence of local occlusion on expression recognition, this paper proposes an improved cross-connected multi-layer LeNet-5 Convolutional Neural Network model. Under occlusion conditions, traditional machine learning methods are not robust due to lack of image information and noise interference, and the recognition rate is poor. Based on the advantages of deep learning in feature extraction, this paper adds a convolution layer and a pooling layer based on the LeNet-5 model. The low-level features extracted from the network structure are combined with the high-level features to construct the classifier. The implicit features are extracted by using the trainable convolution kernel, and the extracted implicit features are reduced by the pooling layer. Finally, the Softmax classifier is used for classification and recognition. The contrast experiment between the occlusion determination and the occlusion uncertainty is carried out, and the occlusion robustness of the improved method is verified.

[1]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[2]  Vinod Chandran,et al.  Toward a more robust facial expression recognition in occluded images using randomly sampled Gabor based templates , 2011, 2011 IEEE International Conference on Multimedia and Expo.

[3]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[4]  Andrea Cavallaro,et al.  Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Ioannis Pitas,et al.  Facial expression analysis under partial occlusion , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[6]  J. Russell,et al.  An approach to environmental psychology , 1974 .

[7]  Lijun Yin,et al.  FERA 2015 - second Facial Expression Recognition and Analysis challenge , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[8]  Maja Pantic,et al.  The first facial expression recognition and analysis challenge , 2011, Face and Gesture 2011.

[9]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[10]  Ligang Zhang Towards spontaneous facial expression recognition in real-world video , 2012 .

[11]  Claude C. Chibelushi,et al.  Recognition of Facial Expressions in the Presence of Occlusion , 2001, BMVC.