Study of video based facial expression and emotions recognition methods

In real life scenario, facial expressions and emotions are nothing but responses to the external and internal events of human being. In human computer interaction, recognition of end user's expressions and emotions from the video streaming plays very important role. In such systems it is required to track the dynamic changes in human face movements quickly in order to deliver the required response system. The one real time application is physical fatigue detection based on facial detection and expressions such as driver fatigue detection in order to prevent the accidents on road. Face expression based physical fatigue analysis or detection is out of scope of this paper, but this paper reveal study on different methods those are presented recently for facial expression and/or emotions recognition using video. This paper presenting the methodologies in terms of feature extraction and classification used in facial expression and/or emotion recognition methods with their comparative study. The comparative study is done based on accuracy, implementation tool, advantages and disadvantages. The outcome of this paper is the current research gap and research challenges those are still open to solve for video based facial detection and recognition systems. The survey on recent methods is appropriately presented throughout this paper by considering future research works.

[1]  Rosdiyana Samad Edge-based Facial Feature Extraction Using Gabor Wavelet and Convolution Filters , 2011, MVA.

[2]  Wankou Yang,et al.  Video-based facial expression recognition using histogram sequence of local Gabor binary patterns from three orthogonal planes , 2014, Proceedings of the 33rd Chinese Control Conference.

[3]  Thomas B. Moeslund,et al.  Facial video-based detection of physical fatigue for maximal muscle activity , 2016, IET Comput. Vis..

[4]  Sukanya Sagarika Meher,et al.  Face recognition and facial expression identification using PCA , 2014, 2014 IEEE International Advance Computing Conference (IACC).

[5]  Jun Li,et al.  Robust Representation and Recognition of Facial Emotions Using Extreme Sparse Learning , 2015, IEEE Transactions on Image Processing.

[6]  Le Hoang Thai,et al.  A Facial Expression Classification System Integrating Canny, Principal Component Analysis and Artificial Neural Network , 2011, ArXiv.

[7]  Rajendran Parthiban,et al.  Spatiotemporal feature extraction for facial expression recognition , 2016, IET Image Process..

[8]  Sachin Kansal,et al.  Human Facial Expression Recognition using Gabor Filter Bank with Minimum Number of Feature Vectors , 2013 .

[9]  Dac-Nhuong Le,et al.  Performance Evaluation of Video-Based Face Recognition Approaches for Online Video Contextual Advertisement User-Oriented System , 2016 .

[10]  Pojala Chiranjeevi,et al.  Neutral Face Classification Using Personalized Appearance Models for Fast and Robust Emotion Detection , 2015, IEEE Transactions on Image Processing.

[11]  Shikha Tripathi,et al.  Dynamic facial emotion recognition from 4D video sequences , 2015, 2015 Eighth International Conference on Contemporary Computing (IC3).

[12]  Aniruddha Dey,et al.  A contour based procedure for face detection and tracking from video , 2016, 2016 3rd International Conference on Recent Advances in Information Technology (RAIT).

[13]  Jun Yu,et al.  A Video-Based Facial Motion Tracking and Expression Recognition System , 2016, Multimedia Tools and Applications.