Intelligent Real-Time Facial Expression Recognition from Video Sequences based on Hybrid Feature Tracking Algorithms

In this paper, a method for automatic facial expression recognition (FER) from video sequences is introduced. The features are extracted from tracking of facial landmarks. Each landmark component is tracked by appropriate method, results in proposing a hybrid technique that is able to achieve high recognition accuracy with limited feature dimensionality. Moreover, our approach aims to increase the system accuracy by increasing the FER recognition accuracy of the most overlapped expressions while achieving low processing time. Thus, the paper introduces also an intelligent Hierarchal Support Vector Machine (HSVM) to reduce the cross-correlation between the confusing expressions. The proposed system was trained and tested using a standard video sequence dataset for six facial expressions, and compared with previous work. Experimental results show an average of 96% recognition accuracy and average processing time of 93 msec.

[1]  Soraia Raupp Musse,et al.  Eyes and Eyebrows Detection for Performance Driven Animation , 2010, 2010 23rd SIBGRAPI Conference on Graphics, Patterns and Images.

[2]  Marian Stewart Bartlett,et al.  Exemplar Hidden Markov Models for classification of facial expressions in videos , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[3]  Maja Pantic,et al.  Facial point detection using boosted regression and graph models , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  V. U. Deshmukh,et al.  Geometric Approach for Human Emotion Recognition using Facial Expression , 2015 .

[5]  Alain Pruski,et al.  Human-Computer Interaction Using Emotion Recognition from Facial Expression , 2011, 2011 UKSim 5th European Symposium on Computer Modeling and Simulation.

[6]  Rembiye Kandemir,et al.  FACIAL EXPRESSION CLASSIFICATION WITH HAAR FEATURES, GEOMETRIC FEATURES AND CUBIC BÉZIER CURVES , 2013 .