Facial Expression Recognition Using Histogram of Oriented Gradients with SVM-RFE Selected Features

This study is an attempt towards improving the accuracy and execution time of a facial expression recognition (FER) system. The algorithmic pipeline consists of a face detector block, followed by a facial alignment and registration, feature extraction, feature selection, and classification blocks. The proposed method utilizes histograms of oriented gradients (HOG) descriptor to extract features from expressive facial images. Support vector machine recursive feature elimination (SVM-RFE), a powerful feature selection algorithm is applied to select the most discriminant features from high-dimensional feature space. Finally, the selected features were fed to a support vector machine (SVM) classifier to determine the underlying emotions from expressive facial images. Performance of the proposed approach is validated on three publicly available FER databases namely CK+, JAFFE, and RFD using different performance metrics like recognition accuracy, precision, recall, and F1-Score. The experimental results demonstrated the effectiveness of the proposed approach in terms of both recognition accuracy and execution time.

[1]  Fernando De la Torre,et al.  Supervised Descent Method and Its Applications to Face Alignment , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[2]  Xiaoyang Tan,et al.  Enhanced Local Texture Feature Sets for Face Recognition Under Difficult Lighting Conditions , 2007, IEEE Transactions on Image Processing.

[3]  Shiqing Zhang,et al.  Facial Expression Recognition Based on Local Binary Patterns and Kernel Discriminant Isomap , 2011, Sensors.

[4]  Muhammad Sajjad,et al.  Facial expression recognition using histogram of oriented gradients based transformed features , 2018, Cluster Computing.

[5]  Jason Weston,et al.  Gene Selection for Cancer Classification using Support Vector Machines , 2002, Machine Learning.

[6]  Skyler T. Hawk,et al.  Presentation and validation of the Radboud Faces Database , 2010 .

[7]  Ayyaz Hussain,et al.  Reliable facial expression recognition for multi-scale images using weber local binary image based cosine transform features , 2017, Multimedia Tools and Applications.

[8]  A. S. M. Shihavuddin,et al.  Compound local binary pattern (CLBP) for robust facial expression recognition , 2011, 2011 IEEE 12th International Symposium on Computational Intelligence and Informatics (CINTI).

[9]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[10]  Musaed Alhussein Automatic facial emotion recognition using weber local descriptor for e-Healthcare system , 2016, Cluster Computing.

[11]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[12]  Aurobinda Routray,et al.  Automatic facial expression recognition using features of salient facial patches , 2015, IEEE Transactions on Affective Computing.

[13]  Carlos Orrite-Uruñuela,et al.  HOG-Based Decision Tree for Facial Expression Classification , 2009, IbPRIA.

[14]  Jules R. Tapamo,et al.  Improved gradient local ternary patterns for facial expression recognition , 2017, EURASIP J. Image Video Process..

[15]  Oksam Chae,et al.  Local Directional Number Pattern for Face Analysis: Face and Expression Recognition , 2013, IEEE Transactions on Image Processing.

[16]  Yibin Li,et al.  Facial Expression Recognition with Fusion Features Extracted from Salient Facial Areas , 2017, Sensors.

[17]  Pierluigi Carcagnì,et al.  Facial expression recognition and histograms of oriented gradients: a comprehensive study , 2015, SpringerPlus.

[18]  Martin Köstinger,et al.  Efficient Metric Learning for Real-World Face Recognition , 2013 .

[19]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[20]  Emam Hossain,et al.  Automated Facial Expression Recognition Using Gradient-Based Ternary Texture Patterns , 2013 .

[21]  Shiqing Zhang,et al.  Facial expression recognition using local binary patterns and discriminant kernel locally linear embedding , 2012, EURASIP Journal on Advances in Signal Processing.

[22]  Uros Mlakar,et al.  Automated facial expression recognition based on histograms of oriented gradient feature vector differences , 2015, Signal Image Video Process..