Facial Expression Recognition using Low Level Histogram Features

The proposed framework recognizes facial expressions with the minimal histogram features. Emotional parts of the face are traced with the combination of face detection and facial landmark techniques; HOG integrated with a linear Support Vector Machine [SVM] classifier framework is adopted for face detection. The landmark points are aligned by using an ensemble of regression algorithm. The aligned facial landmark points are integrated by using a Delaunay triangulation. The mask is created by means of the convex hull points. The emotional parts of the face are isolated by the mask. For feature extraction, HOG and LDP descriptors are utilized to derive the distinct features of the detected face area. The dimensions of the fused feature vectors are reduced with the use of single-layer auto-encoder. The downsized features are recognized by using the soft-max layer. Facial expressions are recognized from still images and video frames. Images are collected from JAFFE, WSEFEP datasets, RAVEES audio-visual database and some of the images are collected from internet. The performance of the proposed model attains 95.7%.

[1]  S. R. Livingstone,et al.  The Ryerson Audio-Visual Database of Emotional Speech and Song (RAVDESS): A dynamic, multimodal set of facial and vocal expressions in North American English , 2018, PloS one.

[2]  H JamesDevaKoresh,et al.  COMPUTER VISION BASED TRAFFIC SIGN SENSING FOR SMART TRANSPORT , 2019, Journal of Innovative Image Processing.

[3]  Serestina Viriri,et al.  Facial Expression Recognition: A Review of Methods, Performances and Limitations , 2019, 2019 Conference on Information Communications Technology and Society (ICTAS).

[4]  Jules-Raymond Tapamo,et al.  A comparative study of the use of local directional pattern for texture-based informal settlement classification , 2017 .

[5]  Carlo Tomasi,et al.  Histograms of Oriented Gradients , 2015 .

[6]  Amit Konar,et al.  Emotion Recognition: A Pattern Analysis Approach , 2015 .

[7]  Sergio Escalera,et al.  Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Maja Pantic,et al.  Automatic Analysis of Facial Actions: A Survey , 2019, IEEE Transactions on Affective Computing.

[10]  Andrea Cavallaro,et al.  Automatic Analysis of Facial Affect: A Survey of Registration, Representation, and Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  P. Lewinski,et al.  Warsaw set of emotional facial expression pictures: a validation study of facial display photographs , 2015, Front. Psychol..

[12]  Hongxun Yao,et al.  Auto-encoder based dimensionality reduction , 2016, Neurocomputing.

[13]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Li Zhuo,et al.  Comparative Study on Dimensionality Reduction in Large-Scale Image Retrieval , 2013, 2013 IEEE International Symposium on Multimedia.

[15]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[16]  Xin Jin,et al.  Face alignment in-the-wild: A Survey , 2016, Comput. Vis. Image Underst..