Multi-Level Haar Wavelet Based Facial Expression Recognition using Logistic Regression

Facial expressions play an equally important role as verbal communication and tonal expression. Recognition of facial expression is important in industrial automation, security, medical and many other fields. An image is a very rich and high dimensional data structure, which can result into a considerable computation when processed upon directly. Various feature extraction techniques have been proposed to represent the images efficiently in lower dimension which is understandable by the computer. Configuration and dynamics, both are crucial in the interpretation of facial expressions. This work is based on the configuration of facial texture, it does not account dynamics of muscle change. In this paper, we propose multilevel haar wavelet-based approach, which extracts the features from prominent face regions at two different scales. The approach first segments most informative geometric components such as eye, mouth, eyebrows etc. using the AdaBoost cascade object detector. Haar features of segmented components are extracted. OneVsAll logistic regression model is used for the classification. The performance of the proposed approach is tested on well-known CK, JAFFE and TFEID facial expression datasets, and it achieves 90.48%, 88.57% and 96.84% accuracy for the respective dataset.

[1]  Rosdiyana Samad Edge-based Facial Feature Extraction Using Gabor Wavelet and Convolution Filters , 2011, MVA.

[2]  Gwen Littlewort,et al.  Dynamics of Facial Expression Extracted Automatically from Video , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[3]  Alejandro F. Frangi,et al.  Two-dimensional PCA: a new approach to appearance-based face representation and recognition , 2004 .

[4]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[5]  Tomaso A. Poggio,et al.  A Trainable System for Object Detection , 2000, International Journal of Computer Vision.

[6]  Manasi Patil,et al.  Facial Expression Recognition Based on Image Feature , 2012 .

[7]  Y. V. Venkatesh,et al.  Facial expression recognition using radial encoding of local Gabor features and classifier synthesis , 2012, Pattern Recognit..

[8]  P. Ekman,et al.  Constants across cultures in the face and emotion. , 1971, Journal of personality and social psychology.

[9]  Michel F. Valstar,et al.  Local Gabor Binary Patterns from Three Orthogonal Planes for Automatic Facial Expression Recognition , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[10]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Marian Stewart Bartlett,et al.  Facial expression recognition using Gabor motion energy filters , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[12]  Radomir S. Stankovic,et al.  The Haar wavelet transform: its status and achievements , 2003, Comput. Electr. Eng..

[13]  Qingshan Liu,et al.  Exploring facial expressions with compositional features , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Stéphane Mallat,et al.  A Theory for Multiresolution Signal Decomposition: The Wavelet Representation , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Sergio Escalera,et al.  Survey on RGB, 3D, Thermal, and Multimodal Approaches for Facial Expression Recognition: History, Trends, and Affect-Related Applications , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[18]  M. Sasikumar,et al.  Analysis of Facial Expression using Gabor and , 2009 .

[19]  Raphael C.-W. Phan,et al.  Facial Expression Recognition in the Encrypted Domain Based on Local Fisher Discriminant Analysis , 2013, IEEE Transactions on Affective Computing.

[20]  KokSheik Wong,et al.  Accurate Facial Landmark Extraction , 2016, IEEE Signal Processing Letters.

[21]  S. J. Press,et al.  Choosing between Logistic Regression and Discriminant Analysis , 1978 .

[22]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Di Huang,et al.  Local Binary Patterns and Its Application to Facial Image Analysis: A Survey , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[24]  Beat Fasel,et al.  Automatic facial expression analysis: a survey , 2003, Pattern Recognit..

[25]  Joonki Paik,et al.  Comparative Analysis of Wavelet-Based Scale-Invariant Feature Extraction Using Different Wavelet Bases , 2009, FGIT-SIP.

[26]  A. Mehrabian Communication without words , 1968 .

[27]  Alex Pentland,et al.  Face recognition using eigenfaces , 1991, Proceedings. 1991 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[28]  P. Ekman,et al.  Facial action coding system: a technique for the measurement of facial movement , 1978 .

[29]  An Liu,et al.  New facial expression recognition based on FSVM and KNN , 2015 .

[30]  Alex Pentland,et al.  Coding, Analysis, Interpretation, and Recognition of Facial Expressions , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[31]  Gwen Littlewort,et al.  Recognizing facial expression: machine learning and application to spontaneous behavior , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[32]  Lionel Prevost,et al.  Facial Action Recognition Combining Heterogeneous Features via Multikernel Learning , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[33]  Ying-li Tian,et al.  Evaluation of Face Resolution for Expression Analysis , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[34]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[35]  Yongzhao Zhan,et al.  A neural-AdaBoost based facial expression recognition system , 2014, Expert Syst. Appl..

[36]  C. Darwin The Expression of the Emotions in Man and Animals , .

[37]  Larry S. Davis,et al.  Recognizing Human Facial Expressions From Long Image Sequences Using Optical Flow , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Weifeng Liu,et al.  Facial Expression Recognition Based on Fusion of Multiple Gabor Features , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[39]  Xin Geng,et al.  A multi-task model for simultaneous face identification and facial expression recognition , 2016, Neurocomputing.

[40]  Nong Sang,et al.  Robust automatic facial expression detection method based on sparse representation plus LBP map , 2013 .

[41]  Mohammed Yeasin,et al.  From facial expression to level of interest: a spatio-temporal approach , 2004, CVPR 2004.

[42]  Patrick Shen-Pei Wang,et al.  Performance Comparisons of Facial Expression Recognition in Jaffe Database , 2008, Int. J. Pattern Recognit. Artif. Intell..

[43]  Qiuqi Ruan,et al.  Facial expression recognition based on two-dimensional discriminant locality preserving projections , 2008, Neurocomputing.

[44]  Luiz Eduardo Soares de Oliveira,et al.  2D Principal Component Analysis for Face and Facial-Expression Recognition , 2011, Computing in Science & Engineering.

[45]  Hubert Konik,et al.  Framework for reliable, real-time facial expression recognition for low resolution images , 2013, Pattern Recognit. Lett..

[46]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[47]  Siu Cheung Hui,et al.  Facial expression recognition from line-based caricatures , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[48]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[49]  Richard Bowden,et al.  Local binary patterns for multi-view facial expression recognition , 2011 .

[50]  Xinhe Xu,et al.  Facial expression recognition based on PCA and NMF , 2008, 2008 7th World Congress on Intelligent Control and Automation.