Reliable facial expression recognition for multi-scale images using weber local binary image based cosine transform features

Accurate recognition of facial expression is a challenging problem especially from multi-scale and multi orientation face images. In this article, we propose a novel technique called Weber Local Binary Image Cosine Transform (WLBI-CT). WLBI-CT extracts and integrates the frequency components of images obtained through Weber local descriptor and local binary descriptor. These frequency components help in accurate classification of various facial expressions in the challenging domain of multi-scale and multi-orientation facial images. Identification of significant feature set plays a vital role in the success of any facial expression recognition system. Effect of multiple feature sets with varying block sizes has been investigated using different multi-scale images taken from well-known JAFEE, MMI and CK+ datasets. Extensive experimentation has been performed to demonstrate that the proposed technique outperforms the contemporary techniques in terms of recognition rate and computational time.

[1]  ZhangYankun,et al.  Efficient face recognition method based on DCT and LDA , 2004 .

[2]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[4]  Matti Pietikäinen,et al.  IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, 2009, TPAMI-2008-09-0620 1 WLD: A Robust Local Image Descriptor , 2022 .

[5]  Yajie Tian,et al.  Handbook of face recognition , 2003 .

[6]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[8]  Zheru Chi,et al.  Facial Expression Recognition in Video with Multiple Feature Fusion , 2018, IEEE Transactions on Affective Computing.

[9]  Lei Liu,et al.  Feature selection with dynamic mutual information , 2009, Pattern Recognit..

[10]  Lin Ma,et al.  Multimodal learning for facial expression recognition , 2015, Pattern Recognit..

[11]  B. K. Julsing,et al.  Face Recognition with Local Binary Patterns , 2012 .

[12]  Qiuqi Ruan,et al.  Facial expression recognition using sparse local Fisher discriminant analysis , 2016, Neurocomputing.

[13]  Inchul Song,et al.  Deep learning for real-time robust facial expression recognition on a smartphone , 2014, 2014 IEEE International Conference on Consumer Electronics (ICCE).

[14]  Maja Pantic,et al.  Web-based database for facial expression analysis , 2005, 2005 IEEE International Conference on Multimedia and Expo.

[15]  Fadi Dornaika,et al.  Improving dynamic facial expression recognition with feature subset selection , 2011, Pattern Recognit. Lett..

[16]  Hubert Konik,et al.  Framework for reliable, real-time facial expression recognition for low resolution images , 2013, Pattern Recognit. Lett..

[17]  Tao Gao,et al.  A novel face feature descriptor using adaptively weighted extended LBP pyramid , 2013 .

[18]  ZhanYongzhao,et al.  A neural-AdaBoost based facial expression recognition system , 2014 .

[19]  Li Zhuo,et al.  Learning realistic facial expressions from web images , 2013, Pattern Recognit..

[20]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[21]  Yong Cheng,et al.  Facial expression recognition algorithm using LGC based on horizontal and diagonal prior principle , 2014 .

[22]  Ying-li Tian,et al.  Evaluation of Face Resolution for Expression Analysis , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[23]  Rajendran Parthiban,et al.  Spatiotemporal feature extraction for facial expression recognition , 2016, IET Image Process..

[24]  Yongzhao Zhan,et al.  A neural-AdaBoost based facial expression recognition system , 2014, Expert Syst. Appl..

[25]  S. Ramachandran,et al.  Face recognition using transform domain feature extraction and PSO-based feature selection , 2014, Appl. Soft Comput..

[26]  Xiao Zhang,et al.  Facial Expression Recognition based on Independent Component Analysis , 2013, J. Multim..

[27]  John C. Platt,et al.  Fast training of support vector machines using sequential minimal optimization, advances in kernel methods , 1999 .

[28]  Zankhana H. Shah,et al.  Facial Expression Recognition: A Survey , 2014 .

[29]  Maja Pantic,et al.  Discriminative Shared Gaussian Processes for Multiview and View-Invariant Facial Expression Recognition , 2015, IEEE Transactions on Image Processing.

[30]  David Zhang,et al.  A Fourier-LDA approach for image recognition , 2005, Pattern Recognit..

[31]  Jian-Jiun Ding,et al.  Facial expression recognition based on improved local binary pattern and class-regularized locality preserving projection , 2015, Signal Process..

[32]  Tardi Tjahjadi,et al.  A spatial-temporal framework based on histogram of gradients and optical flow for facial expression recognition in video sequences , 2015, Pattern Recognit..

[33]  Nong Sang,et al.  Accurate and robust facial expressions recognition by fusing multiple sparse representation based classifiers , 2015, Neurocomputing.

[34]  Matti Pietikäinen,et al.  Face Recognition with Local Binary Patterns , 2004, ECCV.

[35]  Aurobinda Routray,et al.  Automatic facial expression recognition using features of salient facial patches , 2015, IEEE Transactions on Affective Computing.

[36]  Hubert Konik,et al.  Human vision inspired framework for facial expressions recognition , 2012, ICIP.

[37]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[38]  Shichuan Du,et al.  The resolution of facial expressions of emotion. , 2011, Journal of vision.

[39]  Petra Perner,et al.  Data Mining - Concepts and Techniques , 2002, Künstliche Intell..

[40]  Ali Aghagolzadeh,et al.  Feature extraction using discrete cosine transform and discrimination power analysis with a face recognition technology , 2010, Pattern Recognit..

[41]  Cüneyt Güzelis,et al.  A new facial expression recognition based on curvelet transform and online sequential extreme learning machine initialized with spherical clustering , 2014, Neural Computing and Applications.

[42]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[43]  Marian Stewart Bartlett,et al.  Video-based facial expression recognition using learned spatiotemporal pyramid sparse coding features , 2016, Neurocomputing.

[44]  Eli Brenner,et al.  Speed judgments of three-dimensional motion incorporate extraretinal information. , 2011, Journal of vision.

[45]  Xiaobo Lu,et al.  Boosting local Gabor binary patterns for gender recognition , 2013, 2013 Ninth International Conference on Natural Computation (ICNC).

[46]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[47]  Maja Pantic,et al.  Fully Automatic Facial Action Unit Detection and Temporal Analysis , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[48]  Manasi Patil,et al.  Facial Expression Recognition Based on Image Feature , 2012 .

[49]  Yihua Tan,et al.  Unsupervised Multilayer Feature Learning for Satellite Image Scene Classification , 2016, IEEE Geoscience and Remote Sensing Letters.

[50]  Jianqin Zhou,et al.  On discrete cosine transform , 2011, ArXiv.

[51]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.