Facial expression recognition based on image pyramid and single-branch decision tree

In this paper, a new approach has been proposed for improved facial expression recognition. The new approach is inspired by the compressive sensing theory and multiresolution approach to facial expression problems. Initially, each image sample is decomposed into desired pyramid levels at different sizes and resolutions. Pyramid features at all levels are concatenated to form a pyramid feature vector. The vectors are further reinforced and reduced in dimension using a measurement matrix based on compressive sensing theory. For classification, a multilevel classification approach based on single-branch decision tree has been proposed. The proposed multilevel classification approach trains a number of binary support vector machines equal to the number of classes in the datasets. Class of test data is evaluated through the nodes of the tree from the root to its apex. The results obtained from the approach are impressive and outperform most of its counterparts in the literature under the same databases and settings.

[1]  Aggelos K. Katsaggelos,et al.  Automatic facial expression recognition using facial animation parameters and multistream HMMs , 2006, IEEE Transactions on Information Forensics and Security.

[2]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[3]  Gérard Dreyfus,et al.  Single-layer learning revisited: a stepwise procedure for building and training a neural network , 1989, NATO Neurocomputing.

[4]  Karim Faez,et al.  2D facial expression recognition via 3D reconstruction and feature fusion , 2016, J. Vis. Commun. Image Represent..

[5]  Qingshan Liu,et al.  Learning active facial patches for expression analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[6]  Richard H. Sherman,et al.  Chaotic communications in the presence of noise , 1993, Optics & Photonics.

[7]  Ying-li Tian,et al.  Evaluation of Face Resolution for Expression Analysis , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[8]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[9]  Hassan Aghaeinia,et al.  Incorporating prior knowledge from the new person into recognition of facial expression , 2016, Signal Image Video Process..

[10]  Seyed Mehdi Lajevardi,et al.  Structural similarity classifier for facial expression recognition , 2014, Signal Image Video Process..

[11]  Zi-Lu Ying,et al.  A new method for facial expression recognition based on sparse representation plus LBP , 2010, 2010 3rd International Congress on Image and Signal Processing.

[12]  Michel Valstar,et al.  Automatic Facial Expression Analysis , 2015 .

[13]  R. Woods.  Wavelets and Multiresolution Processing , 2006 .

[14]  Xiangning Chen,et al.  Facial Expression Recognition Based on MB-LGBP Feature and Multi-level Classification , 2011 .

[15]  Shaogang Gong,et al.  Robust facial expression recognition using local binary patterns , 2005, IEEE International Conference on Image Processing 2005.

[16]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[17]  Shashidhar G. Koolagudi,et al.  Recognition of emotions from video using acoustic and facial features , 2015, Signal Image Video Process..

[18]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[19]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[20]  Oksam Chae,et al.  Local Directional Number Pattern for Face Analysis: Face and Expression Recognition , 2013, IEEE Transactions on Image Processing.

[21]  E.J. Candes.  Compressive Sampling , 2022 .

[22]  Liu Xiaomin and Zhang Yujin.  Facial Expression Recognition Based on Gabor Histogram Feature and MVBoost , 2007 .

[23]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[24]  Zhenjie Hou,et al.  Supervised bilateral two-dimensional locality preserving projection algorithm based on Gabor wavelet , 2016, Signal Image Video Process..

[25]  Qiuqi Ruan,et al.  Tensor rank one differential graph preserving analysis for facial expression recognition , 2012, Image Vis. Comput..

[26]  Lin-Bo Cai,et al.  A new approach of facial expression recognition based on Contourlet Transform , 2009, 2009 International Conference on Wavelet Analysis and Pattern Recognition.

[27]  Uros Mlakar,et al.  Automated facial expression recognition based on histograms of oriented gradient feature vector differences , 2015, Signal Image Video Process..

[28]  Feng Chen,et al.  Facial expression recognition and its application based on curvelet transform and PSO-SVM , 2013 .

[29]  Miguel Figueroa,et al.  Competitive learning with floating-gate circuits , 2002, IEEE Trans. Neural Networks.

[30]  Ling Guan,et al.  SN-SVM: a sparse nonparametric support vector machine classifier , 2014, Signal Image Video Process..

[31]  Zhengguang Xu,et al.  Local Gabor phase difference pattern for face recognition , 2008, 2008 19th International Conference on Pattern Recognition.

[32]  Weiran Xu,et al.  A Multiclass SVM Method via Probabilistic Error-Correcting Output Codes , 2010, 2010 International Conference on Internet Technology and Applications.

[33]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[34]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[35]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[36]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Hasan Demirel,et al.  Entropy-based feature selection for improved 3D facial expression recognition , 2013, Signal, Image and Video Processing.

[38]  Lemin Li,et al.  Facial expression recognition based on Gabor wavelets and sparse representation , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[39]  Wen Gao,et al.  Histogram of Gabor Phase Patterns (HGPP): A Novel Object Representation Approach for Face Recognition , 2007, IEEE Transactions on Image Processing.

[40]  Vladimir Pavlovic,et al.  Multi-output Laplacian dynamic ordinal regression for facial expression recognition and intensity estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Luiz Eduardo Soares de Oliveira,et al.  Facial expression recognition using ensemble of classifiers , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[42]  Masahide Kaneko,et al.  顔部品の「Bag of Words」とPHOG記述子を用いた顔表情認識 , 2010 .

[43]  Jian-Jiun Ding,et al.  Facial expression recognition based on improved local binary pattern and class-regularized locality preserving projection , 2015, Signal Process..

[44]  Chi Fang,et al.  Facial expression analysis across databases , 2011, 2011 International Conference on Multimedia Technology.

[45]  Mohammed Yeasin,et al.  From facial expression to level of interest: a spatio-temporal approach , 2004, CVPR 2004.

[46]  Karim Faez,et al.  Pose-Invariant Facial Expression Recognition Based on 3D Face Reconstruction and Synthesis from a Single 2D Image , 2014, 2014 22nd International Conference on Pattern Recognition.

[47]  A. Enis Çetin,et al.  Image Feature Extraction Using Compressive Sensing , 2013, IP&C.

[48]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[49]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[50]  Chih-Jen Lin,et al.  A Comparison of Methods for Multi-class Support Vector Machines , 2015 .

[51]  Ali Moeini,et al.  Multimodal Facial Expression Recognition Based on 3D Face Reconstruction from 2D Images , 2014, FFER@ICPR.

[52]  Gwen Littlewort,et al.  Dynamics of Facial Expression Extracted Automatically from Video , 2004, CVPR Workshops.

[53]  Ganesh K. Venayagamoorthy,et al.  Recognition of facial expressions using Gabor wavelets and learning vector quantization , 2008, Eng. Appl. Artif. Intell..

[54]  Cigdem Eroglu Erdem,et al.  Multimodal emotion recognition based on peak frame selection from video , 2015, Signal, Image and Video Processing.

[55]  Ying Zilu,et al.  Combining LBP and Adaboost for facial expression recognition , 2008, 2008 9th International Conference on Signal Processing.

[56]  Masahide Kaneko,et al.  Facial Expression Recognition Using Facial-component-based Bag of Words and PHOG Descriptors , 2010 .

[57]  Qiang Chen,et al.  Three-dimensional (3D) facial recognition and prediction , 2016, Signal Image Video Process..

[58]  Salah Bourennane,et al.  Robust multimodal 2D and 3D face authentication using local feature fusion , 2016, Signal Image Video Process..

[59]  Y. V. Venkatesh,et al.  Facial expression recognition using radial encoding of local Gabor features and classifier synthesis , 2012, Pattern Recognit..

[60]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .