Facial expression recognition with dynamic cascaded classifier

In this paper, a new approach for facial expression recognition has been proposed. The approach has imbedded a new feature extraction technique, new multiclass classification approach and a new kernel parameter optimization for support vector machines. The scheme of the approach begins with feature extraction from the input vectors, and the extracted features are transformed into a Gaussian space using compressive sensing techniques. This process ensures feature vector dimensionality reduction and matches the features vectors with radial basis function kernel used in support vector machines for classification. Prior to classification, an optimized parameter for support vector machines training is automatically determined based on an approach proposed which relies on the receiver operating characteristics of the support vector machine classifier. With the optimized kernel parameter, new proposed multiclass classification approach is used to finally classify any vector. In all the experiments conducted on the two facial expression databases with different cross-validation techniques, the proposed approach outperforms its counterparts under the same database and settings. The results further confirmed the validity and advantages of the proposed approach over other approaches currently used in the literature.

[1]  Jian-Jiun Ding,et al.  Facial expression recognition based on improved local binary pattern and class-regularized locality preserving projection , 2015, Signal Process..

[2]  D. Lowe,et al.  Adaptive radial basis function nonlinearities, and the problem of generalisation , 1989 .

[3]  Gwen Littlewort,et al.  Dynamics of Facial Expression Extracted Automatically from Video , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[4]  Chi Fang,et al.  Facial expression analysis across databases , 2011, 2011 International Conference on Multimedia Technology.

[5]  Vladimir Vapnik,et al.  Principles of Risk Minimization for Learning Theory , 1991, NIPS.

[6]  Oksam Chae,et al.  Local Directional Number Pattern for Face Analysis: Face and Expression Recognition , 2013, IEEE Transactions on Image Processing.

[7]  Y. V. Venkatesh,et al.  Facial expression recognition using radial encoding of local Gabor features and classifier synthesis , 2012, Pattern Recognit..

[8]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[9]  Alaa Eleyan,et al.  Facial expression recognition based on image pyramid and single-branch decision tree , 2017, Signal, Image and Video Processing.

[10]  Qiuqi Ruan,et al.  Tensor rank one differential graph preserving analysis for facial expression recognition , 2012, Image Vis. Comput..

[11]  Shuai Li,et al.  On Context-Dependent Clustering of Bandits , 2016, ICML.

[12]  Aggelos K. Katsaggelos,et al.  Automatic facial expression recognition using facial animation parameters and multistream HMMs , 2006, IEEE Transactions on Information Forensics and Security.

[13]  Tadas Baltrusaitis,et al.  Automatic facial expression analysis , 2014 .

[14]  Shuai Li,et al.  Collaborative Filtering Bandits , 2015, SIGIR.

[15]  Ying-li Tian,et al.  Evaluation of Face Resolution for Expression Analysis , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[16]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[17]  Ganesh K. Venayagamoorthy,et al.  Recognition of facial expressions using Gabor wavelets and learning vector quantization , 2008, Eng. Appl. Artif. Intell..

[18]  Qingshan Liu,et al.  Learning active facial patches for expression analysis , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[19]  Mohammed Yeasin,et al.  From facial expression to level of interest: a spatio-temporal approach , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[20]  Gérard Dreyfus,et al.  Single-layer learning revisited: a stepwise procedure for building and training a neural network , 1989, NATO Neurocomputing.

[21]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[22]  Gwen Littlewort,et al.  Real Time Face Detection and Facial Expression Recognition: Development and Applications to Human Computer Interaction. , 2003, 2003 Conference on Computer Vision and Pattern Recognition Workshop.

[23]  Bernhard E. Boser,et al.  A training algorithm for optimal margin classifiers , 1992, COLT '92.

[24]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  D. Broomhead,et al.  Radial Basis Functions, Multi-Variable Functional Interpolation and Adaptive Networks , 1988 .

[26]  C.E. Shannon,et al.  Communication in the Presence of Noise , 1949, Proceedings of the IRE.

[27]  Zi-Lu Ying,et al.  A new method for facial expression recognition based on sparse representation plus LBP , 2010, 2010 3rd International Congress on Image and Signal Processing.

[28]  Chih-Jen Lin,et al.  A Comparison of Methods for Multi-class Support Vector Machines , 2015 .

[29]  Michel Valstar,et al.  Automatic Facial Expression Analysis , 2015 .

[30]  Sayan Mukherjee,et al.  Choosing Multiple Parameters for Support Vector Machines , 2002, Machine Learning.

[31]  Zhengguang Xu,et al.  Local Gabor phase difference pattern for face recognition , 2008, 2008 19th International Conference on Pattern Recognition.

[32]  Weiran Xu,et al.  A Multiclass SVM Method via Probabilistic Error-Correcting Output Codes , 2010, 2010 International Conference on Internet Technology and Applications.

[33]  Thomas G. Dietterich,et al.  Solving Multiclass Learning Problems via Error-Correcting Output Codes , 1994, J. Artif. Intell. Res..

[34]  M. Pantic,et al.  Induced Disgust , Happiness and Surprise : an Addition to the MMI Facial Expression Database , 2010 .

[35]  Nello Cristianini,et al.  Large Margin DAGs for Multiclass Classification , 1999, NIPS.

[36]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[37]  Lin-Bo Cai,et al.  A new approach of facial expression recognition based on Contourlet Transform , 2009, 2009 International Conference on Wavelet Analysis and Pattern Recognition.

[38]  Feng Chen,et al.  Facial expression recognition and its application based on curvelet transform and PSO-SVM , 2013 .

[39]  Takeo Kanade,et al.  Comprehensive database for facial expression analysis , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[40]  Vladimir Vapnik,et al.  Statistical learning theory , 1998 .

[41]  Karim Faez,et al.  2D facial expression recognition via 3D reconstruction and feature fusion , 2016, J. Vis. Commun. Image Represent..

[42]  Ying Zilu,et al.  Combining LBP and Adaboost for facial expression recognition , 2008, 2008 9th International Conference on Signal Processing.

[43]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[44]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[45]  Luiz Eduardo Soares de Oliveira,et al.  Facial expression recognition using ensemble of classifiers , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[46]  Lemin Li,et al.  Facial expression recognition based on Gabor wavelets and sparse representation , 2012, 2012 IEEE 11th International Conference on Signal Processing.

[47]  Wen Gao,et al.  Histogram of Gabor Phase Patterns (HGPP): A Novel Object Representation Approach for Face Recognition , 2007, IEEE Transactions on Image Processing.

[48]  Vladimir Pavlovic,et al.  Multi-output Laplacian dynamic ordinal regression for facial expression recognition and intensity estimation , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[49]  A. Enis Çetin,et al.  Image Feature Extraction Using Compressive Sensing , 2013, IP&C.

[50]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[51]  Miguel Figueroa,et al.  Competitive learning with floating-gate circuits , 2002, IEEE Trans. Neural Networks.

[52]  Masahide Kaneko,et al.  Facial Expression Recognition Using Facial-component-based Bag of Words and PHOG Descriptors , 2010 .

[53]  Shuai Li,et al.  Distributed Clustering of Linear Bandits in Peer to Peer Networks , 2016, ICML.

[54]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[55]  E.J. Candes Compressive Sampling , 2022 .

[56]  Liu Xiaomin and Zhang Yujin Facial Expression Recognition Based on Gabor Histogram Feature and MVBoost , 2007 .

[57]  Xiangning Chen,et al.  Facial Expression Recognition Based on MB-LGBP Feature and Multi-level Classification , 2011 .

[58]  Shaogang Gong,et al.  Robust facial expression recognition using local binary patterns , 2005, IEEE International Conference on Image Processing 2005.