Multiscale Adaptive Local Directional Texture Pattern for Facial Expression Recognition

This work presents a novel facial descriptor, which is named as multiscale adaptive local directional texture pattern (MALDTP) and employed for expression recognition. We apply an adaptive threshold value to encode facial image in different scales, and concatenate a series of histograms based on the MALDTP to generate facial descriptor in term of Gabor filters. In addition, some dedicated experiments were conducted to evaluate the performance of the MALDTP method in a person-independent way. The experimental results demonstrate that our proposed method achieves higher recognition rate than local directional texture pattern (LDTP). Moreover, the MALDTP method has lower computational complexity, fewer storage space and higher classification accuracy than local Gabor binary pattern histogram sequence (LGBPHS) method. In a nutshell, the proposed MALDTP method can not only avoid choosing the threshold by experience but also contain much more structural and contrast information of facial image than LDTP.

[1]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Saman A. Zonouz,et al.  CloudID: Trustworthy cloud-based and cross-enterprise biometric identification , 2015, Expert Syst. Appl..

[3]  Jing Liu,et al.  Robust Structured Subspace Learning for Data Representation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Jinhui Tang,et al.  Unsupervised Feature Selection via Nonnegative Spectral Analysis and Redundancy Control , 2015, IEEE Transactions on Image Processing.

[5]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[6]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[7]  Rui Zhang,et al.  Compact Local Directional Texture Pattern for Local Image Description , 2015, Adv. Multim..

[8]  Oksam Chae,et al.  Local Directional Texture Pattern image descriptor , 2015, Pattern Recognit. Lett..

[9]  Narendra Limbad,et al.  A Literature Survey on Facial Expression Recognition techniques using Appearance based features , 2014 .

[10]  Bin Jiang,et al.  A Deep Structure for Facial Expression Recognition under Partial Occlusion , 2014, 2014 Tenth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[11]  Yong Man Ro,et al.  Intra-Class Variation Reduction Using Training Expression Images for Sparse Representation Based Facial Expression Recognition , 2014, IEEE Transactions on Affective Computing.

[12]  Zankhana H. Shah,et al.  Facial Expression Recognition: A Survey , 2014 .

[13]  Yichuan Tang,et al.  Deep Learning using Linear Support Vector Machines , 2013, 1306.0239.

[14]  Ling Li,et al.  Person-independent facial expression recognition via hierarchical classification , 2013, 2013 IEEE Eighth International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[15]  Luiz Eduardo Soares de Oliveira,et al.  Fusion of feature sets and classifiers for facial expression recognition , 2013, Expert Syst. Appl..

[16]  Sanjay Tanwani,et al.  Recognition of Facial Expressions using Local Binary Patterns of Important Facial Parts , 2013 .

[17]  Richard E. Mayer,et al.  Five facets of social presence in online distance education , 2012, Comput. Hum. Behav..

[18]  Shiqing Zhang,et al.  Facial expression recognition based on local binary patterns and local fisher discriminant analysis , 2012 .

[19]  Oksam Chae,et al.  Local directional pattern variance (ldpv): a robust feature descriptor for facial expression recognition , 2012, Int. Arab J. Inf. Technol..

[20]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[21]  Aliaa A. A. Youssif,et al.  Automatic Facial Expression Recognition System Based on Geometric and Appearance Features , 2011, Comput. Inf. Sci..

[22]  Driss Aboutajdine,et al.  Local appearance based face recognition method using block based steerable pyramid transform , 2011, Signal Process..

[23]  Oksam Chae,et al.  Facial expression recognition using Local Directional Pattern (LDP) , 2010, 2010 IEEE International Conference on Image Processing.

[24]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[25]  Oksam Chae,et al.  Local Directional Pattern (LDP) for face recognition , 2010, 2010 Digest of Technical Papers International Conference on Consumer Electronics (ICCE).

[26]  Maja Pantic,et al.  Facial Expression Recognition , 2009, Encyclopedia of Biometrics.

[27]  Shaogang Gong,et al.  Facial expression recognition based on Local Binary Patterns: A comprehensive study , 2009, Image Vis. Comput..

[28]  Vitomir Struc,et al.  Gabor-Based Kernel Partial-Least-Squares Discrimination Features for Face Recognition , 2009, Informatica.

[29]  Heng Tao Shen,et al.  Principal Component Analysis , 2009, Encyclopedia of Biometrics.

[30]  Cheng Wang,et al.  A novel extended local-binary-pattern operator for texture analysis , 2008, Inf. Sci..

[31]  Caifeng Shan,et al.  Learning Discriminative LBP-Histogram Bins for Facial Expression Recognition , 2008, BMVC.

[32]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[33]  LinLin Shen,et al.  MutualBoost learning for selecting Gabor features for face recognition , 2006, Pattern Recognit. Lett..

[34]  LinLin Shen,et al.  A review on Gabor wavelets for face recognition , 2006, Pattern Analysis and Applications.

[35]  Lianwen Jin,et al.  A New Facial Expression Recognition Method Based on Local Gabor Filter Bank and PCA plus LDA , 2006 .

[36]  Shaogang Gong,et al.  Robust facial expression recognition using local binary patterns , 2005, IEEE International Conference on Image Processing 2005.

[37]  Wen Gao,et al.  Local Gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[38]  Samuel Kaski,et al.  Discriminative components of data , 2005, IEEE Transactions on Neural Networks.

[39]  Xueyin Lin,et al.  Emotional facial expression model building , 2003, Pattern Recognition Letters.

[40]  Beat Fasel,et al.  Automati Fa ial Expression Analysis: A Survey , 1999 .

[41]  Xueyin Lin,et al.  Mapping emotional status to facial expressions , 2002, Object recognition supported by user interaction for service robots.

[42]  Joni-Kristian Kämäräinen,et al.  Fundamental frequency Gabor filters for object recognition , 2002, Object recognition supported by user interaction for service robots.

[43]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[44]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[45]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[46]  Michael J. Lyons,et al.  Automatic Classification of Single Facial Images , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[47]  Zhengyou Zhang,et al.  Feature-Based Facial Expression Recognition: Sensitivity Analysis and Experiments with A Multilayer Perceptron , 1999, Int. J. Pattern Recognit. Artif. Intell..

[48]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[49]  Tai Sing Lee,et al.  Image Representation Using 2D Gabor Wavelets , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[50]  Matti Pietikäinen,et al.  A comparative study of texture measures with classification based on featured distributions , 1996, Pattern Recognit..

[51]  Matti Pietikäinen,et al.  Performance evaluation of texture measures with classification based on Kullback discrimination of distributions , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[52]  Ashok Samal,et al.  Automatic recognition and analysis of human faces and facial expressions: a survey , 1992, Pattern Recognit..

[53]  J. Russell,et al.  An approach to environmental psychology , 1974 .