Automatically Query Active Features Based on Pixel-Level for Facial Expression Recognition

Feature extraction-based subspace learning methods normally learn a projection that can convert the high-dimensional data to the low-dimensional representation. However, they may not be suitable for better classification since features obtained by these methods ignore discriminability of the data-pixel itself. Given this, we propose a novel approach that automatically queries active features combing sparse representation classification for the facial expression recognition. The proposed approach aims to automatically query discriminative features from raw pixels, thereby fully considering the underlying characteristics existed in the source data. Especially, the proposed approach based on pixel-level adaptively selects the most active and discriminative feature for representation and classification. The intraclass low-rank decomposition and principal feature analysis are simultaneously used to guarantee that the extracted features can capture the most active energy of the raw data, and thus, the proposed approach can be also applied for other feature extraction and selection tasks. We conduct comprehensive experiments on four public datasets, and the results show superior performance than some state-of-the-art methods.

[1]  David J. Kriegman,et al.  Eigenfaces vs. Fisherfaces: Recognition Using Class Specific Linear Projection , 1996, ECCV.

[2]  Haifeng Hu,et al.  Deep multi-path convolutional neural network joint with salient region attention for facial expression recognition , 2019, Pattern Recognit..

[3]  Jianfei Cai,et al.  Conditional Adversarial Synthesis of 3D Facial Action Units , 2018, Neurocomputing.

[4]  Ihtesham Ul Islam,et al.  Illumination normalization using independent component analysis and filtering , 2017 .

[5]  Hasan Demirel,et al.  Low-rank sparse coding and region of interest pooling for dynamic 3D facial expression recognition , 2018, Signal Image Video Process..

[6]  Meng Wang,et al.  Robust Facial Expression Recognition with Low-Rank Sparse Error Dictionary Based Probabilistic Collaborative Representation Classification , 2017, Int. J. Artif. Intell. Tools.

[7]  L. Leyman,et al.  The Karolinska Directed Emotional Faces: A validation study , 2008 .

[8]  Yun Fu,et al.  Learning low-rank and discriminative dictionary for image classification , 2014, Image Vis. Comput..

[9]  Raymond Chiong,et al.  An extended dictionary representation approach with deep subspace learning for facial expression recognition , 2018, Neurocomputing.

[10]  Suman K. Mitra,et al.  On some variants of locality preserving projection , 2016, Neurocomputing.

[12]  Ing Ren Tsang,et al.  FERAtt: Facial Expression Recognition With Attention Net , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[13]  Allen Y. Yang,et al.  Robust Face Recognition via Sparse Representation , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Takeo Kanade,et al.  The Extended Cohn-Kanade Dataset (CK+): A complete dataset for action unit and emotion-specified expression , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[15]  Meng Wang,et al.  Discriminative feature learning-based pixel difference representation for facial expression recognition , 2017, IET Comput. Vis..

[16]  Ming Li,et al.  2D-LDA: A statistical linear discriminant analysis for image matrix , 2005, Pattern Recognit. Lett..

[17]  Zhihui Lai,et al.  Robust Jointly Sparse Regression with Generalized Orthogonal Learning for Image Feature Selection , 2019, Pattern Recognit..

[18]  Jiwen Lu,et al.  PCANet: A Simple Deep Learning Baseline for Image Classification? , 2014, IEEE Transactions on Image Processing.

[19]  Yu-Chiang Frank Wang,et al.  Robust Face Recognition With Structurally Incoherent Low-Rank Matrix Decomposition , 2014, IEEE Transactions on Image Processing.

[20]  Jian Yang,et al.  Sparse Representation Classifier Steered Discriminative Projection With Applications to Face Recognition , 2013, IEEE Transactions on Neural Networks and Learning Systems.

[21]  Sungyoung Lee,et al.  Human Facial Expression Recognition Using Stepwise Linear Discriminant Analysis and Hidden Conditional Random Fields , 2015, IEEE Transactions on Image Processing.

[22]  Anastasios Tefas,et al.  Improving subspace learning for facial expression recognition using person dependent and geometrically enriched training sets , 2011, Neural Networks.

[23]  Meng Wang,et al.  Dictionary learning feature space via sparse representation classification for facial expression recognition , 2017, Artificial Intelligence Review.

[24]  Meng Wang,et al.  Combining the Kernel Collaboration Representation and Deep Subspace Learning for Facial Expression Recognition , 2017, J. Circuits Syst. Comput..

[25]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[26]  Jie Shao,et al.  Three convolutional neural network models for facial expression recognition in the wild , 2019, Neurocomputing.

[27]  Guoying Zhao,et al.  Micro-Expression Recognition Using Robust Principal Component Analysis and Local Spatiotemporal Directional Features , 2014, ECCV Workshops.

[28]  Serestina Viriri,et al.  Facial Expression Recognition: A Review of Methods, Performances and Limitations , 2019, 2019 Conference on Information Communications Technology and Society (ICTAS).

[29]  Yingsheng Ye,et al.  Facial expression recognition via region-based convolutional fusion network , 2019, J. Vis. Commun. Image Represent..

[30]  Jian-Bo Yang,et al.  An Effective Feature Selection Method via Mutual Information Estimation , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[31]  Takeo Kanade,et al.  Multi-PIE , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[32]  Mohammad Reza Mohammadi,et al.  PCA-based dictionary building for accurate facial expression recognition via sparse representation , 2014, J. Vis. Commun. Image Represent..

[33]  Abdellah Madani,et al.  Fusing multi-stream deep neural networks for facial expression recognition , 2018, Signal Image Video Process..

[34]  Ying-li Tian,et al.  Evaluation of Face Resolution for Expression Analysis , 2004, 2004 Conference on Computer Vision and Pattern Recognition Workshop.

[35]  Michael J. Lyons,et al.  Coding facial expressions with Gabor wavelets , 1998, Proceedings Third IEEE International Conference on Automatic Face and Gesture Recognition.

[36]  Giancarlo Fortino,et al.  Human emotion recognition using deep belief network architecture , 2019, Inf. Fusion.

[37]  Xuelong Li,et al.  Low-Rank Preserving Projections , 2016, IEEE Transactions on Cybernetics.

[38]  Meng Wang,et al.  Influenced factors reduction for robust facial expression recognition , 2018, Multimedia Tools and Applications.

[39]  Arif Mahmood,et al.  Internal Emotion Classification Using EEG Signal With Sparse Discriminative Ensemble , 2019, IEEE Access.

[40]  Shubhobrata Bhattacharya,et al.  Local Force Pattern (LFP): Descriptor for Heterogeneous Face Recognition , 2019, Pattern Recognit. Lett..

[41]  Yong Man Ro,et al.  Intra-Class Variation Reduction Using Training Expression Images for Sparse Representation Based Facial Expression Recognition , 2014, IEEE Transactions on Affective Computing.

[42]  Fathi E. Abd El-Samie,et al.  An Efficient Deep Convolutional Neural Network for Visual Image Classification , 2019, AMLTA.

[43]  Jian Yang,et al.  Discriminative Block-Diagonal Representation Learning for Image Recognition , 2017, IEEE Transactions on Neural Networks and Learning Systems.