Uncorrelated multiview discriminant locality preserving projection analysis for multiview facial expression recognition

Recently several multi-view learning-based methods have been proposed, and they are found to be more efficient in many real world applications. However, existing multi-view learning-based methods are not suitable for finding discriminative directions if the data is multi-modal. In such cases, Locality Preserving Projection (LPP) and/or Local Fisher Discriminant Analysis (LFDA) are found to be more appropriate to capture discriminative directions. Furthermore, existing methods show that imposing uncorrelated constraint onto the common space improves classification accuracy of the system. Hence inspired from the above findings, we propose an Un-correlated Multi-view Discriminant Locality Preserving Projection (UMvDLPP)-based approach. The proposed method searches a common uncorrelated discriminative space for multiple observable spaces. Moreover, the proposed method can also handle the multimodal characteristic, which is inherently embedded in multi-view facial expression recognition (FER) data. Hence, the proposed method is effectively more efficient for multi-view FER problem. Experimental results show that the proposed method outperforms state-of-the-art multi-view learning-based methods.

[1]  H. Hotelling Relations Between Two Sets of Variates , 1936 .

[2]  WenAn Tan,et al.  Gabor feature-based face recognition using supervised locality preserving projection , 2007, Signal Process..

[3]  Maja Pantic,et al.  Coupled Gaussian Process Regression for Pose-Invariant Facial Expression Recognition , 2010, ECCV.

[4]  Nasser M. Nasrabadi,et al.  Pattern Recognition and Machine Learning , 2006, Technometrics.

[5]  Sunil Kumar,et al.  Extraction of informative regions of a face for facial expression recognition , 2016, IET Comput. Vis..

[6]  Wenming Zheng,et al.  Multi-View Facial Expression Recognition Based on Group Sparse Reduced-Rank Regression , 2014, IEEE Transactions on Affective Computing.

[7]  Josef Kittler,et al.  Learning Discriminative Canonical Correlations for Object Recognition with Image Sets , 2006, ECCV.

[8]  Feiping Nie,et al.  Trace Ratio Problem Revisited , 2009, IEEE Transactions on Neural Networks.

[9]  Allan Aasbjerg Nielsen,et al.  Multiset canonical correlations analysis and multispectral, truly multitemporal remote sensing data , 2002, IEEE Trans. Image Process..

[10]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[11]  C. Goodall Procrustes methods in the statistical analysis of shape , 1991 .

[12]  Lijun Yin,et al.  Multi-view facial expression recognition , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[13]  Dong Xu,et al.  Trace Ratio vs. Ratio Trace for Dimensionality Reduction , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[14]  David W. Jacobs,et al.  Generalized Multiview Analysis: A discriminative latent space , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[15]  Xuegang Wang,et al.  Uncorrelated Discriminant Locality Preserving Projections , 2008, IEEE Signal Processing Letters.

[16]  Maja Pantic,et al.  Coupled Gaussian processes for pose-invariant facial expression recognition , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Shiguang Shan,et al.  Multi-View Discriminant Analysis , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Lijun Yin,et al.  A study of non-frontal-view facial expressions recognition , 2008, 2008 19th International Conference on Pattern Recognition.

[19]  Masashi Sugiyama,et al.  Dimensionality Reduction of Multimodal Labeled Data by Local Fisher Discriminant Analysis , 2007, J. Mach. Learn. Res..

[20]  J. Shawe-Taylor,et al.  Multi-View Canonical Correlation Analysis , 2010 .

[21]  Matthijs C. Dorst Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[22]  Fan Chung,et al.  Spectral Graph Theory , 1996 .

[23]  Sunil Kumar,et al.  An efficient face model for facial expression recognition , 2016, 2016 Twenty Second National Conference on Communication (NCC).

[24]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[25]  Thomas S. Huang,et al.  Emotion Recognition from Arbitrary View Facial Images , 2010, ECCV.

[26]  Richard Bowden,et al.  Local binary patterns for multi-view facial expression recognition , 2011 .

[27]  Timothy F. Cootes,et al.  Active Appearance Models , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  Maja Pantic,et al.  Dynamics of facial expression: recognition of facial actions and their temporal segments from face profile image sequences , 2006, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[29]  Maja Pantic,et al.  Discriminative Shared Gaussian Processes for Multiview and View-Invariant Facial Expression Recognition , 2015, IEEE Transactions on Image Processing.

[30]  P. Ekman Pictures of Facial Affect , 1976 .

[31]  Hazim Kemal Ekenel,et al.  Multi-view facial expression recognition using local appearance features , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[32]  Raphael C.-W. Phan,et al.  Facial Expression Recognition in the Encrypted Domain Based on Local Fisher Discriminant Analysis , 2013, IEEE Transactions on Affective Computing.

[33]  Jun Wang,et al.  A 3D facial expression database for facial behavior research , 2006, 7th International Conference on Automatic Face and Gesture Recognition (FGR06).

[34]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[35]  Thomas S. Huang,et al.  Multi-view Facial Expression Recognition Analysis with Generic Sparse Coding Feature , 2012, ECCV Workshops.

[36]  Maja Pantic,et al.  Regression-Based Multi-view Facial Expression Recognition , 2010, 2010 20th International Conference on Pattern Recognition.

[37]  N. Ahmed,et al.  Discrete Cosine Transform , 1996 .

[38]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..