MiLDA: A graph embedding approach to multi-view face recognition

Abstract In a vast number of real-world face recognition applications, gallery and probe image sets are captured from different scenarios. For such multi-view data, face recognition systems often perform poorly. To tackle this problem, in this paper we propose a graph embedding framework, which can project the multi-view data into a common subspace of higher discriminability between classes. This framework can be readily utilized to extend classical dimensionality reduction methods to multi-view scenarios. Hence, by utilizing the framework for multi-view face recognition, we propose multi-view linear discriminant analysis (MiLDA). We also empirically demonstrate that, for several distinct multi-view face recognition scenarios, MiLDA has an excellent performance and outperforms many popular approaches.

[1]  H. Hotelling.  Relations Between Two Sets of Variates , 1936 .

[2]  Terence Sim,et al.  The CMU Pose, Illumination, and Expression Database , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  David W. Jacobs,et al.  Generalized Multiview Analysis: A discriminative latent space , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Hanqing Lu,et al.  A nonlinear approach for face sketch synthesis and recognition , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Meng Zhao,et al.  Gabor face recognition by multi-channel classifier fusion of supervised kernel manifold learning , 2012, Neurocomputing.

[6]  Tom Diethe,et al.  Constructing Nonlinear Discriminants from Multiple Data Views , 2010, ECML/PKDD.

[7]  J. Tenenbaum,et al.  A global geometric framework for nonlinear dimensionality reduction. , 2000, Science.

[8]  Avinash C. Kak,et al.  PCA versus LDA , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Yongkang Wong,et al.  Patch-based probabilistic image quality assessment for face selection and improved video-based face recognition , 2011, CVPR 2011 WORKSHOPS.

[10]  Shiguang Shan,et al.  Coupling Alignments with Recognition for Still-to-Video Face Recognition , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Wen Gao,et al.  Separability Oriented Preprocessing for Illumination-Insensitive Face Recognition , 2012, ECCV.

[12]  Anil K. Jain,et al.  Heterogeneous Face Recognition Using Kernel Prototype Similarities , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[14]  Shiguang Shan,et al.  Domain Adaptation for Face Recognition: Targetize Source Domain Bridged by Common Subspace , 2013, International Journal of Computer Vision.

[15]  S T Roweis,et al.  Nonlinear dimensionality reduction by locally linear embedding. , 2000, Science.

[16]  Stan Z. Li,et al.  Towards Pose Robust Face Recognition , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Chunna Tian,et al.  Multi-view face recognition based on tensor subspace analysis and view manifold modeling , 2009, Neurocomputing.

[18]  Dacheng Tao,et al.  Common Feature Discriminant Analysis for Matching Infrared Face Images to Optical Face Images , 2014, IEEE Transactions on Image Processing.

[19]  Shiguang Shan,et al.  Multi-view Discriminant Analysis , 2012, ECCV.

[20]  Dit-Yan Yeung,et al.  Worst-Case Linear Discriminant Analysis , 2010, NIPS.

[21]  Tal Hassner,et al.  Face recognition in unconstrained videos with matched background similarity , 2011, CVPR 2011.

[22]  Qi Tian,et al.  Multiview Face Recognition: From TensorFace to V-TensorFace and K-TensorFace , 2012, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[23]  Patrick J. Flynn,et al.  Pose-robust recognition of low-resolution face images , 2013, CVPR 2011.

[24]  Shiguang Shan,et al.  Maximizing intra-individual correlations for face recognition across pose differences , 2009, CVPR.

[25]  John Shawe-Taylor,et al.  Two view learning: SVM-2K, Theory and Practice , 2005, NIPS.

[26]  Rama Chellappa,et al.  Pose-Invariant Face Recognition Using Markov Random Fields , 2013, IEEE Transactions on Image Processing.

[27]  Jian-Huang Lai,et al.  Matching NIR Face to VIS Face Using Transduction , 2014, IEEE Transactions on Information Forensics and Security.

[28]  Xin Liu,et al.  Morphable Displacement Field Based Image Matching for Face Recognition across Pose , 2012, ECCV.

[29]  YanShuicheng,et al.  Graph Embedding and Extensions , 2007 .

[30]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[31]  Xiaogang Wang,et al.  Coupled information-theoretic encoding for face photo-sketch recognition , 2011, CVPR 2011.

[32]  Xiaogang Wang,et al.  Face Photo-Sketch Synthesis and Recognition , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  Xiaogang Wang,et al.  Face sketch recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[34]  Michael J. Jones,et al.  Fully automatic pose-invariant face recognition via 3D pose normalization , 2011, 2011 International Conference on Computer Vision.

[35]  Shuicheng Yan,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007 .

[36]  D. Jacobs,et al.  Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch , 2011, CVPR 2011.

[37]  Yuxiao Hu,et al.  Face recognition using Laplacianfaces , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Thomas Hofmann,et al.  Kernel Methods for Missing Variables , 2005, AISTATS.