Heterogeneous face recognition via grassmannian based nearest subspace search

Heterogeneous face recognition involves matching faces in different image modalities, such as near infrared images to visible images or sketch images to photos. This challenging task has attracted increasing attention in recent years. This paper presents, for the first time, a subspace based method to tackle the problem of face recognition between visible images (VIS) and near infrared (NIR) images. Subspace is used to extract essential attributes from VIS and NIR images. We adopt Grassmannian radial basis function (RBF) kernel to keep the relationship between subspaces, and use kernel canonical correlation analysis (KCCA) to handle correlation mapping between VIS and NIR domains. After mapping both VIS and NIR images to the common space, the heterogeneous face recognition problem can be easily completed by the nearest search. We evaluate the proposed method on the CASIA NIR-VIS 2.0 dataset. The experimental results demonstrate that our method is very effective for NIR-VIS face recognition.

[1]  Stan Z. Li,et al.  2D–3D face matching using CCA , 2008, 2008 8th IEEE International Conference on Automatic Face & Gesture Recognition.

[2]  Patrick J. Flynn,et al.  A survey of approaches and challenges in 3D and multi-modal 3D + 2D face recognition , 2006, Comput. Vis. Image Underst..

[3]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[4]  Roger Levy,et al.  A new approach to cross-modal multimedia retrieval , 2010, ACM Multimedia.

[5]  Lihi Zelnik-Manor,et al.  A general framework for Approximate Nearest Subspace search , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[6]  Jiwen Lu,et al.  Learning Compact Binary Face Descriptor for Face Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  Shengcai Liao,et al.  The CASIA NIR-VIS 2.0 Face Database , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[8]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[9]  D. Jacobs,et al.  Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch , 2011, CVPR 2011.

[10]  Xu Wang,et al.  Fast Subspace Search via Grassmannian Based Hashing , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Rama Chellappa,et al.  Seeing the Forest from the Trees: A Holistic Approach to Near-Infrared Heterogeneous Face Recognition , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[12]  Hongdong Li,et al.  Expanding the Family of Grassmannian Kernels: An Embedding Perspective , 2014, ECCV.

[13]  Rama Chellappa,et al.  Statistical Computations on Grassmann and Stiefel Manifolds for Image and Video-Based Recognition , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Jiwen Lu,et al.  Large Margin Coupled Feature Learning for cross-modal face recognition , 2015, 2015 International Conference on Biometrics (ICB).

[15]  Brian C. Lovell,et al.  Graph embedding discriminant analysis on Grassmannian manifolds for improved image set matching , 2011, CVPR 2011.

[16]  Lihi Zelnik-Manor,et al.  Approximate Nearest Subspace Search with Applications to Pattern Recognition , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Shotaro Akaho,et al.  A kernel method for canonical correlation analysis , 2006, ArXiv.

[18]  Anil K. Jain,et al.  Heterogeneous Face Recognition: Matching NIR to Visible Light Images , 2010, 2010 20th International Conference on Pattern Recognition.

[19]  Jiwen Lu,et al.  Coupled Discriminative Feature Learning for Heterogeneous Face Recognition , 2015, IEEE Transactions on Information Forensics and Security.

[20]  Marios Savvides,et al.  NIR-VIS heterogeneous face recognition via cross-spectral joint dictionary learning and reconstruction , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[21]  Liwei Wang,et al.  Subspace distance analysis with application to adaptive Bayesian algorithm for face recognition , 2006, Pattern Recognit..

[22]  Lihi Zelnik-Manor,et al.  Approximate Nearest Subspace Search , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.