Cross-spectrum Face Recognition Using Subspace Projection Hashing

Cross-spectrum face recognition, e.g. visible to thermal matching, remains a challenging task due to the large variation originated from different domains. This paper proposed a subspace projection hashing (SPH) to enable the cross-spectrum face recognition task. The intrinsic idea behind SPH is to project the features from different domains onto a common subspace, where matching the faces from different domains can be accomplished. Notably, we proposed a new loss function that can (i) preserve both inter-domain and intra-domain similarity; (ii) regularize a scaled-up pairwise distance between hashed codes, to optimize projection matrix. Three datasets, Wiki, EURECOM VIS-TH paired face and TDFace are adopted to evaluate the proposed SPH. The experimental results indicate that the proposed SPH outperforms the original linear subspace ranking hashing (LSRH) in the benchmark dataset (Wiki) and demonstrates a reasonably good performance for visible-thermal, visible-near-infrared face recognition, therefore suggests the feasibility and effectiveness of the proposed SPH.

[1]  Zhe Jin,et al.  A Secure Visual-thermal Fused Face Recognition System Based on Non-Linear Hashing , 2019, 2019 IEEE 21st International Workshop on Multimedia Signal Processing (MMSP).

[2]  Kilian Q. Weinberger,et al.  Distance Metric Learning for Large Margin Nearest Neighbor Classification , 2005, NIPS.

[3]  Hakan Cevikalp,et al.  Face recognition based on image sets , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[4]  Naser Damer,et al.  Robust Face Authentication Based on Dynamic Quality-weighted Comparison of Visible and Thermal-to-visible images to Visible Enrollments , 2019, 2019 22th International Conference on Information Fusion (FUSION).

[5]  Joshua B. Tenenbaum,et al.  Separating Style and Content with Bilinear Models , 2000, Neural Computation.

[6]  David W. Jacobs,et al.  Generalized Multiview Analysis: A discriminative latent space , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Stephen Lin,et al.  Graph Embedding and Extensions: A General Framework for Dimensionality Reduction , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Shengcai Liao,et al.  Heterogeneous Face Recognition from Local Structures of Normalized Appearance , 2009, ICB.

[9]  Vishal M. Patel,et al.  Synthesis of High-Quality Visible Faces from Polarimetric Thermal Faces using Generative Adversarial Networks , 2018, International Journal of Computer Vision.

[10]  Wei Liu,et al.  Learning Hash Codes with Listwise Supervision , 2013, 2013 IEEE International Conference on Computer Vision.

[11]  Brian C. Lovell,et al.  TV-GAN: Generative Adversarial Network Based Thermal to Visible Face Recognition , 2017, 2018 International Conference on Biometrics (ICB).

[12]  Naser Damer,et al.  Cross-spectrum thermal to visible face recognition based on cascaded image synthesis , 2019, 2019 International Conference on Biometrics (ICB).

[13]  Harry Wechsler,et al.  Open set face recognition using transduction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Wei Liu,et al.  Discrete Graph Hashing , 2014, NIPS.

[15]  Anil K. Jain,et al.  Heterogeneous Face Recognition Using Kernel Prototype Similarities , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[16]  Anil K. Jain,et al.  Heterogeneous Face Recognition: Matching NIR to Visible Light Images , 2010, 2010 20th International Conference on Pattern Recognition.

[17]  Roger Levy,et al.  A new approach to cross-modal multimedia retrieval , 2010, ACM Multimedia.

[18]  Anil K. Jain,et al.  Face Matching and Retrieval in Forensics Applications , 2012, IEEE MultiMedia.

[19]  John Shawe-Taylor,et al.  Canonical Correlation Analysis: An Overview with Application to Learning Methods , 2004, Neural Computation.

[20]  Jianmin Wang,et al.  Deep Hashing Network for Efficient Similarity Retrieval , 2016, AAAI.

[21]  Sos S. Agaian,et al.  Illumination invariant NIR face recognition using directional visibility , 2019, Image Processing: Algorithms and Systems.

[22]  Jean-Luc Dugelay,et al.  A benchmark database of visible and thermal paired face images across multiple variations , 2018, 2018 International Conference of the Biometrics Special Interest Group (BIOSIG).

[23]  Xin Yuan,et al.  A Comprehensive Database for Benchmarking Imaging Systems , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Stefanos Zafeiriou,et al.  ArcFace: Additive Angular Margin Loss for Deep Face Recognition , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Yu Qiao,et al.  Mutual Component Convolutional Neural Networks for Heterogeneous Face Recognition , 2019, IEEE Transactions on Image Processing.

[26]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Kien A. Hua,et al.  Linear Subspace Ranking Hashing for Cross-Modal Retrieval , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Jiwen Lu,et al.  Coupled Discriminative Feature Learning for Heterogeneous Face Recognition , 2015, IEEE Transactions on Information Forensics and Security.

[29]  Massimo Melucci,et al.  On rank correlation in information retrieval evaluation , 2007, SIGF.

[30]  D. Jacobs,et al.  Bypassing synthesis: PLS for face recognition with pose, low-resolution and sketch , 2011, CVPR 2011.