Prototype Correction via Contrastive Augmentation for Few-Shot Unconstrained Palmprint Recognition

Unconstrained Palmprint Recognition (UPR) shows engaging potential owing to its high hygiene and privacy. The unconstrained acquisition usually produces wide variations, against which deep methods resort to large samples that are unavailable in practice, however. We focus on Few-Shot UPR (FS-UPR), a more general problem, recognizing query samples given a few support samples per class. Because scarce samples insufficiently represent potential variations, the augmentation methods train independent hallucinators on large samples to generate more ones. Whereas, the hallucinators trained independently of Few-Shot Learning (FSL) are blind of generating promising samples to boost the downstream FSL. Moreover, training hallucinators requires large samples per class, unavailable from unconstrained palmprint databases. We aim to address FS-UPR via contrastive augmentation merely on the support samples. Observing the variations to be transferable across samples, we exploit low-rank representation to disentangle support samples into principles and variations in embedding space and augment features by variation transfer. To this end, we devise an end-to-end Deep Low-Rank Representation Feature Augmentation Network (DLRR-FAN) to simultaneously learn the embedding space and augmentation features with guaranteed reality and diversity. Furthermore, a Contrastive Recognition Regularizer (CRR) is tailored to secure the discriminability of augmentation features. During each training episode, the task motivates DLRR-FAN to augment such features that correct the biased prototypes towards upcoming query samples with variations unseen in the support samples, namely task-driven prototype correction. Extensive experiments on both the typical and extended FS-UPR tasks demonstrate the efficacy of DLRR-FAN versus the state-of-the-art methods.

[1]  Shervin Minaee,et al.  Biometrics recognition using deep learning: a survey , 2023, Artificial Intelligence Review.

[2]  B. Wen,et al.  Feature Augmentation Learning for Few-Shot Palmprint Image Recognition With Unconstrained Acquisition , 2022, ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Qilong Wang,et al.  Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Wook-Shin Han,et al.  Contrastive Regularization for Semi-Supervised Learning , 2022, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[5]  Tom Drummond,et al.  Adaptive Poincaré Point to Set Distance for Few-Shot Classification , 2021, AAAI.

[6]  Zhao Kang,et al.  Multi-view Contrastive Graph Clustering , 2021, NeurIPS.

[7]  Xinman Zhang,et al.  Double-Laplacian Mixture-Error Model-Based Supervised Group-Sparse Coding for Robust Palmprint Recognition , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[8]  Zenglin Xu,et al.  Pseudo-Supervised Deep Subspace Clustering , 2021, IEEE Transactions on Image Processing.

[9]  David Zhang,et al.  Touchless Palmprint Recognition based on 3D Gabor Template and Block Feature Refinement , 2021, Knowl. Based Syst..

[10]  Dexing Zhong,et al.  Few-shot palmprint recognition based on similarity metric hashing network , 2021, Neurocomputing.

[11]  Min Xu,et al.  Free Lunch for Few-shot Learning: Distribution Calibration , 2021, ICLR.

[12]  Zhongming Jin,et al.  Deep Robust Clustering by Contrastive Learning , 2020, ArXiv.

[13]  Shiguang Shan,et al.  Learning to Learn Adaptive Classifier–Predictor for Few-Shot Learning , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[14]  Dexing Zhong,et al.  Boosting Unconstrained Palmprint Recognition With Adversarial Metric Learning , 2020, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[15]  Mehrtash Harandi,et al.  Adaptive Subspaces for Few-Shot Learning , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Kai Li,et al.  Adversarial Feature Hallucination Networks for Few-Shot Learning , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Shaoxin Li,et al.  Towards Palmprint Verification On Smartphones , 2020, ArXiv.

[18]  P. Corcoran,et al.  Toward Unconstrained Palmprint Recognition on Consumer Devices: A Literature Review , 2020, IEEE Access.

[19]  Debasmit Das,et al.  A Two-Stage Approach to Few-Shot Learning for Image Recognition , 2019, IEEE Transactions on Image Processing.

[20]  Adams Wai-Kin Kong,et al.  Palmprint Recognition in Uncontrolled and Uncooperative Environment , 2019, IEEE Transactions on Information Forensics and Security.

[21]  Ross B. Girshick,et al.  Momentum Contrast for Unsupervised Visual Representation Learning , 2019, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Jiayu Dong,et al.  Laplacian-Uniform Mixture-Driven Iterative Robust Coding With Applications to Face Recognition Against Dense Errors , 2019, IEEE Transactions on Neural Networks and Learning Systems.

[23]  Aurelio Uncini,et al.  Joint feature fusion and optimization via deep discriminative model for mobile palmprint verification , 2019, J. Electronic Imaging.

[24]  Dexing Zhong,et al.  Few‐shot palmprint recognition via graph neural networks , 2019, Electronics Letters.

[25]  Abhishek Sinha,et al.  Charting the Right Manifold: Manifold Mixup for Few-shot Learning , 2019, 2020 IEEE Winter Conference on Applications of Computer Vision (WACV).

[26]  Yu-Gang Jiang,et al.  Image Block Augmentation for One-Shot Learning , 2019, AAAI.

[27]  Dexing Zhong,et al.  Low-Shot Palmprint Recognition Based on Meta-Siamese Network , 2019, 2019 IEEE International Conference on Multimedia and Expo (ICME).

[28]  Dexing Zhong,et al.  Efficient Deep Palmprint Recognition via Distilled Hashing Coding , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[29]  Martial Hebert,et al.  Image Deformation Meta-Networks for One-Shot Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Feiyue Huang,et al.  LGM-Net: Learning to Generate Matching Networks for Few-Shot Learning , 2019, ICML.

[31]  Nikos Komodakis,et al.  Generating Classification Weights With GNN Denoising Autoencoders for Few-Shot Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Zhouchen Lin,et al.  Self-Supervised Convolutional Subspace Clustering Network , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Vincenzo Piuri,et al.  PalmNet: Gabor-PCA Convolutional Networks for Touchless Palmprint Recognition , 2019, IEEE Transactions on Information Forensics and Security.

[34]  Zhenhua Guo,et al.  Learning Discriminant Direction Binary Palmprint Descriptor , 2019, IEEE Transactions on Image Processing.

[35]  Fei Sha,et al.  Few-Shot Learning via Embedding Adaptation With Set-to-Set Functions , 2018, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Bernt Schiele,et al.  Meta-Transfer Learning for Few-Shot Learning , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Lai Guan Ng,et al.  Dimensionality reduction for visualizing single-cell data using UMAP , 2018, Nature Biotechnology.

[38]  Yoshua Bengio,et al.  MetaGAN: An Adversarial Approach to Few-Shot Learning , 2018, NeurIPS.

[39]  Shih-Fu Chang,et al.  Low-shot Learning via Covariance-Preserving Adversarial Augmentation Networks , 2018, NeurIPS.

[40]  Razvan Pascanu,et al.  Meta-Learning with Latent Embedding Optimization , 2018, ICLR.

[41]  Rogério Schmidt Feris,et al.  Delta-encoder: an effective sample synthesis method for few-shot object recognition , 2018, NeurIPS.

[42]  Alexandre Lacoste,et al.  TADAM: Task dependent adaptive metric for improved few-shot learning , 2018, NeurIPS.

[43]  Xiangyang Xue,et al.  Multi-Level Semantic Feature Augmentation for One-Shot Learning , 2018, IEEE Transactions on Image Processing.

[44]  David Zhang,et al.  Discriminative and Robust Competitive Code for Palmprint Recognition , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[45]  Martial Hebert,et al.  Low-Shot Learning from Imaginary Data , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[46]  Tsendsuren Munkhdalai,et al.  Rapid Adaptation with Conditionally Shifted Neurons , 2017, ICML.

[47]  Tao Xiang,et al.  Learning to Compare: Relation Network for Few-Shot Learning , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[48]  Peter Corcoran,et al.  Unconstrained palmprint as a smartphone biometric , 2017, IEEE Transactions on Consumer Electronics.

[49]  Tong Zhang,et al.  Deep Subspace Clustering Networks , 2017, NIPS.

[50]  Ying Shen,et al.  Towards contactless palmprint recognition: A novel device, a new benchmark, and a collaborative representation based identification approach , 2017, Pattern Recognit..

[51]  Wei Shen,et al.  Few-Shot Image Recognition by Predicting Parameters from Activations , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[52]  Wei Jia,et al.  Palmprint Recognition Based on Complete Direction Representation , 2017, IEEE Transactions on Image Processing.

[53]  Richard S. Zemel,et al.  Prototypical Networks for Few-shot Learning , 2017, NIPS.

[54]  Sergey Levine,et al.  Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networks , 2017, ICML.

[55]  Martial Hebert,et al.  Learning from Small Sample Sets by Combining Unsupervised Meta-Training with CNNs , 2016, NIPS.

[56]  Hugo Larochelle,et al.  Optimization as a Model for Few-Shot Learning , 2016, ICLR.

[57]  Yun Fu,et al.  Learning Robust and Discriminative Subspace With Low-Rank Constraints , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[58]  Arun Ross,et al.  50 years of biometric research: Accomplishments, challenges, and opportunities , 2016, Pattern Recognit. Lett..

[59]  Wei-Yun Yau,et al.  Deep Subspace Clustering with Sparsity Prior , 2016, IJCAI.

[60]  Oriol Vinyals,et al.  Matching Networks for One Shot Learning , 2016, NIPS.

[61]  Bharath Hariharan,et al.  Low-Shot Visual Recognition by Shrinking and Hallucinating Features , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[62]  Junbin Gao,et al.  Laplacian Regularized Low-Rank Representation and Its Applications , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[63]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[64]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[65]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[66]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[67]  Davide Maltoni,et al.  Minutia Cylinder-Code: A New Representation and Matching Technique for Fingerprint Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[68]  Yong Yu,et al.  Robust Recovery of Subspace Structures by Low-Rank Representation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[69]  Zhenhua Guo,et al.  Palmprint verification using binary orientation co-occurrence vector , 2009, Pattern Recognit. Lett..

[70]  Mikhail Belkin,et al.  Laplacian Eigenmaps and Spectral Techniques for Embedding and Clustering , 2001, NIPS.

[71]  A. DiCenso,et al.  Confidence Intervals , 1984, National Institute Economic Review.

[72]  Dexing Zhong,et al.  One-shot cross-dataset palmprint recognition via adversarial domain adaptation , 2021, Neurocomputing.

[73]  Raymond N. J. Veldhuis,et al.  Few-Shot Learning for Palmprint Recognition via Meta-Siamese Network , 2021, IEEE Transactions on Instrumentation and Measurement.

[74]  Dexing Zhong,et al.  Deep Distillation Hashing for Unconstrained Palmprint Recognition , 2021, IEEE Transactions on Instrumentation and Measurement.

[75]  Licheng Jiao,et al.  Deep Multi-View Subspace Clustering With Unified and Discriminative Learning , 2021, IEEE Transactions on Multimedia.

[76]  Xindong Wu,et al.  Graph-Based Learning via Auto-Grouped Sparse Regularization and Kernelized Extension , 2015, IEEE Transactions on Knowledge and Data Engineering.

[77]  Anil K. Jain,et al.  Biometric Authentication: System Security and User Privacy , 2012, Computer.

[78]  Geoffrey E. Hinton,et al.  Visualizing Data using t-SNE , 2008 .