Dual Spoof Disentanglement Generation for Face Anti-Spoofing With Depth Uncertainty Learning

Face anti-spoofing (FAS) plays a vital role in preventing face recognition systems from presentation attacks. Existing face anti-spoofing datasets lack diversity due to the insufficient identity and insignificant variance, which limits the generalization ability of FAS model. In this paper, we propose Dual Spoof Disentanglement Generation (DSDG) framework to tackle this challenge by “anti-spoofing via generation”. Depending on the interpretable factorized latent disentanglement in Variational Autoencoder (VAE), DSDG learns a joint distribution of the identity representation and the spoofing pattern representation in the latent space. Then, large-scale paired live and spoofing images can be generated from random noise to boost the diversity of the training set. However, some generated face images are partially distorted due to the inherent defect of VAE. Such noisy samples are hard to predict precise depth values, thus may obstruct the widely-used depth supervised optimization. To tackle this issue, we further introduce a lightweight Depth Uncertainty Module (DUM), which alleviates the adverse effects of noisy samples by depth uncertainty learning. DUM is developed without extradependency, thus can be flexibly integrated with any depth supervised network for face anti-spoofing. We evaluate the effectiveness of the proposed method on five popular benchmarks and achieve state-of-the-art results under both intraand intertest settings. The codes are available at https://github.com/JDAICV/FaceX-Zoo/tree/main/addition module/DSDG.

[1]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[2]  Feiyue Huang,et al.  Face Anti-Spoofing Via Disentangled Representation Learning , 2020, ECCV.

[3]  Guoying Zhao,et al.  Deep Learning for Face Anti-Spoofing: A Survey , 2021, ArXiv.

[4]  Shengcai Liao,et al.  Face liveness detection with component dependent descriptor , 2013, 2013 International Conference on Biometrics (ICB).

[5]  Yuan Xie,et al.  Dual Reweighting Domain Generalization for Face Presentation Attack Detection , 2021, IJCAI.

[6]  Shiqi Wang,et al.  DRL-FAS: A Novel Framework Based on Deep Reinforcement Learning for Face Anti-Spoofing , 2020, IEEE Transactions on Information Forensics and Security.

[7]  Jukka Komulainen,et al.  Face Antispoofing Using Speeded-Up Robust Features and Fisher Vector Encoding , 2017, IEEE Signal Processing Letters.

[8]  Ran He,et al.  Dual Variational Generation for Low-Shot Heterogeneous Face Recognition , 2019, NeurIPS.

[9]  Qian Zhang,et al.  High Fidelity Face Manipulation with Extreme Pose and Expression , 2019, ArXiv.

[10]  Sébastien Marcel,et al.  Can face anti-spoofing countermeasures work in a real world scenario? , 2013, 2013 International Conference on Biometrics (ICB).

[11]  Jun Wan,et al.  Face Anti-Spoofing via Adversarial Cross-Modality Translation , 2021, IEEE Transactions on Information Forensics and Security.

[12]  Hyuk-Jae Lee,et al.  Gaussian YOLOv3: An Accurate and Fast Object Detector Using Localization Uncertainty for Autonomous Driving , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[13]  Julien Cornebise,et al.  Weight Uncertainty in Neural Networks , 2015, ArXiv.

[14]  Zhenan Sun,et al.  Learning a High Fidelity Pose Invariant Model for High-resolution Face Frontalization , 2018, NeurIPS.

[15]  Xiangyu Zhu,et al.  Deep Spatial Gradient and Temporal Depth Learning for Face Anti-Spoofing , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Xiaoming Liu,et al.  Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[17]  Xiaoming Liu,et al.  Face anti-spoofing using patch and depth-based CNNs , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[18]  Anil K. Jain,et al.  Secure Face Unlock: Spoof Detection on Smartphones , 2016, IEEE Transactions on Information Forensics and Security.

[19]  Xiaoming Liu,et al.  Face De-Spoofing: Anti-Spoofing via Noise Modeling , 2018, ECCV.

[20]  Matti Pietikäinen,et al.  Generalized face anti-spoofing by detecting pulse from face videos , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[21]  Fang Zhao,et al.  Dual-Agent GANs for Photorealistic and Identity Preserving Profile Face Synthesis , 2017, NIPS.

[22]  Chenxu Zhao,et al.  Searching Central Difference Convolutional Networks for Face Anti-Spoofing , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[24]  K. Dietmayer,et al.  Uncertainty Estimation in One-Stage Object Detection , 2019, 2019 IEEE Intelligent Transportation Systems Conference (ITSC).

[25]  Weihong Deng,et al.  Orthogonality Loss: Learning Discriminative Representations for Face Recognition , 2020 .

[26]  Anjith George,et al.  Learning One Class Representations for Face Presentation Attack Detection Using Multi-Channel Convolutional Neural Networks , 2020, IEEE Transactions on Information Forensics and Security.

[27]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[28]  Guoying Zhao,et al.  Dual-Cross Central Difference Network for Face Anti-Spoofing , 2021, IJCAI.

[29]  Zhen Lei,et al.  Meta-Teacher For Face Anti-Spoofing , 2021, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Fang Zhao,et al.  Towards Pose Invariant Face Recognition in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[31]  Shiqi Wang,et al.  Learning Generalized Deep Feature Representation for Face Anti-Spoofing , 2018, IEEE Transactions on Information Forensics and Security.

[32]  Chen Lin,et al.  Live Face Verification with Multiple Instantialized Local Homographic Parameterization , 2018, IJCAI.

[33]  Zhenan Sun,et al.  3D Aided Duet GANs for Multi-View Face Image Synthesis , 2019, IEEE Transactions on Information Forensics and Security.

[34]  Lizhuang Ma,et al.  Adaptive Normalized Representation Learning for Generalizable Face Anti-Spoofing , 2021, ACM Multimedia.

[35]  Sébastien Marcel,et al.  On the effectiveness of local binary patterns in face anti-spoofing , 2012, 2012 BIOSIG - Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG).

[36]  Shiliang Pu,et al.  Self-Domain Adaptation for Face Anti-Spoofing , 2021, AAAI.

[37]  Abdenour Hadid,et al.  An original face anti-spoofing approach using partial convolutional neural network , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[38]  Zhaoqiang Xia,et al.  Revisiting Pixel-Wise Supervision for Face Anti-Spoofing , 2020, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[39]  Xiaoming Liu,et al.  Deep Tree Learning for Zero-Shot Face Anti-Spoofing , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[40]  Guoying Zhao,et al.  Face Liveness Detection by rPPG Features and Contextual Patch-Based CNN , 2019, ICBEA.

[41]  Paulo Lobato Correia,et al.  A Double-Deep Spatio-Angular Learning Framework for Light Field-Based Face Recognition , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[42]  Zoubin Ghahramani,et al.  Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learning , 2015, ICML.

[43]  Tieniu Tan,et al.  A Light CNN for Deep Face Representation With Noisy Labels , 2015, IEEE Transactions on Information Forensics and Security.

[44]  Roberto Cipolla,et al.  Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding , 2015, BMVC.

[45]  Alex C. Kot,et al.  Detection of Spoofing Medium Contours for Face Anti-Spoofing , 2021, IEEE Transactions on Circuits and Systems for Video Technology.

[46]  Xiangyu Zhu,et al.  Learning Meta Model for Zero- and Few-Shot Face Anti-Spoofing , 2019, AAAI.

[47]  Pong C. Yuen,et al.  Multi-Adversarial Discriminative Deep Domain Generalization for Face Presentation Attack Detection , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[48]  Sergio Escalera,et al.  CASIA-SURF CeFA: A Benchmark for Multi-modal Cross-ethnicity Face Anti-spoofing , 2020, 2021 IEEE Winter Conference on Applications of Computer Vision (WACV).

[49]  Pong C. Yuen,et al.  Joint Discriminative Learning of Deep Dynamic Textures for 3D Mask Face Anti-Spoofing , 2019, IEEE Transactions on Information Forensics and Security.

[50]  Jukka Komulainen,et al.  Face anti-spoofing based on color texture analysis , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[51]  Tao Mei,et al.  FaceX-Zoo: A PyTorch Toolbox for Face Recognition , 2021, ACM Multimedia.

[52]  Zhenan Sun,et al.  M2FPA: A Multi-Yaw Multi-Pitch High-Quality Dataset and Benchmark for Facial Pose Analysis , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[53]  Sam Kwong,et al.  Camera Invariant Feature Learning for Generalized Face Anti-Spoofing , 2021, IEEE Transactions on Information Forensics and Security.

[54]  Feiyue Huang,et al.  Generalizable Representation Learning for Mixture Domain Face Anti-Spoofing , 2021, AAAI.

[55]  Jun Liu,et al.  Single-Shot Face Anti-Spoofing for Dual Pixel Camera , 2021, IEEE Transactions on Information Forensics and Security.

[56]  Tao Mei,et al.  Dive into Ambiguity: Latent Distribution Mining and Pairwise Uncertainty Estimation for Facial Expression Recognition , 2021, 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[57]  Sébastien Marcel,et al.  LBP - TOP Based Countermeasure against Face Spoofing Attacks , 2012, ACCV Workshops.

[58]  Shuicheng Yan,et al.  Look Across Elapse: Disentangled Representation Learning and Photorealistic Cross-Age Face Synthesis for Age-Invariant Face Recognition , 2018, AAAI.

[59]  Ran He,et al.  DVG-Face: Dual Variational Generation for Heterogeneous Face Recognition , 2020, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Xilin Chen,et al.  Unsupervised Adversarial Domain Adaptation for Cross-Domain Face Presentation Attack Detection , 2021, IEEE Transactions on Information Forensics and Security.

[61]  Xin Yu,et al.  Progressive Transfer Learning for Face Anti-Spoofing , 2021, IEEE Transactions on Image Processing.

[62]  Xiaoming Liu,et al.  On Disentangling Spoof Trace for Generic Face Anti-Spoofing , 2020, ECCV.

[63]  Matti Pietikäinen,et al.  Face spoofing detection from single images using micro-texture analysis , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[64]  Yichen Wei,et al.  Data Uncertainty Learning in Face Recognition , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[65]  Anil K. Jain,et al.  Probabilistic Face Embeddings , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[66]  Matti Pietikäinen,et al.  Context based face anti-spoofing , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[67]  Xilin Chen,et al.  Single-Side Domain Generalization for Face Anti-Spoofing , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[68]  Xi Zhou,et al.  Joint 3D Face Reconstruction and Dense Alignment with Position Map Regression Network , 2018, ECCV.

[69]  Hakan Cevikalp,et al.  Face Recognition Based on Videos by Using Convex Hulls , 2020, IEEE Transactions on Circuits and Systems for Video Technology.

[70]  Cheng-Yaw Low,et al.  Multi-Fold Gabor, PCA, and ICA Filter Convolution Descriptor for Face Recognition , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[71]  Wenhan Luo,et al.  Face Anti-Spoofing: Model Matters, so Does Data , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[72]  Jukka Komulainen,et al.  OULU-NPU: A Mobile Face Presentation Attack Database with Real-World Variations , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[73]  Jingang Shi,et al.  Face Anti-Spoofing with Human Material Perception , 2020, ECCV.

[74]  Zhenan Sun,et al.  Learning an Evolutionary Embedding via Massive Knowledge Distillation , 2020, International Journal of Computer Vision.

[75]  Alex Kendall,et al.  What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision? , 2017, NIPS.

[76]  Feiyue Huang,et al.  Unsupervised Domain Adaptation for Face Anti-Spoofing , 2018, IEEE Transactions on Information Forensics and Security.

[77]  Shuichi Arai,et al.  Deep convolutional encoder-decoder network with model uncertainty for semantic segmentation , 2017, 2017 IEEE International Conference on INnovations in Intelligent SysTems and Applications (INISTA).

[78]  Olegs Nikisins,et al.  Biometric Face Presentation Attack Detection With Multi-Channel Convolutional Neural Network , 2019, IEEE Transactions on Information Forensics and Security.

[79]  Anjith George,et al.  Deep Pixel-wise Binary Supervision for Face Presentation Attack Detection , 2019, 2019 International Conference on Biometrics (ICB).

[80]  Stan Z. Li,et al.  Person-Specific Face Antispoofing With Subject Domain Adaptation , 2015, IEEE Transactions on Information Forensics and Security.

[81]  Zhenan Sun,et al.  Dual-Structure Disentangling Variational Generation for Data-Limited Face Parsing , 2020, ACM Multimedia.

[82]  Zhenan Sun,et al.  Pose-Guided Photorealistic Face Rotation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[83]  Junjie Yan,et al.  A face antispoofing database with diverse attacks , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[84]  Sergio Escalera,et al.  Cross-ethnicity Face Anti-spoofing Recognition Challenge: A Review , 2020, IET Biom..

[85]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[86]  Ling Shao,et al.  Striking the Right Balance With Uncertainty , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[87]  Jilin Li,et al.  Structure Destruction and Content Combination for Face Anti-Spoofing , 2021, 2021 IEEE International Joint Conference on Biometrics (IJCB).

[88]  Yonghyun Kim,et al.  BASN: Enriching Feature Representation Using Bipartite Auxiliary Supervisions for Face Anti-Spoofing , 2019, 2019 IEEE/CVF International Conference on Computer Vision Workshop (ICCVW).

[89]  Jukka Komulainen,et al.  Face Spoofing Detection Using Colour Texture Analysis , 2016, IEEE Transactions on Information Forensics and Security.

[90]  Anil K. Jain,et al.  Look Locally Infer Globally: A Generalizable Face Anti-Spoofing Approach , 2021, IEEE Transactions on Information Forensics and Security.