Demonstrating the Vulnerability of RGB-D based Face Recognition to GAN-generated Depth-map Injection

RGB-D cameras are devices able to collect additional information, compared to classical RGB devices, about the observed scene: its depth (D). This has made RGB-D very suitable for many image processing tasks, including presentation attack detection (PAD) in face recognition systems. This work aims at demonstrating that thanks to novel techniques developed in recent years, such as generative adversarial networks (GANs), face PAD systems based on RGB-D are now vulnerable to logical access attack. In this work, a GAN is trained to generate a depth map from an input 2D RGB face image. The attacker can then fool the system by injecting a photo of the authorized user along with the generated depth map. Among all RGB-D devices, this work focuses on light-field cameras but the proposed framework can be easily adapted for other RGB-D devices. The GAN is trained on the IST-EURECOM light-field face database (LFFD). The attack is simulated thanks to the IST lenslet light field face spoofing database (LLFFSD). A third dataset is used to show that the proposed approach generalizes well on a different face database.

[1]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[2]  Paulo Lobato Correia,et al.  Face spoofing detection using a light field imaging framework , 2018, IET Biom..

[3]  Kiran B. Raja,et al.  Comparative evaluation of super-resolution techniques for multi-face recognition using light-field camera , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[4]  Paulo Lobato Correia,et al.  Light field local binary patterns description for face recognition , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[5]  Paulo Lobato Correia,et al.  The IST-EURECOM Light Field Face Database , 2017, 2017 5th International Workshop on Biometrics and Forensics (IWBF).

[6]  Kiran B. Raja,et al.  Improved face recognition at a distance using light field camera & super resolution schemes , 2013, SIN.

[7]  Qing Wang,et al.  LFHOG: A discriminative descriptor for live face detection from light field image , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[8]  Mengyang Liu,et al.  Light field-based face liveness detection with convolutional neural networks , 2019, J. Electronic Imaging.

[9]  Stefanos Zafeiriou,et al.  300 Faces In-The-Wild Challenge: database and results , 2016, Image Vis. Comput..

[10]  Arun Ross,et al.  Biometric template security: Challenges and solutions , 2005, 2005 13th European Signal Processing Conference.

[11]  Alexei A. Efros,et al.  Image-to-Image Translation with Conditional Adversarial Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[12]  Paulo Lobato Correia,et al.  A Double-Deep Spatio-Angular Learning Framework for Light Field-Based Face Recognition , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[13]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[14]  Sangyoun Lee,et al.  Face Liveness Detection Using a Light Field Camera , 2014, Sensors.

[15]  Paulo Lobato Correia,et al.  LIGHT FIELD BASED FACE RECOGNITION VIA A FUSED DEEP REPRESENTATION , 2018, 2018 IEEE 28th International Workshop on Machine Learning for Signal Processing (MLSP).

[16]  Paulo Lobato Correia,et al.  Light Field-Based Face Presentation Attack Detection: Reviewing, Benchmarking and One Step Further , 2018, IEEE Transactions on Information Forensics and Security.

[17]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Kiran B. Raja,et al.  A novel image fusion scheme for robust multiple face recognition with light-field camera , 2013, Proceedings of the 16th International Conference on Information Fusion.

[19]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[20]  Faouzi Alaya Cheikh,et al.  Evaluation of fusion approaches for face recognition using light field cameras , 2015, 2015 Colour and Visual Computing Symposium (CVCS).

[21]  Nalini K. Ratha,et al.  Enhancing security and privacy in biometrics-based authentication systems , 2001, IBM Syst. J..

[22]  Kiran B. Raja,et al.  Presentation Attack Detection for Face Recognition Using Light Field Camera , 2015, IEEE Transactions on Image Processing.

[23]  Sébastien Marcel,et al.  Biometric Antispoofing Methods: A Survey in Face Recognition , 2014, IEEE Access.

[24]  Xiaobo Lv,et al.  Plenoptic Face Presentation Attack Detection , 2020, IEEE Access.

[25]  João Ferreira Nunes,et al.  Human motion analysis and simulation tools , 2012 .

[26]  Paulo Lobato Correia,et al.  Light Fields for Face Analysis , 2019, Sensors.

[27]  Paulo Lobato Correia,et al.  Ear recognition in a light field imaging framework: a new perspective , 2018, IET Biom..

[28]  Jean-Luc Dugelay,et al.  On Multi-View Face Recognition Using Lytro Images , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).