Light Field-Based Face Presentation Attack Detection: Reviewing, Benchmarking and One Step Further

Vulnerability of face recognition systems to presentation attacks has attracted increasing attention from the biometrics and forensics communities. Moreover, the recent availability of light field cameras is opening new possibilities for designing improved face presentation attack detection solutions. In this context, this paper provides the first review and benchmarking study in the literature on light field-based face presentation attack detection solutions. State-of-the-art solutions are assessed in terms of accuracy, generalization and complexity, using a common, representative evaluation framework. This paper also proposes a novel face presentation attack detection solution, based on a histogram of oriented gradients descriptor, which exploits the disparity information available in light field imaging. The evaluation of the proposed face presentation attack detection solution for different presentation attack types shows a very effective and stable performance, notably performing better than the state-of-the-art alternatives.

[1]  Junjie Yan,et al.  A face antispoofing database with diverse attacks , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[2]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[3]  Singh Richa,et al.  Face anti-spoofing using Haralick features , 2016 .

[4]  Qing Wang,et al.  LFHOG: A discriminative descriptor for live face detection from light field image , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[5]  Libin Yang,et al.  Face liveness detection by focusing on frontal faces and image backgrounds , 2014, 2014 International Conference on Wavelet Analysis and Pattern Recognition.

[6]  N. Kose,et al.  Classification of captured and recaptured images to detect photograph spoofing , 2012, 2012 International Conference on Informatics, Electronics & Vision (ICIEV).

[7]  M. Landy,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[8]  Sébastien Marcel,et al.  Can face anti-spoofing countermeasures work in a real world scenario? , 2013, 2013 International Conference on Biometrics (ICB).

[9]  Fernando Pereira,et al.  Efficient plenoptic imaging representation: Why do we need it? , 2016, 2016 IEEE International Conference on Multimedia and Expo (ICME).

[10]  P. Hanrahan,et al.  Light Field Photography with a Hand-held Plenoptic Camera , 2005 .

[11]  Kiran B. Raja,et al.  Exploring the Usefulness of Light Field Cameras for Biometrics: An Empirical Study on Face and Iris Recognition , 2016, IEEE Transactions on Information Forensics and Security.

[12]  Sébastien Marcel,et al.  2D Face Recognition: An Experimental and Reproducible Research Survey , 2017 .

[13]  Yi Li,et al.  Face Liveness Detection from a Single Image with Sparse Low Rank Bilinear Discriminative Model , 2010, ECCV.

[14]  Stan Z. Li,et al.  Face liveness detection by learning multispectral reflectance distributions , 2011, Face and Gesture 2011.

[15]  Azriel Rosenfeld,et al.  Face recognition: A literature survey , 2003, CSUR.

[16]  Stan Z. Li,et al.  Learn Convolutional Neural Network for Face Anti-Spoofing , 2014, ArXiv.

[17]  Abdenour Hadid,et al.  Biometrics Systems Under Spoofing Attack: An evaluation methodology and lessons learned , 2015, IEEE Signal Processing Magazine.

[18]  Lai-Man Po,et al.  Integration of image quality and motion cues for face anti-spoofing: A neural network approach , 2016, J. Vis. Commun. Image Represent..

[19]  Paulo Lobato Correia,et al.  Light field local binary patterns description for face recognition , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[20]  Sangyoun Lee,et al.  Face Liveness Detection Using a Light Field Camera , 2014, Sensors.

[21]  Ramachandra Raghavendra,et al.  Robust 2D/3D face mask presentation attack detection scheme by exploring multiple features and comparison score level fusion , 2014, 17th International Conference on Information Fusion (FUSION).

[22]  Abdenour Hadid,et al.  An original face anti-spoofing approach using partial convolutional neural network , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[23]  Arun Ross,et al.  An introduction to biometric recognition , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  M. Levoy,et al.  The light field , 1939 .

[25]  Sébastien Marcel,et al.  LBP - TOP Based Countermeasure against Face Spoofing Attacks , 2012, ACCV Workshops.

[26]  Abdenour Hadid,et al.  Face recognition under spoofing attacks: countermeasures and research directions , 2018, IET Biom..

[27]  Farzin Deravi,et al.  Directional Sensitivity of Gaze-Collinearity Features in Liveness Detection , 2013, 2013 Fourth International Conference on Emerging Security Technologies.

[28]  Sébastien Marcel,et al.  Counter-measures to photo attacks in face recognition: A public database and a baseline , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[29]  Jukka Komulainen,et al.  Face Antispoofing Using Speeded-Up Robust Features and Fisher Vector Encoding , 2017, IEEE Signal Processing Letters.

[30]  Sangyoun Lee,et al.  Face Liveness Detection Using Defocus , 2015, Sensors.

[31]  Mark Horowitz,et al.  High performance imaging using arrays of inexpensive cameras , 2004 .

[32]  Pei-Yin Chen,et al.  An Efficient Hardware Implementation of HOG Feature Extraction for Human Detection , 2014, IEEE Transactions on Intelligent Transportation Systems.

[33]  Lin Sun,et al.  Monocular camera-based face liveness detection by combining eyeblink and scene context , 2011, Telecommun. Syst..

[34]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[35]  Antonio Albiol,et al.  Face recognition using HOG-EBGM , 2008, Pattern Recognit. Lett..

[36]  Sangyoun Lee,et al.  Face liveness detection using variable focusing , 2013, 2013 International Conference on Biometrics (ICB).

[37]  Sébastien Marcel,et al.  Biometric Antispoofing Methods: A Survey in Face Recognition , 2014, IEEE Access.

[38]  Paulo Lobato Correia,et al.  The IST-EURECOM Light Field Face Database , 2017, 2017 5th International Workshop on Biometrics and Forensics (IWBF).

[39]  Shengcai Liao,et al.  Face liveness detection with component dependent descriptor , 2013, 2013 International Conference on Biometrics (ICB).

[40]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[41]  R A Kirsch,et al.  Computer determination of the constituent structure of biological images. , 1971, Computers and biomedical research, an international journal.

[42]  Lei Huang,et al.  A Novel Face Spoofing Detection Method Based on Gaze Estimation , 2014, ACCV.

[43]  Sébastien Marcel,et al.  Spoofing Face Recognition With 3D Masks , 2014, IEEE Transactions on Information Forensics and Security.

[44]  Samarth Bharadwaj,et al.  Computationally Efficient Face Spoofing Detection with Motion Magnification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[45]  Mei-Chen Yeh,et al.  Fast Human Detection Using a Cascade of Histograms of Oriented Gradients , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[46]  Anil K. Jain,et al.  Secure Face Unlock: Spoof Detection on Smartphones , 2016, IEEE Transactions on Information Forensics and Security.

[47]  Ramachandra Raghavendra,et al.  Presentation Attack Detection Methods for Face Recognition Systems , 2017, ACM Comput. Surv..

[48]  K. Harshika Image Quality Assessment for Fake Biometric Detection : Application to Iris , Fingerprint , and Face Recognition , 2017 .

[49]  Wei Cao,et al.  Implementation of high performance hardware architecture of face recognition algorithm based on local binary pattern on FPGA , 2015, 2015 IEEE 11th International Conference on ASIC (ASICON).

[50]  Ausif Mahmood,et al.  Deep face liveness detection based on nonlinear diffusion using convolution neural network , 2016, Signal, Image and Video Processing.

[51]  Matti Pietikäinen,et al.  Face spoofing detection from single images using micro-texture analysis , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[52]  Kiran B. Raja,et al.  Presentation Attack Detection for Face Recognition Using Light Field Camera , 2015, IEEE Transactions on Image Processing.

[53]  Francesco G. B. De Natale,et al.  FACE spoofing detection using LDP-TOP , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[54]  Kiran B. Raja,et al.  A new perspective — Face recognition with light-field camera , 2013, 2013 International Conference on Biometrics (ICB).

[55]  Sébastien Marcel,et al.  On the effectiveness of local binary patterns in face anti-spoofing , 2012, 2012 BIOSIG - Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG).

[56]  Anil K. Jain,et al.  Face Spoof Detection With Image Distortion Analysis , 2015, IEEE Transactions on Information Forensics and Security.

[57]  Anderson Rocha,et al.  Face Spoofing Detection Through Visual Codebooks of Spectral Temporal Cubes , 2015, IEEE Transactions on Image Processing.

[58]  Andreas Uhl,et al.  Non-reference image quality assessment for biometric presentation attack detection , 2017, 2017 5th International Workshop on Biometrics and Forensics (IWBF).

[59]  Jean-Luc Dugelay,et al.  Reflectance analysis based countermeasure technique to detect face mask attacks , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[60]  Guifen Tian,et al.  Spoofing detection for embedded face recognition system using a low cost stereo camera , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[61]  Sébastien Marcel,et al.  Face Anti-spoofing Based on General Image Quality Assessment , 2014, 2014 22nd International Conference on Pattern Recognition.

[62]  Sébastien Marcel,et al.  Spoofing in 2D face recognition with 3D masks and anti-spoofing with Kinect , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[63]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[64]  Paulo Lobato Correia,et al.  Ear recognition in a light field imaging framework: a new perspective , 2018, IET Biom..

[65]  William J. Christmas,et al.  Ieee Transactions on Information Forensics and Security 1 Face Spoofing Detection Based on Multiple Descriptor Fusion Using Multiscale Dynamic Binarized Statistical Image Features , 2022 .

[66]  Junjie Yan,et al.  Face liveness detection by exploring multiple scenic clues , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[67]  Weihong Deng,et al.  Learning temporal features using LSTM-CNN architecture for face anti-spoofing , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[68]  Lei Huang,et al.  Dual Camera Based Feature for Face Spoofing Detection , 2016, CCPR.

[69]  Kiran B. Raja,et al.  Multi-face Recognition at a Distance Using Light-Field Camera , 2013, 2013 Ninth International Conference on Intelligent Information Hiding and Multimedia Signal Processing.

[70]  G. Lippmann,et al.  Epreuves reversibles. Photographies integrals , 1908 .

[71]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[72]  Jukka Komulainen,et al.  Face Spoofing Detection Using Colour Texture Analysis , 2016, IEEE Transactions on Information Forensics and Security.

[73]  Matti Pietikäinen,et al.  Complementary countermeasures for detecting scenic face spoofing attacks , 2013, 2013 International Conference on Biometrics (ICB).

[74]  Matti Pietikäinen,et al.  Context based face anti-spoofing , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[75]  Sébastien Marcel,et al.  Motion-based counter-measures to photo attacks in face recognition , 2014, IET Biom..

[76]  Donald G. Dansereau,et al.  Plenoptic Signal Processing for Robust Vision in Field Robotics , 2013 .

[77]  A. Lakshmi,et al.  DEEP REPRESENTATIONS FOR IRIS , FACE , AND FINGERPRINT SPOOFING DETECTION , 2017 .

[78]  Fei Peng,et al.  Face presentation attack detection using guided scale texture , 2017, Multimedia Tools and Applications.

[79]  Sébastien Marcel,et al.  Face Recognition Systems Under Spoofing Attacks , 2016, Face Recognition Across the Imaging Spectrum.

[80]  Lin Sun,et al.  TIR/VIS Correlation for Liveness Detection in Face Recognition , 2011, CAIP.

[81]  M. Killioğlu,et al.  Anti-spoofing in face recognition with liveness detection using pupil tracking , 2017, 2017 IEEE 15th International Symposium on Applied Machine Intelligence and Informatics (SAMI).

[82]  Kiran B. Raja,et al.  Comparative evaluation of super-resolution techniques for multi-face recognition using light-field camera , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[83]  Jukka Komulainen,et al.  Software-based countermeasures to 2D facial spoofing attacks , 2015 .

[84]  Moncef Gabbouj,et al.  Analysis of textural features for face biometric anti-spoofing , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[85]  Abdenour Hadid,et al.  Face Biometrics Under Spoofing Attacks: Vulnerabilities, Countermeasures, Open Issues, and Research Directions , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[86]  Richa Singh,et al.  RGB-D Face Recognition With Texture and Attribute Features , 2014, IEEE Transactions on Information Forensics and Security.

[87]  Narayanan Vijaykrishnan,et al.  A Hardware Efficient Support Vector Machine Architecture for FPGA , 2008, 2008 16th International Symposium on Field-Programmable Custom Computing Machines.

[88]  Stan Z. Li,et al.  Face Anti-spoofing: Multi-spectral Approach , 2014, Handbook of Biometric Anti-Spoofing.

[89]  Matti Pietikäinen,et al.  Face spoofing detection from single images using texture and local shape analysis , 2012, IET Biom..

[90]  Jukka Komulainen,et al.  OULU-NPU: A Mobile Face Presentation Attack Database with Real-World Variations , 2017, 2017 12th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2017).

[91]  Paulo Lobato Correia,et al.  Face spoofing detection using a light field imaging framework , 2018, IET Biom..

[92]  Chander Kant,et al.  Fake Face Recognition using Fusion of Thermal Imaging and Skin Elasticity , 2013 .