SLNet: Stereo face liveness detection via dynamic disparity-maps and convolutional neural network

Abstract Current state-of-the-art dual camera-based face liveness detection methods utilize either hand-crafted features, such as disparity, or deep texture features to classify a live face and face Presentation Attack (PA). However, these approaches limit the effectiveness of classifiers, particularly deep Convolutional Neural Networks (CNN) to unknown face PA in adverse scenarios. In contrast to these approaches, in this paper, we show that supervising a deep CNN classifier by learning disparity features using the existing CNN layers improves the performance and robustness of CNN to unknown types of face PA. For this purpose, we propose to supervise a CNN classifier by introducing a disparity layer within CNN to learn the dynamic disparity-maps. Subsequently, the rest of the convolutional layers, following the disparity layer, in the CNN are supervised using the learned dynamic disparity-maps for face liveness detection. We further propose a new video-based stereo face anti-spoofing database with various face PA and different imaging qualities. Experiments on the proposed stereo face anti-spoofing database are performed using various test case scenarios. The experimental results indicate that our proposed system shows promising performance and has good generalization ability.

[1]  Anil K. Jain,et al.  Face Spoof Detection With Image Distortion Analysis , 2015, IEEE Transactions on Information Forensics and Security.

[2]  Anderson Rocha,et al.  Face Spoofing Detection Through Visual Codebooks of Spectral Temporal Cubes , 2015, IEEE Transactions on Image Processing.

[3]  Abdenour Hadid,et al.  An original face anti-spoofing approach using partial convolutional neural network , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[4]  Abdenour Hadid,et al.  Face recognition under spoofing attacks: countermeasures and research directions , 2018, IET Biom..

[5]  Kongqiao Wang,et al.  Robust face anti-spoofing with depth information , 2017, J. Vis. Commun. Image Represent..

[6]  João Paulo Papa,et al.  Deep Texture Features for Robust Face Spoofing Detection , 2017, IEEE Transactions on Circuits and Systems II: Express Briefs.

[7]  Jang-Hee Yoo,et al.  A motion and similarity-based fake detection method for biometric face recognition systems , 2011, IEEE Transactions on Consumer Electronics.

[8]  Mengyang Liu,et al.  LiveNet: Improving features generalization for face liveness detection using convolution neural networks , 2018, Expert Syst. Appl..

[9]  Yi Li,et al.  Face Liveness Detection from a Single Image with Sparse Low Rank Bilinear Discriminative Model , 2010, ECCV.

[10]  Tien Dat Nguyen,et al.  Combining Deep and Handcrafted Image Features for Presentation Attack Detection in Face Recognition Systems Using Visible-Light Camera Sensors , 2018, Sensors.

[11]  Weihong Deng,et al.  Learning temporal features using LSTM-CNN architecture for face anti-spoofing , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[12]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[14]  Xiaoming Liu,et al.  Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[15]  Lai-Man Po,et al.  Face liveness detection using convolutional-features fusion of real and deep network generated face images , 2019, J. Vis. Commun. Image Represent..

[16]  Luisa Verdoliva,et al.  An Investigation of Local Descriptors for Biometric Spoofing Detection , 2015, IEEE Transactions on Information Forensics and Security.

[17]  Junjie Yan,et al.  A face antispoofing database with diverse attacks , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[18]  Fei Peng,et al.  A competition on generalized software-based face presentation attack detection in mobile scenarios , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[19]  Sébastien Marcel,et al.  Spoofing in 2D face recognition with 3D masks and anti-spoofing with Kinect , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[20]  Matti Pietikäinen,et al.  Face spoofing detection from single images using micro-texture analysis , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[21]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[22]  Sébastien Marcel,et al.  Biometric Antispoofing Methods: A Survey in Face Recognition , 2014, IEEE Access.

[23]  Josef Bigün,et al.  Real-Time Face Detection and Motion Analysis With Application in “Liveness” Assessment , 2007, IEEE Transactions on Information Forensics and Security.

[24]  Lai-Man Po,et al.  Perturbing Convolutional Feature Maps with Histogram of Oriented Gradients for Face Liveness Detection , 2019, CISIS-ICEUTE.

[25]  Shengcai Liao,et al.  Face liveness detection using 3D structure recovered from a single camera , 2013, 2013 International Conference on Biometrics (ICB).

[26]  Jongwoo Seo,et al.  Face Liveness Detection Using Thermal Face-CNN with External Knowledge , 2019, Symmetry.

[27]  Stan Z. Li,et al.  Person-Specific Face Antispoofing With Subject Domain Adaptation , 2015, IEEE Transactions on Information Forensics and Security.

[28]  Jang-Hee Yoo,et al.  A motion and similarity-based fake detection method for biometric face recognition systems , 2011, 2011 IEEE International Conference on Consumer Electronics (ICCE).

[29]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[30]  Venu Govindaraju,et al.  A discriminative spatio-temporal mapping of face for liveness detection , 2017, 2017 IEEE International Conference on Identity, Security and Behavior Analysis (ISBA).

[31]  Sébastien Marcel,et al.  On the effectiveness of local binary patterns in face anti-spoofing , 2012, 2012 BIOSIG - Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG).

[32]  Xiaoming Liu,et al.  Face anti-spoofing using patch and depth-based CNNs , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[33]  Matti Pietikäinen,et al.  Face liveness detection using dynamic texture , 2014, EURASIP J. Image Video Process..

[34]  Xu Zhao,et al.  Discriminative Representation Combinations for Accurate Face Spoofing Detection , 2018, Pattern Recognit..

[35]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Sébastien Marcel,et al.  Image Quality Assessment for Fake Biometric Detection: Application to Iris, Fingerprint, and Face Recognition , 2014, IEEE Transactions on Image Processing.

[37]  Carlo Luschi,et al.  Revisiting Small Batch Training for Deep Neural Networks , 2018, ArXiv.

[38]  Changsong Liu,et al.  Face Liveness Detection Based on Joint Analysis of RGB and Near-Infrared Image of Faces , 2018 .

[39]  Matti Pietikäinen,et al.  Face spoofing detection from single images using texture and local shape analysis , 2012, IET Biom..

[40]  Xiaoming Liu,et al.  Face De-Spoofing: Anti-Spoofing via Noise Modeling , 2018, ECCV.

[41]  Lei Huang,et al.  Dual Camera Based Feature for Face Spoofing Detection , 2016, CCPR.

[42]  David Menotti,et al.  Deep Representations for Iris, Face, and Fingerprint Spoofing Detection , 2014, IEEE Transactions on Information Forensics and Security.

[43]  Jukka Komulainen,et al.  Face Spoofing Detection Using Colour Texture Analysis , 2016, IEEE Transactions on Information Forensics and Security.

[44]  Lei Huang,et al.  Multimodal Face Spoofing Detection via RGB-D Images , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[45]  Sébastien Marcel,et al.  Motion-based counter-measures to photo attacks in face recognition , 2014, IET Biom..