Face Anti-Spoofing Based on Dynamic Color Texture Analysis Using Local Directional Number Pattern

Face anti-spoofing is becoming increasingly indispensable for face recognition systems, which are vulnerable to various spoofing attacks performed using fake photos and videos. In this paper, a novel “LDN-TOP representation followed by ProCRC classification” pipeline for face anti-spoofing is proposed. We use local directional number pattern (LDN) with the derivative-Gaussian mask to capture detailed appearance information resisting illumination variations and noises, which can influence the texture pattern distribution. To further capture motion information, we extend LDN to a spatial-temporal variant named local directional number pattern from three orthogonal planes (LDN- TOP). The multi-scale LDN- TOP capturing complete information is extracted from color images to generate the feature vector with powerful representation capacity. Finally, the feature vector is fed into the probabilistic collaborative representation based classifier (ProCRC) for face anti-spoofing. Our method is evaluated on three challenging public datasets, namely CASIA FASD, Replay-Attack database, and UVAD database using sequence-based evaluation protocol. The experimental results show that our method can achieve promising performance with 0.37% EER on CASIA and 5.73% HTER on UVAD. The performance on Replay-Attack database is also competitive.

[1]  Xiaoming Liu,et al.  Face De-Spoofing: Anti-Spoofing via Noise Modeling , 2018, ECCV.

[2]  Matti Pietikäinen,et al.  Face spoofing detection from single images using micro-texture analysis , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[3]  Anil K. Jain,et al.  Face Spoof Detection With Image Distortion Analysis , 2015, IEEE Transactions on Information Forensics and Security.

[4]  Anderson Rocha,et al.  Using Visual Rhythms for Detecting Video-Based Facial Spoof Attacks , 2015, IEEE Transactions on Information Forensics and Security.

[5]  Jukka Komulainen,et al.  Face Spoofing Detection Using Colour Texture Analysis , 2016, IEEE Transactions on Information Forensics and Security.

[6]  Chun-Hsiao Yeh,et al.  Face Liveness Detection Based on Perceptual Image Quality Assessment Features with Multi-scale Analysis , 2018, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[7]  Xiaoou Tang,et al.  Surpassing Human-Level Face Verification Performance on LFW with GaussianFace , 2014, AAAI.

[8]  Oksam Chae,et al.  Local Directional Number Pattern for Face Analysis: Face and Expression Recognition , 2013, IEEE Transactions on Image Processing.

[9]  Junjie Yan,et al.  A face antispoofing database with diverse attacks , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[10]  Xiangyu Zhu,et al.  Improving Face Anti-Spoofing by 3D Virtual Synthesis , 2019, 2019 International Conference on Biometrics (ICB).

[11]  Yu Qiao,et al.  Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks , 2016, IEEE Signal Processing Letters.

[12]  Samarth Bharadwaj,et al.  Face anti-spoofing with multifeature videolet aggregation , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[13]  Lei Zhang,et al.  A Probabilistic Collaborative Representation Based Approach for Pattern Classification , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Yaowu Chen,et al.  Attention-Based Two-Stream Convolutional Networks for Face Spoofing Detection , 2020, IEEE Transactions on Information Forensics and Security.

[15]  Xiaoyue Jiang,et al.  Face spoofing detection with local binary pattern network , 2018, J. Vis. Commun. Image Represent..

[16]  Anderson Rocha,et al.  Face Spoofing Detection Through Visual Codebooks of Spectral Temporal Cubes , 2015, IEEE Transactions on Image Processing.

[17]  Jukka Komulainen,et al.  Scale space texture analysis for face anti-spoofing , 2016, 2016 International Conference on Biometrics (ICB).

[18]  Shiqi Wang,et al.  Learning Generalized Deep Feature Representation for Face Anti-Spoofing , 2018, IEEE Transactions on Information Forensics and Security.

[19]  Sébastien Marcel,et al.  On the effectiveness of local binary patterns in face anti-spoofing , 2012, 2012 BIOSIG - Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG).

[20]  Xiaoming Liu,et al.  Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[21]  Yaping Lin,et al.  Dynamic Texture Recognition Using Volume Local Binary Count Patterns With an Application to 2D Face Spoofing Detection , 2018, IEEE Transactions on Multimedia.

[22]  Xiaoming Liu,et al.  Face anti-spoofing using patch and depth-based CNNs , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[23]  Matti Pietikäinen,et al.  Face liveness detection using dynamic texture , 2014, EURASIP J. Image Video Process..

[24]  Shiguang Shan,et al.  Face Anti-Spoofing with Multi-Scale Information , 2018, 2018 24th International Conference on Pattern Recognition (ICPR).

[25]  Li Sun,et al.  Investigation in Spatial-Temporal Domain for Face Spoof Detection , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[26]  Fei Peng,et al.  Face presentation attack detection using guided scale texture , 2017, Multimedia Tools and Applications.

[27]  A. Hadid,et al.  Face anti-spoofing via deep local binary patterns , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[28]  Sébastien Marcel,et al.  Face Anti-spoofing Based on General Image Quality Assessment , 2014, 2014 22nd International Conference on Pattern Recognition.

[29]  Philip S. Yu,et al.  Transfer Feature Learning with Joint Distribution Adaptation , 2013, 2013 IEEE International Conference on Computer Vision.

[30]  Matti Pietikäinen,et al.  Dynamic Texture Recognition Using Local Binary Patterns with an Application to Facial Expressions , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Fei Peng,et al.  Face spoofing detection based on color texture Markov feature and support vector machine recursive feature elimination , 2018, J. Vis. Commun. Image Represent..

[32]  Alice Caplier,et al.  Motion-based countermeasure against photo and video spoofing attacks in face recognition , 2018, J. Vis. Commun. Image Represent..

[33]  Francesca Odone,et al.  Histogram intersection kernel for image classification , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[34]  Richa Singh,et al.  Detecting Silicone Mask-Based Presentation Attack via Deep Dictionary Learning , 2017, IEEE Transactions on Information Forensics and Security.

[35]  Jukka Komulainen,et al.  Face anti-spoofing based on color texture analysis , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[36]  Francesco G. B. De Natale,et al.  Using LDP-TOP in Video-Based Spoofing Detection , 2017, ICIAP.

[37]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[38]  Jian Zhao,et al.  Learning Generalizable and Identity-Discriminative Representations for Face Anti-Spoofing , 2019, ACM Trans. Intell. Syst. Technol..

[39]  William J. Christmas,et al.  Ieee Transactions on Information Forensics and Security 1 Face Spoofing Detection Based on Multiple Descriptor Fusion Using Multiscale Dynamic Binarized Statistical Image Features , 2022 .