A lite convolutional neural network built on permuted Xceptio-inception and Xceptio-reduction modules for texture based facial liveness recognition

Face recognition is one of the emerging areas in the field of biometric and computer vision that plays an important role in numerous time-bound applications such as ATM payment, criminal identification, E-Learning, healthcare, and online gaming. It can be compromised by various imposter attacks such as masks, print, or replay attacks. So, there is a requirement of a light-weight powerful classifier that could take significantly less time to minimize those effects by observing the liveness of a current person. In this paper, a lightweight permuted Xceptio-Inception/Reduction Convolutional Neural Network classifier has been proposed using depthwise convolution, permutation, reshape, and residual techniques for texture-based facial liveness recognition. It has been validated with moderately dense ImageNet benchmarked Convolutional Neural Network classifiers with respect to weight size, accuracy, precision, and recall. Here, we have considered some of the variants of most popular convolution neural networks such as AlexNet, Inception, ResNet, and VGGNet and applied these models for textured based facial liveness recognition. Before the training and testing of those classifiers, all the frontal face images from the FRAUD2, NUAA, and CASIA FASD imposter datasets had normalized, and the multi-colored space LBP feature maps extracted from these normalized image frames had supplied as inputs to the classifiers. The results show that the proposed convolutional neural network performs best among the above-standardized network models, whose total weights consumes less memory space, which leads to fast liveness face recognition. In the end, comparison with the previous work shows that it achieves almost the highest success rate and lowest Equal Error Rate as a non-intrusive classifier.

[1]  Yong Xu,et al.  Face liveness detection using color gradient features , 2017, 2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[2]  Carla P. Gomes,et al.  Understanding Batch Normalization , 2018, NeurIPS.

[3]  Yunde Jia,et al.  Face Spoofing Detection Using Relativity Representation on Riemannian Manifold , 2020, IEEE Transactions on Information Forensics and Security.

[4]  Hassen Drira,et al.  DeepColorFASD: Face Anti Spoofing Solution Using a Multi Channeled Color Spaces CNN , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[5]  Shijun Xiang,et al.  Face anti-spoofing detection based on DWT-LBP-DCT features , 2020, Signal Process. Image Commun..

[6]  Xiaogang Jin,et al.  Quadruplet Network With One-Shot Learning for Fast Visual Object Tracking , 2017, IEEE Transactions on Image Processing.

[7]  Zhuowen Tu,et al.  Aggregated Residual Transformations for Deep Neural Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Febryanti Sthevanie,et al.  Image Spoofing Detection Using Local Binary Pattern and Local Binary Pattern Variance , 2019 .

[9]  Junjie Yan,et al.  A face antispoofing database with diverse attacks , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[10]  Jianbing Shen,et al.  Local Semantic Siamese Networks for Fast Tracking , 2019, IEEE Transactions on Image Processing.

[11]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[12]  Saptarshi Chakraborty,et al.  An Overview of Face Liveness Detection , 2014, ArXiv.

[13]  Lai-Man Po,et al.  SLNet: Stereo face liveness detection via dynamic disparity-maps and convolutional neural network , 2020, Expert Syst. Appl..

[14]  Chengjun Liu,et al.  LBP and Color Descriptors for Image Classification , 2012, Cross Disciplinary Biometric Systems.

[15]  Mengyang Liu,et al.  Deep learning for face anti-spoofing: An end-to-end approach , 2017, 2017 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA).

[16]  Roberto Javier López-Sastre,et al.  Deep Anomaly Detection for Generalized Face Anti-Spoofing , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[17]  Yi Li,et al.  Face Liveness Detection from a Single Image with Sparse Low Rank Bilinear Discriminative Model , 2010, ECCV.

[18]  Ausif Mahmood,et al.  Deep face liveness detection based on nonlinear diffusion using convolution neural network , 2016, Signal, Image and Video Processing.

[19]  Shuo Wang,et al.  Overview of deep learning , 2016, 2016 31st Youth Academic Annual Conference of Chinese Association of Automation (YAC).

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Yaping Lin,et al.  Dynamic Texture Recognition Using Volume Local Binary Count Patterns With an Application to 2D Face Spoofing Detection , 2018, IEEE Transactions on Multimedia.

[22]  Wonjun Kim,et al.  Face liveness detection from a single image via diffusion speed model. , 2015, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[23]  Brian C. Lovell,et al.  Binary watermarks: a practical method to address face recognition replay attacks on consumer mobile devices , 2015, IEEE International Conference on Identity, Security and Behavior Analysis (ISBA 2015).

[24]  Jian Sun,et al.  Accelerating Very Deep Convolutional Networks for Classification and Detection , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Hanqiu Sun,et al.  Video Saliency Prediction Using Spatiotemporal Residual Attentive Networks , 2020, IEEE Transactions on Image Processing.

[26]  F. A. Pujol,et al.  Entropy-Based Face Recognition and Spoof Detection for Security Applications , 2019, Sustainability.

[27]  R Sanjeev Kunte,et al.  Extended Local Ternary Co-relation Pattern: A novel feature descriptor for face Anti-spoofing , 2020, J. Inf. Secur. Appl..

[28]  Vrizlynn L. L. Thing,et al.  Towards Building a Remote Anti-spoofing Face Authentication System , 2018, TENCON 2018 - 2018 IEEE Region 10 Conference.

[29]  G. C. Nandi,et al.  Face recognition with liveness detection using eye and mouth movement , 2014, 2014 International Conference on Signal Propagation and Computer Technology (ICSPCT 2014).

[30]  Jianbing Shen,et al.  Triplet Loss in Siamese Network for Object Tracking , 2018, ECCV.

[31]  Pranav Gokhale,et al.  Applications of Convolutional Neural Networks , 2016 .

[32]  Weihua Ou,et al.  Face liveness detection with recaptured feature extraction , 2017, 2017 International Conference on Security, Pattern Analysis, and Cybernetics (SPAC).

[33]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[34]  Fei Peng,et al.  Face spoofing detection based on color texture Markov feature and support vector machine recursive feature elimination , 2018, J. Vis. Commun. Image Represent..

[35]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  Abdenour Hadid,et al.  Face recognition under spoofing attacks: countermeasures and research directions , 2018, IET Biom..

[37]  Changsong Liu,et al.  Face Liveness Detection Based on Joint Analysis of RGB and Near-Infrared Image of Faces , 2018 .

[38]  Marsyita Hanafi,et al.  Face Liveness Detection Using Dynamic Local Ternary Pattern (DLTP) , 2016, Comput..

[39]  Vasif V. Nabiyev,et al.  EFFECT OF FEATURE SELECTION WITH META-HEURISTIC OPTIMIZATION METHODS ON FACE SPOOFING DETECTION , 2020 .

[40]  F Sthevanie,et al.  Spoofing detection on facial images recognition using LBP and GLCM combination , 2018 .

[41]  Josef Bigün,et al.  Non-intrusive liveness detection by face images , 2009, Image Vis. Comput..

[42]  Fei Peng,et al.  Content-Independent Face Presentation Attack Detection with Directional Local Binary Pattern , 2017, CCBR.

[43]  Ausif Mahmood,et al.  Optimizing Deep CNN Architectures for Face Liveness Detection , 2019, Entropy.

[44]  Guanghui Wang,et al.  Object Detection with Convolutional Neural Networks , 2019, Deep Learning in Computer Vision.

[45]  M. Parisa Beham,et al.  Anti-spoofing enabled face recognition based on aggregated local weighted gradient orientation , 2018, Signal Image Video Process..

[46]  Erkam Uzun,et al.  rtCaptcha: A Real-Time CAPTCHA Based Liveness Detection System , 2018, NDSS.

[47]  Mingtao Pei,et al.  Face Liveness Detection Based on Client Identity Using Siamese Network , 2019, PRCV.

[48]  M. Kavitha,et al.  Face Spoofing Detection using Binary Gradient Orientation Pattern with Deep Neural Network , 2017, 2017 Ninth International Conference on Advances in Pattern Recognition (ICAPR).

[49]  Farzin Deravi,et al.  Spatio-Temporal Texture Features for Presentation Attack Detection in Biometric Systems , 2019, 2019 Eighth International Conference on Emerging Security Technologies (EST).

[50]  Saptarshi Chakraborty,et al.  Face liveness detection based on frequency and micro-texture analysis , 2014, 2014 International Conference on Advances in Engineering & Technology Research (ICAETR - 2014).

[51]  Jukka Komulainen,et al.  Face anti-spoofing based on color texture analysis , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[52]  Shih-Hung Yang,et al.  Face Liveness Detection Based on Skin Blood Flow Analysis , 2017, Symmetry.

[53]  Ling Shao,et al.  Video Salient Object Detection via Fully Convolutional Networks , 2017, IEEE Transactions on Image Processing.

[54]  Wai Sze Leung,et al.  Face spoof detection using light reflection in moderate to low lighting , 2017, 2017 2nd Asia-Pacific Conference on Intelligent Robot Systems (ACIRS).

[55]  Haibin Ling,et al.  A Deep Network Solution for Attention and Aesthetics Aware Photo Cropping , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Jongwoo Seo,et al.  Face Liveness Detection Using Thermal Face-CNN with External Knowledge , 2019, Symmetry.

[57]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[58]  Shanmukhappa A. Angadi,et al.  Detection of Face Spoofing using Multiple Texture Descriptors , 2018, 2018 International Conference on Computational Techniques, Electronics and Mechanical Systems (CTEMS).

[59]  Ümit Budak,et al.  Deep Feature Extraction for Face Liveness Detection , 2018, 2018 International Conference on Artificial Intelligence and Data Processing (IDAP).

[60]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[61]  Wonjun Kim,et al.  Face Liveness Detection From a Single Image via Diffusion Speed Model , 2015, IEEE Transactions on Image Processing.

[62]  Meng Pan,et al.  A Review of Face Anti-spoofing and Its Applications in China , 2019 .

[63]  Marsyita Hanafi,et al.  Face Anti-Spoofing Methods , 2015 .

[64]  Koichi Ito,et al.  Recent advances in biometrie security: A case study of liveness detection in face recognition , 2017, 2017 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC).

[65]  William J. Christmas,et al.  An anomaly detection approach to face spoofing detection: A new formulation and evaluation protocol , 2017, 2017 IEEE International Joint Conference on Biometrics (IJCB).

[66]  Mourad Oussalah,et al.  Face antispoofing based on frame difference and multilevel representation , 2017, J. Electronic Imaging.

[67]  Tao Yang,et al.  Evaluating facial recognition web services with adversarial and synthetic samples , 2020, Neurocomputing.

[68]  Kenji Murakami,et al.  Eye and Nose Fields Detection from Gray Scale Facial Images , 2011, MVA.

[69]  Misha Denil,et al.  Noisy Activation Functions , 2016, ICML.

[70]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[71]  Dustin Terence van der Haar Real-Time Face Antispoofing Using Shearlets , 2018, ISSA.

[72]  Yu Song,et al.  Face Spoofing Detection Based on Local Ternary Label Supervision in Fully Convolutional Networks , 2020, IEEE Transactions on Information Forensics and Security.

[73]  S Vasuhi,et al.  Liveliness Detection in Real Time Videos using Color based Chromatic Moment Feature , 2018 .

[74]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[75]  Paolo Napoletano,et al.  Benchmark Analysis of Representative Deep Neural Network Architectures , 2018, IEEE Access.