Multifeature Fusion Detection Method for Fake Face Attack in Identity Authentication

With the rise in biometric-based identity authentication, facial recognition software has already stimulated interesting research. However, facial recognition has also been subjected to criticism due to security concerns. The main attack methods include photo, video, and three-dimensional model attacks. In this paper, we propose a multifeature fusion scheme that combines dynamic and static joint analysis to detect fake face attacks. Since the texture differences between the real and the fake faces can be easily detected, LBP (local binary patter) texture operators and optical flow algorithms are often merged. Basic LBP methods are also modified by considering the nearest neighbour binary computing method instead of the fixed centre pixel method; the traditional optical flow algorithm is also modified by applying the multifusion feature superposition method, which reduces the noise of the image. In the pyramid model, image processing is performed in each layer by using block calculations that form multiple block images. The features of the image are obtained via two fused algorithms (MOLF), which are then trained and tested separately by an SVM classifier. Experimental results show that this method can improve detection accuracy while also reducing computational complexity. In this paper, we use the CASIA, PRINT-ATTACK, and REPLAY-ATTACK database to compare the various LBP algorithms that incorporate optical flow and fusion algorithms.

[1]  Jukka Komulainen,et al.  Face Spoofing Detection Using Colour Texture Analysis , 2016, IEEE Transactions on Information Forensics and Security.

[2]  Matti Pietikäinen,et al.  Complementary countermeasures for detecting scenic face spoofing attacks , 2013, 2013 International Conference on Biometrics (ICB).

[3]  Sébastien Marcel,et al.  Motion-based counter-measures to photo attacks in face recognition , 2014, IET Biom..

[4]  Brian C. Lovell,et al.  Face Recognition on Consumer Devices: Reflections on Replay Attacks , 2015, IEEE Transactions on Information Forensics and Security.

[5]  Sébastien Marcel,et al.  Biometric Antispoofing Methods: A Survey in Face Recognition , 2014, IEEE Access.

[6]  Liming Chen,et al.  Shape Analysis Based Anti-spoofing 3D Face Recognition with Mask Attacks , 2016, RFMI.

[7]  Ricardo L. de Queiroz,et al.  Face-Spoofing 2D-Detection Based on Moiré-Pattern Analysis , 2015, IEEE Transactions on Information Forensics and Security.

[8]  Matti Pietikäinen,et al.  Face spoofing detection from single images using micro-texture analysis , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[9]  Rhio Sutoyo,et al.  Unlock Screen Application Design Using Face Expression on Android Smartphone , 2016 .

[10]  Kiran B. Raja,et al.  Presentation Attack Detection for Face Recognition Using Light Field Camera , 2015, IEEE Transactions on Image Processing.

[11]  Stan Z. Li,et al.  Learn Convolutional Neural Network for Face Anti-Spoofing , 2014, ArXiv.

[12]  Michele Nappi,et al.  Moving face spoofing detection via 3D projective invariants , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[13]  Junjie Yan,et al.  A face antispoofing database with diverse attacks , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[14]  Sébastien Marcel,et al.  Face Anti-spoofing Based on General Image Quality Assessment , 2014, 2014 22nd International Conference on Pattern Recognition.

[15]  Petr Motlícek,et al.  Real-Time Audio-Visual Analysis for Multiperson Videoconferencing , 2013, Adv. Multim..

[16]  Yaping Lin,et al.  Dynamic Texture Recognition Using Volume Local Binary Count Patterns With an Application to 2D Face Spoofing Detection , 2018, IEEE Transactions on Multimedia.

[17]  Christian Riess,et al.  Illumination Analysis in Physics-Based Image Forensics: A Joint Discussion of Illumination Direction and Color , 2017, TIWDC.

[18]  Razali Yaakob,et al.  Low Cost Skin Segmentation Scheme in Videos Using Two Alternative Methods for Dynamic Hand Gesture Detection Method , 2017, Adv. Multim..

[19]  Josef Bigün,et al.  Real-Time Face Detection and Motion Analysis With Application in “Liveness” Assessment , 2007, IEEE Transactions on Information Forensics and Security.

[20]  Wonjun Kim,et al.  Face liveness detection from a single image via diffusion speed model. , 2015, IEEE transactions on image processing : a publication of the IEEE Signal Processing Society.

[21]  Hui Li,et al.  Multitarget Tracking of Pedestrians in Video Sequences Based on Particle Filters , 2012, Adv. Multim..

[22]  William J. Christmas,et al.  Ieee Transactions on Information Forensics and Security 1 Face Spoofing Detection Based on Multiple Descriptor Fusion Using Multiscale Dynamic Binarized Statistical Image Features , 2022 .