Reliable face anti-spoofing using multispectral SWIR imaging

Recent studies point out that spoofing attacks using facial masks still are a severe problem for current biometric face recognition (FR) systems. As such systems are becoming more frequently used, for example, for automated border crossing or access control to critical infrastructure, advanced anti-spoofing techniques are necessary to counter these attacks. This work presents a novel, cross-modal approach that enhances existing solutions for face verification and uses multispectral short wave infrared (SWIR) imaging to ensure the authenticity of a face even in the presence of partial disguises and masks. It is evaluated on a dataset containing 137 subjects and a variety of spoofing attacks. Using a commercial FR system, it successfully rejects all attempts to counterfeit a foreign face with a false acceptance rate FARcf = 0% and most attempts to disguise the own identity with FARdg = 1% at a false rejection rate of FRR <; 5% using SWIR images for verification.

[1]  Arun Ross,et al.  Cross-Spectral Face Verification in the Short Wave Infrared (SWIR) Band , 2010, 2010 20th International Conference on Pattern Recognition.

[2]  Anil K. Jain,et al.  Live face video vs. spoof face video: Use of moiré patterns to detect replay video attacks , 2015, 2015 International Conference on Biometrics (ICB).

[3]  Sébastien Marcel,et al.  Spoofing Face Recognition With 3D Masks , 2014, IEEE Transactions on Information Forensics and Security.

[4]  Jean-Luc Dugelay,et al.  On the vulnerability of face recognition systems to spoofing mask attacks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Anil K. Jain,et al.  Handbook of Face Recognition, 2nd Edition , 2011 .

[6]  K. Harshika Image Quality Assessment for Fake Biometric Detection : Application to Iris , Fingerprint , and Face Recognition , 2017 .

[7]  Madhu Sudan,et al.  A Fuzzy Vault Scheme , 2006, Des. Codes Cryptogr..

[8]  J. A. Jacquez,et al.  Spectral reflectance of human skin in the region 235-700 mu. , 1955, Journal of applied physiology.

[9]  Sébastien Marcel,et al.  Counter-measures to photo attacks in face recognition: A public database and a baseline , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[10]  Ioan Buciu,et al.  Oscillating patterns based face antispoofing approach against video replay , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[11]  Jian-Huang Lai,et al.  WLD-TOP Based Algorithm against Face Spoofing Attacks , 2015, CCBR.

[12]  I. Pavlidis,et al.  The imaging issue in an automatic face/disguise detection system , 2000, Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (Cat. No.PR00640).

[13]  Robert K. Rowe,et al.  Spoof Detection Schemes , 2008 .

[14]  Javier Galbally,et al.  Three-dimensional and two-and-a-half-dimensional face recognition spoofing using three-dimensional printed models , 2016, IET Biom..

[15]  Richa Singh,et al.  Disguise detection and face recognition in visible and thermal spectrums , 2013, 2013 International Conference on Biometrics (ICB).

[16]  Václav Hlavác,et al.  Real-time multi-view facial landmark detector learned by the structured output SVM , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[17]  Shengcai Liao,et al.  Face liveness detection using 3D structure recovered from a single camera , 2013, 2013 International Conference on Biometrics (ICB).

[18]  Stan Z. Li,et al.  Handbook of Biometric Anti-Spoofing , 2014, Advances in Computer Vision and Pattern Recognition.

[19]  Junjie Yan,et al.  Face liveness detection by exploring multiple scenic clues , 2012, 2012 12th International Conference on Control Automation Robotics & Vision (ICARCV).

[20]  Matti Pietikäinen,et al.  Complementary countermeasures for detecting scenic face spoofing attacks , 2013, 2013 International Conference on Biometrics (ICB).

[21]  Lingyu Wang,et al.  Near- and Far- Infrared Imaging for Vein Pattern Biometrics , 2006, 2006 IEEE International Conference on Video and Signal Based Surveillance.

[22]  Andreas Kolb,et al.  Design of an Active Multispectral SWIR Camera System for Skin Detection and Face Verification , 2016, J. Sensors.

[23]  Matti Pietikäinen,et al.  Face spoofing detection from single images using micro-texture analysis , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[24]  Xiaoli Hao,et al.  A New Multispectral Method for Face Liveness Detection , 2013, 2013 2nd IAPR Asian Conference on Pattern Recognition.

[25]  Anil K. Jain,et al.  Face Spoof Detection With Image Distortion Analysis , 2015, IEEE Transactions on Information Forensics and Security.

[26]  Anil K. Jain,et al.  Heterogeneous Face Recognition: Matching NIR to Visible Light Images , 2010, 2010 20th International Conference on Pattern Recognition.

[27]  Stan Z. Li,et al.  Face liveness detection by learning multispectral reflectance distributions , 2011, Face and Gesture 2011.

[28]  Josef Bigün,et al.  Non-intrusive liveness detection by face images , 2009, Image Vis. Comput..

[29]  Jean-Luc Dugelay,et al.  Countermeasure for the protection of face recognition systems against mask attacks , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).