An Auxiliary Method Based on Hyperspectral Reflectance for Presentation Attack Detection

Face recognition has reached a high accuracy in recent years by adopting convolutional neural networks. However, it suffers from presentation attacks such as 2D face photos, and 3D masks. The vulnerability of face recognition and presentation attacks detection (PAD) attract numerous researchers in recent years. Most studies have only focused on PAD algorithms by analyzing texture information, depth information or thermal images. On the other hand, hyperspectral reflectance, which benefits from the development of line-scan HSI sensors, makes it possible to detect information about the inner structure of materials. Our research proposes an auxiliary method to support face recognition by analyzing hyperspectral reflectance. Combined with biological facts of human skin, we trained a neural network with pigmentation fractions inside human skin and corresponding reflectance. The results show high accuracy in identifying skin and non-skin.

[1]  Petru Radu,et al.  Robust multimodal face and fingerprint fusion in the presence of spoofing attacks , 2016, Pattern Recognit..

[2]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[3]  Stan Z. Li,et al.  Face liveness detection by learning multispectral reflectance distributions , 2011, Face and Gesture 2011.

[4]  Anil K. Jain,et al.  Face Spoof Detection With Image Distortion Analysis , 2015, IEEE Transactions on Information Forensics and Security.

[5]  Tim Bashford,et al.  Effect of wavelength and beam width on penetration in light-tissue interaction using computational methods , 2017, Lasers in Medical Science.

[6]  Gladimir V. G. Baranoski,et al.  Light & Skin Interactions: Simulations for Computer Graphics Applications , 2010 .

[7]  Tieniu Tan,et al.  A Light CNN for Deep Face Representation With Noisy Labels , 2015, IEEE Transactions on Information Forensics and Security.

[8]  Sébastien Marcel,et al.  Spoofing Deep Face Recognition with Custom Silicone Masks , 2018, 2018 IEEE 9th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[9]  Anderson Rocha,et al.  Using Visual Rhythms for Detecting Video-Based Facial Spoof Attacks , 2015, IEEE Transactions on Information Forensics and Security.

[10]  Sébastien Marcel,et al.  DeepFakes: a New Threat to Face Recognition? Assessment and Detection , 2018, ArXiv.

[11]  Sujata G. Bhele,et al.  A Review Paper on Face Recognition Techniques , 2012 .

[12]  Shree K. Nayar,et al.  Generalized Assorted Pixel Camera: Postcapture Control of Resolution, Dynamic Range, and Spectrum , 2010, IEEE Transactions on Image Processing.

[13]  Sébastien Marcel,et al.  Motion-based counter-measures to photo attacks in face recognition , 2014, IET Biom..

[14]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Jean-Luc Dugelay,et al.  Reflectance analysis based countermeasure technique to detect face mask attacks , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[16]  Faouzi Alaya Cheikh,et al.  On the vulnerability of extended Multispectral face recognition systems towards presentation attacks , 2017, 2017 IEEE International Conference on Identity, Security and Behavior Analysis (ISBA).

[17]  Naser Damer,et al.  2D face liveness detection: An overview , 2012, 2012 BIOSIG - Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG).

[18]  Kiran B. Raja,et al.  Custom silicone Face Masks: Vulnerability of Commercial Face Recognition Systems & Presentation Attack Detection , 2019, 2019 7th International Workshop on Biometrics and Forensics (IWBF).

[19]  Wei Chen,et al.  Reflectance spectra based skin and non-skin classification , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[20]  Ramachandra Raghavendra,et al.  Presentation Attack Detection Methods for Face Recognition Systems , 2017, ACM Comput. Surv..