Face anti-spoofing countermeasure: Efficient 2D materials classification using polarization imaging

Spoofing is an act to impersonate a valid user of any biometric systems in order to gain access. In a face biometric system, an imposter might use some fake masks that mimic the real user face. Existing countermeasures against spoofing adopt face texture analysis, motion detection and surface reflection analysis. For the purpose of face anti-spoofing analysis, skin structure is a key factor in achieving the target of our study. Skin consists of multiple layers structure which produces multiple reflections: surface and subsurface reflections. In this paper, we proposed a measure to discriminate between a genuine face and a printed paper photo based on physical properties of the materials which contribute to its distinctive reflection values. In order to differentiate the reflections, polarized light (light that vibrates in a single direction) can be used. The Stokes parameters are applied to generate the Stokes images which are then used to produce the final image known as Stokes degree of linear polarization (SDOLP) image. The intensity of the SDOLP image is investigated statistically which has shown promising results in the materials classification, between the skin and the paper mask. Furthermore, comparison between the experimental results from two skin color groups, black and others show that the SDOLP data distribution of black skin is similar to the printed paper photo of the same skin group.

[1]  Lawrence B. Wolff,et al.  Using polarization to separate reflection components , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Stan Z. Li,et al.  Face liveness detection by learning multispectral reflectance distributions , 2011, Face and Gesture 2011.

[3]  Jianhua Xuan,et al.  Polarization imaging for breast cancer diagnosis using texture analysis and SVM , 2007, 2007 IEEE/NIH Life Science Systems and Applications Workshop.

[4]  Seongbeak Yoon,et al.  Masked fake face detection using radiance measurements. , 2009, Journal of the Optical Society of America. A, Optics, image science, and vision.

[5]  P. Wilhelm Bioengineering of the skin , 2014 .

[6]  David San Segundo Bello,et al.  Integrated Polarization Analyzing CMOS Image Sensor for Material Classification , 2011, IEEE Sensors Journal.

[7]  Aroma Mahendru,et al.  Bio-inspired object classification using polarization imaging , 2012, 2012 Sixth International Conference on Sensing Technology (ICST).

[8]  Jean-Luc Dugelay,et al.  On the vulnerability of face recognition systems to spoofing mask attacks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Terrance E. Boult,et al.  Polarization/radiometric based material classification , 1989, Proceedings CVPR '89: IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[10]  Jean-Luc Dugelay,et al.  Reflectance analysis based countermeasure technique to detect face mask attacks , 2013, 2013 18th International Conference on Digital Signal Processing (DSP).

[11]  Ling Li,et al.  A multi-layered reflection model of natural human skin , 2001, Proceedings. Computer Graphics International 2001.

[12]  Terrance E. Boult,et al.  Constraining Object Features Using a Polarization Reflectance Model , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[13]  Matti Pietikäinen,et al.  Face spoofing detection from single images using micro-texture analysis , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[14]  Sébastien Marcel,et al.  Spoofing in 2D face recognition with 3D masks and anti-spoofing with Kinect , 2013, 2013 IEEE Sixth International Conference on Biometrics: Theory, Applications and Systems (BTAS).

[15]  Jean-Luc Dugelay,et al.  Countermeasure for the protection of face recognition systems against mask attacks , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[16]  Sébastien Marcel,et al.  Spoofing Face Recognition With 3D Masks , 2014, IEEE Transactions on Information Forensics and Security.

[17]  Zhaohui Wu,et al.  Liveness Detection for Face Recognition , 2008 .

[18]  Terrance E. Boult,et al.  PARAPH: Presentation Attack Rejection by Analyzing Polarization Hypotheses , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).