Face Spoofing Detection for Smartphones using a 3D Reconstruction and the Motion Sensors

Face recognition system is proven to be vulnerable to face spoofing attack. Many approaches have been proposed in the literature to resolve this vulnerability. This paper proposes a novel method dedicated to mobile systems. The approach asks users to capture a video by moving the device around their face. Thanks to a 3D reconstruction process, the shape of the object is estimated from the video. By evaluating this 3D shape, we can rapidly eliminate attacks in which a photo of a legitimate face is used. Then, the camera’s poses estimated from the 3D reconstruction is used to be compared to the data captured from the device’s motion sensors. Experimental results on a real database show the efficiency of the proposed approach.

[1]  Kang Ryoung Park,et al.  Face liveness detection based on texture and frequency analyses , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[2]  Changchang Wu,et al.  Towards Linear-Time Incremental Structure from Motion , 2013, 2013 International Conference on 3D Vision.

[3]  Sangyoun Lee,et al.  Face liveness detection using variable focusing , 2013, 2013 International Conference on Biometrics (ICB).

[4]  V. Bhagavatula Real-Time Face Detection and Motion Analysis With Application in "Liveness" Assessment , 2007 .

[5]  Jang-Hee Yoo,et al.  Liveness Detection for Embedded Face Recognition System , 2008 .

[6]  Hong Li,et al.  A liveness detection method for face recognition based on optical flow field , 2009, 2009 International Conference on Image Analysis and Signal Processing.

[7]  Matti Pietikäinen,et al.  Face spoofing detection from single images using micro-texture analysis , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[8]  Siong Hoe Lau,et al.  Face Spoofing Detection Based on Improved Local Graph Structure , 2014, 2014 International Conference on Information Science & Applications (ICISA).

[9]  Siong Hoe Lau,et al.  Face Spoofing Detection Using Local Graph Structure , 2014, INFOCOM 2014.

[10]  Marc Pollefeys,et al.  Face Reconstruction on Mobile Devices Using a Height Map Shape Model and Fast Regularization , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[11]  Kalaiarasi Sonai Muthu,et al.  Face recognition with Symmetric Local Graph Structure (SLGS) , 2014, Expert Syst. Appl..

[12]  Lin Sun,et al.  Blinking-Based Live Face Detection Using Conditional Random Fields , 2007, ICB.

[13]  Hoai Phuong Nguyen,et al.  Face spoofing attack detection based on the behavior of noises , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).