Gaze stability for liveness detection

Spoofing attacks on biometric systems are one of the major impediments to their use for secure unattended applications. This paper explores features for face liveness detection based on tracking the gaze of the user. In the proposed approach, a visual stimulus is placed on the display screen, at apparently random locations, which the user is required to follow while their gaze is measured. This visual stimulus appears in such a way that it repeatedly directs the gaze of the user to specific positions on the screen. Features extracted from sets of collinear and colocated points are used to estimate the liveness of the user. Data are collected from genuine users tracking the stimulus with natural head/eye movements and impostors holding a photograph, looking through a 2D mask or replaying the video of a genuine user. The choice of stimulus and features are based on the assumption that natural head/eye coordination for directing gaze results in a greater accuracy and thus can be used to effectively differentiate between genuine and spoofing attempts. Tests are performed to assess the effectiveness of the system with these features in isolation as well as in combination with each other using score fusion techniques. The results from the experiments indicate the effectiveness of the proposed gaze-based features in detecting such presentation attacks.

[1]  F. C. Volkmann.  Human visual suppression , 1986, Vision Research.

[2]  Arun Ross,et al.  Information fusion in biometrics , 2003, Pattern Recognit. Lett..

[3]  Arun Ross,et al.  Score normalization in multimodal biometric systems , 2005, Pattern Recognit..

[4]  Trevor J. Bihl,et al.  QUEST hierarchy for hyperspectral face recognition , 2011, Defense + Commercial Sensing.

[5]  Tom Fawcett,et al.  ROC Graphs: Notes and Practical Considerations for Researchers , 2007 .

[6]  Farzin Deravi,et al.  Spoofing attempt detection using gaze colocation , 2013, 2013 International Conference of the BIOSIG Special Interest Group (BIOSIG).

[7]  Abel S. Nunez.  A Physical Model of Human Skin and its Application for Search and Rescue , 2012 .

[8]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[9]  M. Land.  Eye movements and the control of actions in everyday life , 2006, Progress in Retinal and Eye Research.

[10]  G. C. Nandi,et al.  Face recognition with liveness detection using eye and mouth movement , 2014, 2014 International Conference on Signal Propagation and Computer Technology (ICSPCT 2014).

[11]  V. Bhagavatula.  Real-Time Face Detection and Motion Analysis With Application in "Liveness" Assessment , 2007 .

[12]  丁晓青,et al.  Face Live Detection Method Based on Physiological Motion Analysis , 2009 .

[13]  Matti Pietikäinen,et al.  Complementary countermeasures for detecting scenic face spoofing attacks , 2013, 2013 International Conference on Biometrics (ICB).

[14]  Chander Kant,et al.  Fake Face Detection Based on Skin Elasticity , 2013 .

[15]  Alexander Werner,et al.  Avoiding replay-attacks in a face recognition system using head-pose estimation , 2003, 2003 IEEE International SOI Conference. Proceedings (Cat. No.03CH37443).

[16]  Anderson Rocha,et al.  Face liveness detection under bad illumination conditions , 2011, 2011 18th IEEE International Conference on Image Processing.

[17]  Jukka Komulainen,et al.  Face Spoofing Detection Using Dynamic Texture , 2012, ACCV Workshops.

[18]  Farzin Deravi,et al.  Liveness Detection Using Gaze Collinearity , 2012, 2012 Third International Conference on Emerging Security Technologies.

[19]  M. Hayhoe,et al.  The coordination of eye, head, and hand movements in a natural task , 2001, Experimental Brain Research.

[20]  Jukka Komulainen,et al.  The 2nd competition on counter measures to 2D face spoofing attacks , 2013, 2013 International Conference on Biometrics (ICB).

[21]  Fabio Roli,et al.  Fusion of multiple clues for photo-attack detection in face recognition systems , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[22]  Tieniu Tan,et al.  Live face detection based on the analysis of Fourier spectra , 2004, SPIE Defense + Commercial Sensing.

[23]  Josef Bigün,et al.  Non-intrusive liveness detection by face images , 2009, Image Vis. Comput..

[24]  Jang-Hee Yoo,et al.  Liveness Detection for Embedded Face Recognition System , 2008 .

[25]  Sébastien Marcel,et al.  On the effectiveness of local binary patterns in face anti-spoofing , 2012, 2012 BIOSIG - Proceedings of the International Conference of Biometrics Special Interest Group (BIOSIG).

[26]  Fred Nicolls,et al.  Locating Facial Features with an Extended Active Shape Model , 2008, ECCV.

[27]  Kang Ryoung Park,et al.  Face liveness detection based on texture and frequency analyses , 2012, 2012 5th IAPR International Conference on Biometrics (ICB).

[28]  Josef Bigün,et al.  Verifying liveness by multiple experts in face biometrics , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[29]  Anderson Rocha,et al.  Video-Based Face Spoofing Detection through Visual Rhythm Analysis , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images.

[30]  Josef Bigün,et al.  Evaluating liveness by face images and the structure tensor , 2005, Fourth IEEE Workshop on Automatic Identification Advanced Technologies (AutoID'05).

[31]  Lin Sun,et al.  Eyeblink-based Anti-Spoofing in Face Recognition from a Generic Webcamera , 2007, 2007 IEEE 11th International Conference on Computer Vision.