Improving eye movement biometrics in low frame rate eye-tracking devices using periocular and eye blinking features

Abstract In this paper, the biometric potential of eye movement patterns extracted from low frame rate eye-tracking devices is evaluated. Also, possible improvement in recognition rates is investigated using other static and dynamic features extracted from the eyes including eye blinking patterns and periocular shape features. These modalities can be applicable for specific biometric applications like continuous driver authentication for law enforcement. For this purpose, two databases are collected with two low frame rate eye-tracking systems that capture the eye movements. Data were recorded from 55 participants while watching real driving sessions. For eye gaze, features from fixations and saccades are extracted separately including duration, amplitude, and statistical features. For eye blinking, features from the blinking pattern, its speed, acceleration, and power per unit mass profiles are extracted. Periocular features include the eye-opening height, width, axial ratio, etc. Each modality is evaluated first, then, these modalities are combined in a multi-modal setup for performance improvement. While each trait achieved a moderate performance in a single-modality setup, the fusion of the static and the dynamic features from the eye provides a great performance improvement up to 98.5% recognition rate and 0% error rate in both modes of authentication. Although the single-modality setup might not be secure enough, the fusion of these traits achieves high levels of identification making these traits effective for continuous driver authentication application.

[1]  Arun Ross,et al.  Periocular Biometrics in the Visible Spectrum , 2011, IEEE Transactions on Information Forensics and Security.

[2]  Mounir Ghogho,et al.  Who is behind the wheel? Driver identification and fingerprinting , 2018, Journal of Big Data.

[3]  Kazuya Takeda,et al.  Driver Modeling Based on Driving Behavior and Its Evaluation in Driver Identification , 2007, Proceedings of the IEEE.

[4]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[5]  Chi Zhang,et al.  An EEG-Based Person Authentication System with Open-Set Capability Combining Eye Blinking Signals , 2018, Sensors.

[6]  Pawel Kasprowski,et al.  Eye Movements in Biometrics , 2004, ECCV Workshop BioAW.

[7]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Ioannis Rigas,et al.  Biometric Recognition via Eye Movements: Saccadic Vigor and Acceleration Cues , 2016, TAP.

[9]  Mohammed Abo-Zahhad,et al.  A Novel Biometric Approach for Human Identification and Verification Using Eye Blinking Signal , 2015, IEEE Signal Processing Letters.

[10]  Wenjia Li,et al.  Driver identification and authentication with active behavior modeling , 2016, 2016 12th International Conference on Network and Service Management (CNSM).

[11]  Hiok Chai Quek,et al.  Driving Profile Modeling and Recognition Based on Soft Computing Approach , 2009, IEEE Transactions on Neural Networks.

[12]  Mohamed Abdel-Mottaleb,et al.  Fully automatic face normalization and single sample face recognition in unconstrained environments , 2016, Expert Syst. Appl..

[13]  Ioannis Rigas,et al.  BioEye 2015: Competition on biometrics via eye movements , 2015, 2015 IEEE 7th International Conference on Biometrics Theory, Applications and Systems (BTAS).

[14]  David Windridge,et al.  Detection of Face Spoofing Using Visual Dynamics , 2015, IEEE Transactions on Information Forensics and Security.

[15]  Yan Liu,et al.  A new method of feature fusion and its application in image recognition , 2005, Pattern Recognit..

[16]  David Crundall,et al.  Driver's visual attention as a function of driving experience and visibility. Using a driving simulator to explore drivers' eye movements in day, night and rain driving. , 2010, Accident; analysis and prevention.

[17]  David Mas,et al.  Blinking characterization from high speed video records. Application to biometric authentication , 2018, PloS one.

[18]  Katarzyna Harezlak,et al.  Using Dissimilarity Matrix for Eye Movement Biometrics with a Jumping Point Experiment , 2016 .

[19]  Lee Friedman,et al.  Study of an Extensive Set of Eye Movement Features: Extraction Methods and Statistical Analysis , 2018, Journal of eye movement research.

[20]  Davide Maltoni,et al.  Fingerprint verification competition 2006 , 2007 .

[21]  Dimitrios Hatzinakos,et al.  Improving Eye Movement Biometrics Using Remote Registration of Eye Blinking Patterns , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[22]  Davis E. King,et al.  Dlib-ml: A Machine Learning Toolkit , 2009, J. Mach. Learn. Res..

[23]  Sherif N. Abbas,et al.  A new multi-level approach to EEG based human authentication using eye blinking , 2016, Pattern Recognit. Lett..

[24]  Ioannis Rigas,et al.  Current research in eye movement biometrics: An analysis based on BioEye 2015 competition , 2017, Image Vis. Comput..

[25]  Tereza Soukupová,et al.  Eye-Blink Detection Using Facial Landmarks , 2016 .

[26]  Sergios Theodoridis,et al.  Chapter 2 – Classifiers Based on Bayes Decision Theory , 2006 .

[27]  K. Rayner Eye movements and visual cognition : scene perception and reading , 1992 .

[28]  J. Fierrez-Aguilar,et al.  On the Vulnerability of Fingerprint Verification Systems to Fake Fingerprints Attacks , 2006, Proceedings 40th Annual 2006 International Carnahan Conference on Security Technology.

[29]  Sébastien Marcel,et al.  Biometric Antispoofing Methods: A Survey in Face Recognition , 2014, IEEE Access.

[30]  Mohammed Abo-Zahhad,et al.  Eye Blinking EOG Signals as Biometrics , 2017 .

[31]  Narishige Abe,et al.  A Novel Local Feature for Eye Movement Authentication , 2016, 2016 International Conference of the Biometrics Special Interest Group (BIOSIG).

[32]  Michele Nappi,et al.  Eye Movement Analysis in Biometrics , 2018, Biometrics under Biomedical Considerations.

[33]  Aurobinda Routray,et al.  A score level fusion method for eye movement biometrics , 2016, Pattern Recognit. Lett..

[34]  Nei Kato,et al.  Automobile Driver Fingerprinting: A New Machine Learning Based Authentication Scheme , 2020, IEEE Transactions on Industrial Informatics.