EyeDrive: A Deep Learning Model for Continuous Driver Authentication

Eye movement (EM) is considerably a new behavioral modality for biometric authentication. In this work, we use this modality in the context of continuous driver authentication. Existing models rely on different modalities that limit their usage or are inconvenient to drivers. We propose an end-to-end learning model that takes the remote eye movement profiles solely and produces embeddings for driver authentication scenarios. The model is based on Long short-term memory (LSTM) and dense networks to learn temporal characteristics from the EM profiles. We focus on low-rate devices because of their affordability. Yet, they present a challenge because of their limited ability to capture quality measurements. To evaluate our model, two low frame-rate devices are used to build our datasets, which are Autocruis and GazePoint. The authentication performance outperforms state-of-the-art with as low as 30 seconds frame length with both devices. The best authentication performances for the identification/verification modes are 92.38/0.76% and 91.05/0.11% for the first and the second datasets, respectively.

[1]  T. Murino,et al.  On the Impact of Multimodal and Multisensor Biometrics in Smart Factories , 2022, IEEE Transactions on Industrial Informatics.

[2]  G. Cattaneo,et al.  A PNU-Based Methodology to Improve the Reliability of Biometric Systems , 2022, Sensors.

[3]  Tobias Scheffer,et al.  DeepEyedentificationLive: Oculomotoric Biometric Identification and Presentation-Attack Detection Using Deep Neural Networks , 2021, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[4]  Oleg V. Komogortsev,et al.  Eye Know You: Metric Learning for End-to-End Biometric Authentication Using Eye Movements From a Longitudinal Dataset , 2021, IEEE Transactions on Biometrics, Behavior, and Identity Science.

[5]  Dimitrios Hatzinakos,et al.  Improving eye movement biometrics in low frame rate eye-tracking devices using periocular and eye blinking features , 2021, Image Vis. Comput..

[6]  Zhiwen Yu,et al.  Behavioral Biometrics for Continuous Authentication in the Internet-of-Things Era: An Artificial Intelligence Perspective , 2020, IEEE Internet of Things Journal.

[7]  Nei Kato,et al.  Automobile Driver Fingerprinting: A New Machine Learning Based Authentication Scheme , 2020, IEEE Transactions on Industrial Informatics.

[8]  Sameer Qazi,et al.  Internet of Things (IoT) for Next-Generation Smart Systems: A Review of Current Challenges, Future Trends and Prospects for Emerging 5G-IoT Scenarios , 2020, IEEE Access.

[9]  Niels Landwehr,et al.  Deep Distributional Sequence Embeddings Based on a Wasserstein Loss , 2019, Neural Processing Letters.

[10]  Ivan Martinovic,et al.  28 Blinks Later: Tackling Practical Challenges of Eye Movement Biometrics , 2019, CCS.

[11]  Johannes L. Schönberger,et al.  SciPy 1.0: fundamental algorithms for scientific computing in Python , 2019, Nature Methods.

[12]  Joel Nothman,et al.  SciPy 1.0-Fundamental Algorithms for Scientific Computing in Python , 2019, ArXiv.

[13]  Bruno Crispo,et al.  DriverAuth: A risk-based multi-modal biometric-based driver authentication scheme for ride-sharing platforms , 2019, Comput. Secur..

[14]  Andreas Keil,et al.  Biometric Recognition Through Eye Movements Using a Recurrent Neural Network , 2018, 2018 IEEE International Conference on Big Knowledge (ICBK).

[15]  Antonio Alfredo Ferreira Loureiro,et al.  Driver Authentication in VANETs based on Intra-Vehicular Sensor Data , 2018, 2018 IEEE Symposium on Computers and Communications (ISCC).

[16]  Albert Ali Salah,et al.  Continuous Real-Time Vehicle Driver Authentication Using Convolutional Neural Network Based Face Recognition , 2018, 2018 13th IEEE International Conference on Automatic Face & Gesture Recognition (FG 2018).

[17]  Katharina Rifai,et al.  Sampling rate influences saccade detection in mobile eye tracking of a reading task , 2017, Journal of eye movement research.

[18]  Kenneth Holmqvist,et al.  Joint visual working memory through implicit collaboration , 2017 .

[19]  Wenjia Li,et al.  Driver identification and authentication with active behavior modeling , 2016, 2016 12th International Conference on Network and Service Management (CNSM).

[20]  Flavio D. Garcia,et al.  Lock It and Still Lose It - on the (In)Security of Automotive Remote Keyless Entry Systems , 2016, USENIX Security Symposium.

[21]  Ioannis Rigas,et al.  Biometric Recognition via Eye Movements: Saccadic Vigor and Acceleration Cues , 2016, TAP.

[22]  Aurobinda Routray,et al.  A score level fusion method for eye movement biometrics , 2016, Pattern Recognit. Lett..

[23]  Richa Singh,et al.  Ocular biometrics: A survey of modalities and fusion approaches , 2015, Inf. Fusion.

[24]  Oleg V. Komogortsev,et al.  Ieee Transactions on Information Forensics and Security 1 , 2022 .

[25]  Isao Nakanishi,et al.  Using brain waves as transparent biometrics for on-demand driver authentication , 2013, Int. J. Biom..

[26]  Oleg V. Komogortsev,et al.  Complex eye movement pattern biometrics: Analyzing fixations and saccades , 2013, 2013 International Conference on Biometrics (ICB).

[27]  Weiqi Yuan,et al.  The Driver Authentication Device Based on the Characteristics of Palmprint and Palm Vein , 2011, 2011 International Conference on Hand-Based Biometrics.

[28]  Oleg V. Komogortsev,et al.  Biometric identification via eye movement scanpaths in reading , 2011, 2011 International Joint Conference on Biometrics (IJCB).

[29]  Marcus Nyström,et al.  Sampling frequency and eye-tracking measures: how speed affects durations, latencies, and more , 2010 .

[30]  Tomi Kinnunen,et al.  Towards task-independent person authentication using eye movement signals , 2010, ETRA.

[31]  Hiok Chai Quek,et al.  Driving Profile Modeling and Recognition Based on Soft Computing Approach , 2009, IEEE Transactions on Neural Networks.

[32]  Kazuya Takeda,et al.  Driver Modeling Based on Driving Behavior and Its Evaluation in Driver Identification , 2007, Proceedings of the IEEE.

[33]  Pawel Kasprowski,et al.  Eye Movements in Biometrics , 2004, ECCV Workshop BioAW.

[34]  Satoshi Hoshino,et al.  Impact of artificial "gummy" fingers on fingerprint systems , 2002, IS&T/SPIE Electronic Imaging.

[35]  S. Hochreiter,et al.  Long Short-Term Memory , 1997, Neural Computation.

[36]  M. Westerlund The Emergence of Deepfake Technology: A Review , 2019, Technology Innovation Management Review.

[37]  Ryad Benadjila,et al.  One Car, Two Frames: Attacks on Hitag-2 Remote Keyless Entry Systems Revisited , 2017, WOOT.

[38]  Katarzyna Harezlak,et al.  Using Dissimilarity Matrix for Eye Movement Biometrics with a Jumping Point Experiment , 2016 .

[39]  Srdjan Capkun,et al.  Relay Attacks on Passive Keyless Entry and Start Systems in Modern Cars , 2010, NDSS.