Continuous Real-Time Vehicle Driver Authentication Using Convolutional Neural Network Based Face Recognition

Continuous driver authentication is useful in the prevention of car thefts, fraudulent switching of designated drivers, and driving beyond a designated amount of time for a single driver. In this paper, we propose a deep neural network based approach for real time and continuous authentication of vehicle drivers. Features extracted from pre-trained neural network models are classified with support vector classifiers. In order to examine realistic conditions, we collect 130 in-car driving videos from 52 different subjects. We investigate the conditions under which current face recognition technology will allow commercialization of continuous driver authentication.

[1]  Michael Felsberg,et al.  Accurate Scale Estimation for Robust Visual Tracking , 2014, BMVC.

[2]  Keiichi Yamada,et al.  Detection of the face and eye region for drivers' support system , 2003, International Conference on Quality Control by Artificial Vision.

[3]  Prabir Bhattacharya,et al.  A driver fatigue recognition model based on information fusion and dynamic Bayesian network , 2010, Inf. Sci..

[4]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  M. Amaç Güvensan,et al.  Driver Behavior Analysis for Safe Driving: A Survey , 2015, IEEE Transactions on Intelligent Transportation Systems.

[6]  Sooyeong Kwak,et al.  Driver Facial Landmark Detection in Real Driving Situations , 2018, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  Ferdinand van der Heijden,et al.  Efficient adaptive density estimation per image pixel for the task of background subtraction , 2006, Pattern Recognit. Lett..

[8]  Mahmood Fathy,et al.  A driver face monitoring system for fatigue and distraction detection , 2013 .

[9]  Pedro Jiménez,et al.  RSMAT: Robust simultaneous modeling and tracking , 2010, Pattern Recognit. Lett..

[10]  Marwan Mattar,et al.  Labeled Faces in the Wild: A Database forStudying Face Recognition in Unconstrained Environments , 2008 .

[11]  Z. Zivkovic.  Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[12]  Sei-Wang Chen,et al.  Extracting driver's facial features during driving , 2011, 2011 14th International IEEE Conference on Intelligent Transportation Systems (ITSC).

[13]  Laurence T. Yang,et al.  Automatic Vehicle Detection and Driver Identification Framework for Secure Vehicle Parking , 2015, 2015 13th International Conference on Frontiers of Information Technology (FIT).

[14]  Hang-Bong Kang,et al.  Various Approaches for Driver and Driving Behavior Monitoring: A Review , 2013, 2013 IEEE International Conference on Computer Vision Workshops.

[15]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[16]  Sei-Wang Chen,et al.  Image compensation for improving extraction of driver's facial features , 2014, 2014 International Conference on Computer Vision Theory and Applications (VISAPP).

[17]  Hyeonjoon Moon,et al.  Biometric Driver Authentication Based on 3D Face Recognition for Telematics Applications , 2007, HCI.

[18]  Davis E. King,et al.  Dlib-ml: A Machine Learning Toolkit , 2009, J. Mach. Learn. Res..

[19]  Antonio M. López,et al.  A reduced feature set for driver head pose estimation , 2016, Appl. Soft Comput..

[20]  Rita Cucchiara,et al.  POSEidon: Face-from-Depth for Driver Pose Estimation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Saeid Nahavandi,et al.  Recent Advances on Singlemodal and Multimodal Face Recognition: A Survey , 2014, IEEE Transactions on Human-Machine Systems.

[22]  M. Zweig,et al.  Receiver-operating characteristic (ROC) plots: a fundamental evaluation tool in clinical medicine. , 1993, Clinical chemistry.