Non-Intrusive Detection of Drowsy Driving Based on Eye Tracking Data

Drowsy driving is one of the leading causes of motor vehicle accidents in North America. This paper presents the use of eye tracking data as a non-intrusive measure of driver behavior for detection of drowsiness. Eye tracking data were acquired from 53 subjects in a simulated driving experiment, whereas the simultaneously recorded multichannel electroencephalogram (EEG) signals were used as the baseline. A random forest (RF) and a non-linear support vector machine (SVM) were employed for binary classification of the state of vigilance. Different lengths of eye tracking epoch were selected for feature extraction, and the performance of each classifier was investigated for every epoch length. Results revealed a high accuracy for the RF classifier in the range of 88.37% to 91.18% across all epoch lengths, outperforming the SVM with 77.12% to 82.62% accuracy. A feature analysis approach was presented and top eye tracking features for drowsiness detection were identified. Altogether, this study showed a high correspondence between the extracted eye tracking features and EEG as a physiological measure of vigilance and verified the potential of these features along with a proper classification technique, such as the RF, for non-intrusive long-term assessment of drowsiness in drivers. This research would ultimately lead to development of technologies for real-time assessment of the state of vigilance, providing early warning of fatigue and drowsiness in drivers.

[1]  Luis Miguel Bergasa,et al.  Vision-based drowsiness detector for real driving conditions , 2012, 2012 IEEE Intelligent Vehicles Symposium.

[2]  Mark E Howard,et al.  Slow eyelid closure as a measure of driver drowsiness and its relationship to performance , 2016, Traffic Injury Prevention.

[3]  M. Bonnet,et al.  Acute Sleep Deprivation , 2013 .

[4]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[5]  M. Golz,et al.  Evaluation of PERCLOS based current fatigue monitoring technologies , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[6]  H. Colten,et al.  Sleep Disorders and Sleep Deprivation: An Unmet Public Health Problem , 2006 .

[7]  Gamini Dissanayake,et al.  Driver Drowsiness Classification Using Fuzzy Wavelet-Packet-Based Feature-Extraction Algorithm , 2011, IEEE Transactions on Biomedical Engineering.

[8]  D. Dinges,et al.  Chapter 38 – Circadian Rhythms in Sleepiness, Alertness, and Performance , 2011 .

[9]  Evangelos Bekiaris,et al.  Using EEG spectral components to assess algorithms for detecting fatigue , 2009, Expert Syst. Appl..

[10]  Jianfeng Hu,et al.  Comparison of Different Features and Classifiers for Driver Fatigue Detection Based on a Single EEG Channel , 2017, Comput. Math. Methods Medicine.

[11]  John D Lee,et al.  Evaluating driver drowsiness countermeasures , 2017, Traffic injury prevention.

[12]  F. L. D. Silva,et al.  EEG signal processing , 2000, Clinical Neurophysiology.

[13]  Nak-Tak Jeong,et al.  Drowsy behavior detection based on driving information , 2016, International Journal of Automotive Technology.

[14]  D. Dinges,et al.  EVALUATION OF TECHNIQUES FOR OCULAR MEASUREMENT AS AN INDEX OF FATIGUE AND THE BASIS FOR ALERTNESS MANAGEMENT , 1998 .

[15]  E. Parzen On Estimation of a Probability Density Function and Mode , 1962 .

[16]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[17]  Cardona Alzate,et al.  Predicción y selección de variables con bosques aleatorios en presencia de variables correlacionadas , 2020 .

[18]  D. Opitz,et al.  Popular Ensemble Methods: An Empirical Study , 1999, J. Artif. Intell. Res..

[19]  Jianfeng Hu,et al.  Automated Detection of Driver Fatigue Based on AdaBoost Classifier with EEG Signals , 2017, Front. Comput. Neurosci..

[20]  Prabir Bhattacharya,et al.  A driver fatigue recognition model based on information fusion and dynamic Bayesian network , 2010, Inf. Sci..

[21]  Mark R. Rosekind,et al.  Asleep at the Wheel: A National Compendium of Efforts to Eliminate Drowsy Driving , 2017 .

[22]  Jarek Krajewski,et al.  Steering wheel behavior based estimation of fatigue , 2017 .

[23]  Chin-Teng Lin,et al.  An EEG-based perceptual function integration network for application to drowsy driving , 2015, Knowl. Based Syst..

[24]  Xinping Yan,et al.  Sensitivity of Lane Position and Steering Angle Measurements to Driver Fatigue , 2016 .

[25]  Shuyan Hu,et al.  Driver drowsiness detection with eyelid related parameters by Support Vector Machine , 2009, Expert Syst. Appl..

[26]  Anwar M. Mirza,et al.  Fully automated real time fatigue detection of drivers through Fuzzy Expert Systems , 2014, Appl. Soft Comput..

[27]  Mengyang Xin,et al.  Can variations in visual behavior measures be good predictors of driver sleepiness? A real driving test study , 2017, Traffic injury prevention.

[28]  Robert E. Schapire,et al.  A Brief Introduction to Boosting , 1999, IJCAI.

[29]  Ron Kohavi,et al.  Wrappers for Feature Subset Selection , 1997, Artif. Intell..

[30]  J. Ramaekers,et al.  Driving performance and EEG fluctuations during on-the-road driving following sleep deprivation , 2016, Biological Psychology.

[31]  Azhar Quddus,et al.  Non-Intrusive Assessment of Fatigue in Drivers Using Eye Tracking , 2018 .

[32]  Colin Campbell,et al.  Algorithmic approaches to training Support Vector Machines: a survey , 2000, ESANN.

[33]  M. Bonnet,et al.  Chapter 5 – Acute Sleep Deprivation , 2005 .

[34]  Christian Guilleminault,et al.  Fatigue, sleep restriction, and performance in automobile drivers: a controlled study in a natural environment. , 2003, Sleep.

[35]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[36]  Keiichi Uchimura,et al.  Driver Inattention Monitoring System for Intelligent Vehicles: A Review , 2009, IEEE Transactions on Intelligent Transportation Systems.

[37]  Pushpa N. Rathie,et al.  On the entropy of continuous probability distributions (Corresp.) , 1978, IEEE Trans. Inf. Theory.

[38]  D. Dinges,et al.  Circadian Rhythms in Sleepiness, Alertness, and Performance , 2009 .

[39]  Xiao Fan,et al.  Gabor-based dynamic representation for human fatigue monitoring in facial image sequences , 2010, Pattern Recognit. Lett..

[40]  Christophe Bourdin,et al.  Adapting artificial neural networks to a specific driver enhances detection and prediction of drowsiness. , 2018, Accident; analysis and prevention.

[41]  Melinda L. Jackson,et al.  The utility of automated measures of ocular metrics for detecting driver drowsiness during extended wakefulness. , 2016, Accident; analysis and prevention.

[42]  Xuesong Wang,et al.  Driver drowsiness detection based on non-intrusive metrics considering individual specifics. , 2016, Accident; analysis and prevention.