Real-Time Detection System of Driver Distraction Using Machine Learning

There is accumulating evidence that driver distraction is a leading cause of vehicle crashes and incidents. In particular, increased use of so-called in-vehicle information systems (IVIS) and partially autonomous driving assistance systems (PADAS) have raised important and growing safety concerns. Thus, detecting the driver's state is of paramount importance, to adapt IVIS and PADAS accordingly, therefore avoiding or mitigating their possible negative effects. The purpose of this paper is to show a method for the nonintrusive and real-time detection of visual distraction, using vehicle dynamics data and without using the eye-tracker data as inputs to classifiers. Specifically, we present and compare different models that are based on well-known machine learning (ML) methods. Data for training the models were collected using a static driving simulator, with real human subjects performing a specific secondary task [i.e., a surrogate visual research task (SURT)] while driving. Different training methods, model characteristics, and feature selection criteria have been compared. Based on our results, using a support vector machine (SVM) has outperformed all the other ML methods, providing the highest classification rate for most of the subjects. Potential applications of this paper include the design of an adaptive IVIS and of a “smarter” PADAS.

[1]  W. Marsden I and J , 2012 .

[2]  William W. Stoner,et al.  Pattern Recognition With A Neural Net , 1986, Optics & Photonics.

[3]  Karel Brookhuis,et al.  The feasibility of detecting phone-use related driver distraction , 2001 .

[4]  Charlene Hallett,et al.  Driver distraction and driver inattention: definition, relationship and taxonomy. , 2011, Accident; analysis and prevention.

[5]  Dot Hs,et al.  The 100 Car Naturalistic Driving Study , 2002 .

[6]  Keiichi Uchimura,et al.  Driver inattention monitoring system for intelligent vehicles: A review , 2009 .

[7]  David Sandberg Detecting Driver Sleepiness , 2011 .

[8]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[9]  Jeffry Allen Greenberg,et al.  THE EFFECT OF LATERAL MOTION CUES DURING SIMULATED DRIVING , 2003 .

[10]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[11]  S J Westerman,et al.  Mobile (cellular) phone use and driving: a critical review of research methodology , 2001, Ergonomics.

[12]  Berthold Färber,et al.  Driver distraction based lane-keeping assistance , 2009 .

[13]  Björn W. Schuller,et al.  Online Driver Distraction Detection Using Long Short-Term Memory , 2011, IEEE Transactions on Intelligent Transportation Systems.

[14]  T. Ranney Driver Distraction : A Review of the Current State-of-Knowledge , 2008 .

[15]  Simon Haykin,et al.  Neural Networks: A Comprehensive Foundation , 1998 .

[16]  Cataldo Guaragnella,et al.  A visual approach for driver inattention detection , 2007, Pattern Recognit..

[17]  Motoyuki Akamatsu,et al.  Prediction of Human Driving Behavior Using Dynamic Bayesian Networks , 2006, IEICE Trans. Inf. Syst..

[18]  John D. Lee,et al.  Nonintrusive Detection of Driver Cognitive Distraction in Real Time Using Bayesian Networks , 2007 .

[19]  Qiang Ji,et al.  A probabilistic framework for modeling and real-time monitoring human fatigue , 2006, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[20]  Jing Zhang,et al.  Driver cognitive workload estimation: a data-driven perspective , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[21]  James C. Bezdek,et al.  Pattern Recognition with Fuzzy Objective Function Algorithms , 1981, Advanced Applications in Pattern Recognition.

[22]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[23]  P Van Elslande,et al.  Attentional competition between tasks and ITS implications , 2010 .

[24]  Jyh-Shing Roger Jang,et al.  ANFIS: adaptive-network-based fuzzy inference system , 1993, IEEE Trans. Syst. Man Cybern..

[25]  Olivier Pietquin,et al.  Automation Effects on Driver's Behaviour When Integrating a PADAS and a Distraction Classifier , 2011, HCI.

[26]  Marco Botta,et al.  Evaluation of Distraction in a Driver-Vehicle-Environment Framework: An Application of Different Data-Mining Techniques , 2009, ICDM.

[27]  John D. Lee,et al.  Driver Cognitive Distraction Detection Using Eye Movements , 2008 .

[28]  Hyeran Byun,et al.  Applications of Support Vector Machines for Pattern Recognition: A Survey , 2002, SVM.

[29]  Katja Kircher,et al.  Driver distraction : a review of the literature , 2007 .

[30]  Michio Sugeno,et al.  Industrial Applications of Fuzzy Control , 1985 .

[31]  Richard J. Hanowski,et al.  Driver Distraction in Commercial Vehicle Operations , 2009 .

[32]  John D. Lee,et al.  Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[33]  Marco Botta,et al.  Non-intrusive Detection of Driver Distraction using Machine Learning Algorithms , 2010, ECAI.

[34]  Alex Pentland,et al.  Modeling and Prediction of Human Behavior , 1999, Neural Computation.

[35]  J R Treat,et al.  TRI-LEVEL STUDY OF THE CAUSES OF TRAFFIC ACCIDENTS: FINAL REPORT , 1979 .

[36]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[37]  Pierre Baldi,et al.  Bioinformatics - the machine learning approach (2. ed.) , 2000 .

[38]  Takahiro Wada,et al.  How Do Distracted and Normal Driving Differ: An Analysis of the ACAS Naturalistic Driving Data , 2007 .

[39]  Harry Zhang,et al.  Identification of Real-Time Diagnostic Measures of Visual Distraction With an Automatic Eye-Tracking System , 2006, Hum. Factors.

[40]  E D Sussman,et al.  Driver inattention and highway safety , 1985 .

[41]  Christopher D. Wickens,et al.  Multiple resources and performance prediction , 2002 .

[42]  John D. Lee,et al.  Defining Driver Distraction , 2009 .

[43]  Rebecca L Olson,et al.  Distraction in Commercial Trucks and Buses: Assessing Prevalence and Risk in Conjunction with Crashes and Near-Crashes , 2009 .

[44]  Gustav Markkula,et al.  Driver cognitive distraction detection: Feature estimation and implementation , 2007 .

[45]  Eric Rodgman,et al.  The role of driver distraction in traffic crashes , 2001 .

[46]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[47]  Michael J. Goodman,et al.  The role of driver inattention in crashes: new statistics from the 1995 crashworthiness data system , 1996 .

[48]  Liu Qiao,et al.  Learning algorithm of environmental recognition in driving vehicle , 1995, IEEE Trans. Syst. Man Cybern..

[49]  Noelia Hernández,et al.  Gaze Fixation System for the Evaluation of Driver Distractions Induced by IVIS , 2012, IEEE Transactions on Intelligent Transportation Systems.

[50]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..

[51]  Thomas A. Dingus,et al.  The 100-Car Naturalistic Driving Study Phase II – Results of the 100-Car Field Experiment , 2006 .

[52]  Olivier Pietquin,et al.  Batch reinforcement learning for optimizing longitudinal driving assistance strategies , 2011, 2011 IEEE Symposium on Computational Intelligence in Vehicles and Transportation Systems (CIVTS) Proceedings.

[53]  Omer Tsimhoni,et al.  Model-Based Analysis and Classification of Driver Distraction Under Secondary Tasks , 2010, IEEE Transactions on Intelligent Transportation Systems.

[54]  Vladimir N. Vapnik,et al.  The Nature of Statistical Learning Theory , 2000, Statistics for Engineering and Information Science.

[55]  Madan M. Gupta,et al.  Introduction to Fuzzy Arithmetic , 1991 .