Classification of Driver Distraction: A Comprehensive Analysis of Feature Generation, Machine Learning, and Input Measures

Objective The objective of this study was to analyze a set of driver performance and physiological data using advanced machine learning approaches, including feature generation, to determine the best-performing algorithms for detecting driver distraction and predicting the source of distraction. Background Distracted driving is a causal factor in many vehicle crashes, often resulting in injuries and deaths. As mobile devices and in-vehicle information systems become more prevalent, the ability to detect and mitigate driver distraction becomes more important. Method This study trained 21 algorithms to identify when drivers were distracted by secondary cognitive and texting tasks. The algorithms included physiological and driving behavioral input processed with a comprehensive feature generation package, Time Series Feature Extraction based on Scalable Hypothesis tests. Results Results showed that a Random Forest algorithm, trained using only driving behavior measures and excluding driver physiological data, was the highest-performing algorithm for accurately classifying driver distraction. The most important input measures identified were lane offset, speed, and steering, whereas the most important feature types were standard deviation, quantiles, and nonlinear transforms. Conclusion This work suggests that distraction detection algorithms may be improved by considering ensemble machine learning algorithms that are trained with driving behavior measures and nonstandard features. In addition, the study presents several new indicators of distraction derived from speed and steering measures. Application Future development of distraction mitigation systems should focus on driver behavior–based algorithms that use complex feature generation techniques.

[1]  Joonwoo Son,et al.  Real-Time Detection and Classification of Driver Distraction Using Lateral Control Performance , 2016 .

[2]  John D. Lee,et al.  Nonintrusive Detection of Driver Cognitive Distraction in Real Time Using Bayesian Networks , 2007 .

[3]  J. Dusek,et al.  Impact of Incremental Increases in Cognitive Workload on Physiological Arousal and Performance in Young Adult Drivers , 2009 .

[4]  I. Pavlidis,et al.  Dissecting Driver Behaviors Under Cognitive, Emotional, Sensorimotor, and Mixed Stressors , 2016, Scientific Reports.

[5]  Tom Fawcett,et al.  ROC Graphs: Notes and Practical Considerations for Researchers , 2007 .

[6]  David B. Kaber,et al.  The Red-Line of Workload: Theory, Research, and Design , 2008 .

[7]  Fred Feng,et al.  Can vehicle longitudinal jerk be used to identify aggressive drivers? An examination using naturalistic driving data. , 2017, Accident; analysis and prevention.

[8]  Keiichi Uchimura,et al.  Driver Inattention Monitoring System for Intelligent Vehicles: A Review , 2009, IEEE Transactions on Intelligent Transportation Systems.

[9]  John D. Lee,et al.  Real-Time Detection of Driver Cognitive Distraction Using Support Vector Machines , 2007, IEEE Transactions on Intelligent Transportation Systems.

[10]  Yan Yang,et al.  Driver Distraction Detection Using Semi-Supervised Machine Learning , 2016, IEEE Transactions on Intelligent Transportation Systems.

[11]  John D Lee,et al.  Combining cognitive and visual distraction: less than the sum of its parts. , 2010, Accident; analysis and prevention.

[12]  Bryan Reimer,et al.  Sensitivity of Physiological Measures for Detecting Systematic Variations in Cognitive Demand From a Working Memory Task , 2012, Hum. Factors.

[13]  Jing Zhang,et al.  Driver cognitive workload estimation: a data-driven perspective , 2004, Proceedings. The 7th International IEEE Conference on Intelligent Transportation Systems (IEEE Cat. No.04TH8749).

[14]  John D. Lee,et al.  A hybrid Bayesian Network approach to detect driver cognitive distraction , 2014 .

[15]  Thomas G. Dietterich Approximate Statistical Tests for Comparing Supervised Classification Learning Algorithms , 1998, Neural Computation.

[16]  R. Jafari,et al.  Body sensor networks for driver distraction identification , 2008, 2008 IEEE International Conference on Vehicular Electronics and Safety.

[17]  C Collet,et al.  Phoning while driving I: a review of epidemiological, psychological, behavioural and physiological studies , 2010, Ergonomics.

[18]  Thomas R. Kurfess,et al.  Detection of Wheel and Workpiece Contact/Release in Reciprocating Surface Grinding , 2003 .

[19]  Bryan Reimer,et al.  Classifying driver workload using physiological and driving performance data: two field studies , 2014, CHI.

[20]  Max Kuhn,et al.  Applied Predictive Modeling , 2013 .

[21]  D. Strayer,et al.  Cell phone-induced failures of visual attention during simulated driving. , 2003, Journal of experimental psychology. Applied.

[22]  J. Hintze,et al.  Violin plots : A box plot-density trace synergism , 1998 .

[23]  Ioannis Pavlidis,et al.  A multimodal dataset for various forms of distracted driving , 2017, Scientific Data.

[24]  Sotiris B. Kotsiantis,et al.  Supervised Machine Learning: A Review of Classification Techniques , 2007, Informatica.

[25]  Johan Engstrom,et al.  Real-Time Distraction Countermeasures , 2009 .

[26]  Johan Engström,et al.  Effects of visual and cognitive load in real and simulated motorway driving , 2005 .

[27]  David L. Strayer,et al.  The Impact of Eye Movements and Cognitive Workload on Lateral Position Variability in Driving , 2013, Hum. Factors.

[28]  Nicholas Roy,et al.  The impact of a naturalistic hands-free cellular phone task on heart rate and simulated driving performance in two age groups , 2011 .

[29]  Fakhri Karray,et al.  A Visual-Based Driver Distraction Recognition and Detection Using Random Forest , 2014, ICIAR.

[30]  N A Stanton,et al.  Transition to manual: Comparing simulator with on-road control transitions. , 2017, Accident; analysis and prevention.

[31]  T. Dingus,et al.  Distracted driving and risk of road crashes among novice and experienced drivers. , 2014, The New England journal of medicine.

[32]  Timothy L. Brown,et al.  The Detection of Visual Distraction using Vehicle and Driver-Based Sensors , 2016 .

[33]  M. N. Doja,et al.  Detecting distraction of drivers using Convolutional Neural Network , 2020, Pattern Recognit. Lett..

[34]  John D. Lee,et al.  Distraction Detection and Mitigation Through Driver Feedback Appendices , 2013 .

[35]  Wendy Macdonald,et al.  Review of Relationships Between Steering Wheel Reversal Rate and Driving Task Demand , 1980 .

[36]  Cory Siebe,et al.  Distracted Driving and Risk of Road Crashes among Novice and Experienced Drivers , 2014 .

[37]  Erwin Roeland Boer Behavioral Entropy as an Index of Workload , 2000 .

[38]  Feng Guo,et al.  Driver crash risk factors and prevalence evaluation using naturalistic driving data , 2016, Proceedings of the National Academy of Sciences.

[39]  Kurt Hornik,et al.  kernlab - An S4 Package for Kernel Methods in R , 2004 .

[40]  David J. Hand,et al.  A Simple Generalisation of the Area Under the ROC Curve for Multiple Class Classification Problems , 2001, Machine Learning.

[41]  Thomas K. Ferris,et al.  Physiological Indicators of the Cognitive Redline , 2015 .

[42]  Natasha Merat,et al.  Effects of Cognitive Load on Driving Performance: The Cognitive Control Hypothesis , 2017, Hum. Factors.

[43]  Noel Massey,et al.  Detecting driver inattention in the absence of driver monitoring sensors , 2004, 2004 International Conference on Machine Learning and Applications, 2004. Proceedings..

[44]  Mark Asbridge,et al.  A meta-analysis of the effects of texting on driving. , 2014, Accident; analysis and prevention.

[45]  Haruki Kawanaka,et al.  Driver's cognitive distraction detection using physiological features by the adaboost , 2009, 2009 12th International IEEE Conference on Intelligent Transportation Systems.

[46]  Y. Benjamini,et al.  THE CONTROL OF THE FALSE DISCOVERY RATE IN MULTIPLE TESTING UNDER DEPENDENCY , 2001 .

[47]  Carlos Busso,et al.  Modeling of Driver Behavior in Real World Scenarios Using Multiple Noninvasive Sensors , 2013, IEEE Transactions on Multimedia.

[48]  Frank Drews,et al.  Text Messaging During Simulated Driving , 2009, Hum. Factors.

[49]  Thomas K. Ferris,et al.  Driving While Interacting With Google Glass: Investigating the Combined Effect of Head-Up Display and Hands-Free Input on Driving Safety and Multitask Performance , 2017, Hum. Factors.

[50]  Andreas W. Kempa-Liehr,et al.  Distributed and parallel time series feature extraction for industrial big data applications , 2016, ArXiv.

[51]  Walter W. Wierwille,et al.  Comparison of Five Mental Workload Assessment Procedures in a Moving-Base Driving Simulator , 1979 .

[52]  R Core Team,et al.  R: A language and environment for statistical computing. , 2014 .

[53]  T. Schreiber,et al.  Discrimination power of measures for nonlinearity in a time series , 1997, chao-dyn/9909043.

[54]  Jennifer Healey,et al.  Detecting stress during real-world driving tasks using physiological sensors , 2005, IEEE Transactions on Intelligent Transportation Systems.

[55]  Thomas K. Ferris,et al.  Age Effects on Drivers’ Physiological Response to Workload , 2017 .

[56]  Omer Tsimhoni,et al.  Model-Based Analysis and Classification of Driver Distraction Under Secondary Tasks , 2010, IEEE Transactions on Intelligent Transportation Systems.

[57]  Anind K. Dey,et al.  Sensors Know When to Interrupt You in the Car: Detecting Driver Interruptibility Through Monitoring of Peripheral Interactions , 2015, CHI.

[58]  Christopher D. Wickens,et al.  Examining the Impact of Cell Phone Conversations on Driving Using Meta-Analytic Techniques , 2006, Hum. Factors.

[59]  Dick de Waard,et al.  Monitoring drivers' mental workload in driving simulators using physiological measures. , 2010, Accident; analysis and prevention.

[60]  J. G. Hollands,et al.  Engineering Psychology and Human Performance , 1984 .

[61]  John D. Lee,et al.  Adapting Collision Warnings to Real-Time Estimates of Driver Distraction , 2009 .

[62]  Jeff K. Caird,et al.  Does Talking on a Cell Phone, With a Passenger, or Dialing Affect Driving Performance? An Updated Systematic Review and Meta-Analysis of Experimental Studies , 2018, Hum. Factors.

[63]  D. de Waard,et al.  Handbook of driving simulation for engineering, medicine and psychology , 2011 .

[64]  Huacai Xian,et al.  Driver Cognitive Distraction Detection Using Driving Performance Measures , 2012 .