Processing of Eye/Head-Tracking Data in Large-Scale Naturalistic Driving Data Sets

Driver distraction and driver inattention are frequently recognized as leading causes of crashes and incidents. Despite this fact, there are few methods available for the automatic detection of driver distraction. Eye tracking has come forward as the most promising detection technology, but the technique suffers from quality issues when used in the field over an extended period of time. Eye-tracking data acquired in the field clearly differs from what is acquired in a laboratory setting or a driving simulator, and algorithms that have been developed in these settings are often unable to operate on noisy field data. The aim of this paper is to develop algorithms for quality handling and signal enhancement of naturalistic eye- and head-tracking data within the setting of visual driver distraction. In particular, practical issues are highlighted. Developed algorithms are evaluated on large-scale field operational test data acquired in the Sweden-Michigan Field Operational Test (SeMiFOT) project, including data from 44 unique drivers and more than 10 000 trips from 13 eye-tracker-equipped vehicles. Results indicate that, by applying advanced data-processing methods, sensitivity and specificity of eyes-off-road glance detection can be increased by about 10%. In conclusion, postenhancement and quality handling is critical when analyzing large databases with naturalistic eye-tracking data. The presented algorithms provide the first holistic approach to accomplish this task.

[1]  Luke Fletcher,et al.  Driver state monitoring to mitigate distraction , 2007 .

[2]  Harry Zhang,et al.  Identification of Real-Time Diagnostic Measures of Visual Distraction With an Automatic Eye-Tracking System , 2006, Hum. Factors.

[3]  Michael J. Goodman,et al.  Individual Differences and in-Vehicle Distraction While Driving: A Test Track Study and Psychometric Evaluation , 1999 .

[4]  Michelle L. Reyes,et al.  Effects of cognitive load presence and duration on driver eye movements and event detection performance , 2008 .

[5]  F. Behrens,et al.  An algorithm separating saccadic from nonsaccadic eye movements automatically by use of the acceleration signal , 1992, Vision Research.

[6]  Luis M. Bergasa,et al.  Real-time system for monitoring driver vigilance , 2005, ISIE 2005.

[7]  Johan Engström,et al.  Effects of visual and cognitive load in real and simulated motorway driving , 2005 .

[8]  Robert J. K. Jacob,et al.  Eye Movement-Based Human-Computer Interaction Techniques: Toward Non-Command Interfaces , 2003 .

[9]  Joseph H. Goldberg,et al.  Identifying fixations and saccades in eye-tracking protocols , 2000, ETRA.

[10]  William J Horrey,et al.  Modeling drivers' visual attention allocation while interacting with in-vehicle technologies. , 2006, Journal of experimental psychology. Applied.

[11]  Tania Dukic,et al.  Comparison of eye tracking systems with one and three cameras , 2010, MB '10.

[12]  Linda Ng Boyle,et al.  Safety implications of providing real-time feedback to distracted drivers. , 2007, Accident; analysis and prevention.

[13]  Katja Kircher,et al.  Issues related to the driver distraction detection algorithm AttenD , 2009 .

[14]  David N. Lee,et al.  Where we look when we steer , 1994, Nature.

[15]  Heikki Summala,et al.  Maintaining Lane Position with Peripheral Vision during In-Vehicle Tasks , 1996, Hum. Factors.

[16]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Linda Ng Boyle,et al.  The Impact of Distraction Mitigation Strategies on Driving Performance , 2006, Hum. Factors.

[18]  Gary Burnett,et al.  Defining Driver Distraction , 2005 .

[19]  Wolfgang Beinhauer.  A widget library for gaze-based interaction elements , 2006, ETRA '06.

[20]  Andreas Paepcke,et al.  Improving the accuracy of gaze input for interaction , 2008, ETRA.

[21]  Richard J. Hanowski,et al.  Driver Distraction in Commercial Vehicle Operations , 2009 .

[22]  Patrice Renaud,et al.  Eye-tracker data filtering using pulse coupled neural network , 2006 .

[23]  M. A. Recarte,et al.  Effects of verbal and spatial-imagery tasks on eye fixations while driving. , 2000, Journal of experimental psychology. Applied.

[24]  Wolfgang Birk,et al.  A driver-distraction-based lane-keeping assistance system , 2007 .

[25]  Mohan M. Trivedi,et al.  Head Pose Estimation and Augmented Reality Tracking: An Integrated System and Evaluation for Monitoring Driver Awareness , 2010, IEEE Transactions on Intelligent Transportation Systems.

[26]  Rebecca L Olson,et al.  Distraction in Commercial Trucks and Buses: Assessing Prevalence and Risk in Conjunction with Crashes and Near-Crashes , 2009 .

[27]  Keiichi Uchimura,et al.  Driver Inattention Monitoring System for Intelligent Vehicles: A Review , 2009, IEEE Transactions on Intelligent Transportation Systems.

[28]  Rikard Karlsson,et al.  Evaluating driver distraction countermeasures , 2005 .

[29]  Dirk P. Kroese,et al.  Kernel density estimation via diffusion , 2010, 1011.2602.

[30]  Paul H. C. Eilers,et al.  Quantile smoothing of array CGH data , 2005, Bioinform..

[31]  Björn W. Schuller,et al.  Online Driver Distraction Detection Using Long Short-Term Memory , 2011, IEEE Transactions on Intelligent Transportation Systems.

[32]  Marcus Nyström,et al.  An adaptive algorithm for fixation, saccade, and glissade detection in eyetracking data , 2010, Behavior research methods.

[33]  Andrew T. Duchowski,et al.  Eye Tracking Methodology: Theory and Practice , 2003, Springer London.

[34]  Lisbeth Almén.  REDUCING THE EFFECTS OF DRIVER DISTRACTION: A COMPARISON OF DISTRACTION ALERTS ON DRIVER ATTENTION , 2003 .

[35]  Charlene Hallett,et al.  Driver distraction and driver inattention: definition, relationship and taxonomy. , 2011, Accident; analysis and prevention.

[36]  L. Stark,et al.  Dynamics of head movement trajectories: Main sequence relationship , 1981, Experimental Neurology.

[37]  Patrice Renaud,et al.  An online noise filter for eye-tracker data recorded in a virtual environment , 2008, ETRA '08.

[38]  Thomas A. Dingus,et al.  The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data , 2006 .

[39]  D. Whitteridge.  Movements of the eyes R. H. S. Carpenter, Pion Ltd, London (1977), 420 pp., $27.00 , 1979, Neuroscience.

[40]  Charles C. Adams,et al.  Safety Aspects of CRT Touch Panel Controls in Automobiles , 1988 .

[41]  Johan Engström,et al.  Sensitivity of eye-movement measures to in-vehicle task difficulty , 2005 .

[42]  Paul H. C. Eilers,et al.  Splines, knots, and penalties , 2010 .

[43]  Kenneth Holmqvist,et al.  Eye tracking: a comprehensive guide to methods and measures , 2011 .

[44]  A. Savitzky,et al.  Smoothing and Differentiation of Data by Simplified Least Squares Procedures. , 1964 .

[45]  N. Shimizu.  [Neurology of eye movements]. , 2000, Rinsho shinkeigaku = Clinical neurology.

[46]  Jeremy D Sudweeks,et al.  An Analysis of Driver Inattention Using a Case-Crossover Approach On 100-Car Data: Final Report , 2010 .

[47]  Heikki Summala,et al.  Driving experience and time-sharing during in-car tasks on roads of different width , 1998 .

[48]  Miguel Ángel Sotelo,et al.  Real-time system for monitoring driver vigilance , 2004, Proceedings of the IEEE International Symposium on Industrial Electronics, 2005. ISIE 2005..