Evaluating driver cognitive distraction by eye tracking: From simulator to driving

Abstract Driver cognitive distraction, a critical factor for road safety, is challenging for researchers to evaluate, especially under real conditions. This paper introduces a novel method for simulating involuntary eye movement by combining the vestibulo-ocular reflex model and the optokinetic response. The difference between the predicted and observed eye movements is then assumed to be a measure of the level of cognitive distraction. When this hypothesis was validated under two sets of conditions, in a driving simulator and in a naturalistic situation, our algorithm was able to capture the cognitive distraction event in the naturalistic case. In addition, we also review and discuss the eye-movement sensor, which has a marked effect on the results of the evaluation, and the potential of using eye-movement sensors to evaluate cognitive distraction in drivers.

[1]  Tanja Schultz,et al.  Mental workload during n-back task—quantified in the prefrontal cortex using fNIRS , 2014, Front. Hum. Neurosci..

[2]  Goro Obinata,et al.  Quantitative Evaluation of Mental Workload by Using Model of Involuntary Eye Movement , 2009, HCI.

[3]  M. Rizzo,et al.  Looking but not seeing , 1987, Neurology.

[4]  Hirofumi Aoki,et al.  Effect of Sliding Window Time on the Classification of Driver Mental Workload Performance Using Near-Infrared Spectroscopy (NIRS) , 2018, 2018 21st International Conference on Intelligent Transportation Systems (ITSC).

[5]  Makoto Inagami,et al.  Towards online detection of driver distraction: Eye-movement simulation based on a combination of vestibulo–ocular reflex and optokinetic reflex models , 2019, Transportation Research Part F: Traffic Psychology and Behaviour.

[6]  Goro Obinata,et al.  Evaluating the influence of distractions to drivers based on reflex eye movement model , 2010, IFAC HMS.

[7]  Hirofumi Aoki,et al.  Evaluation of Driver Distraction with Changes in Gaze Direction Based on a Vestibulo-Ocular Reflex Model , 2017 .

[8]  Goro Obinata,et al.  On-line Method for Evaluating Driver Distraction of Memory-decision Workload Based on Dynamics of Vestibulo-ocular Reflex , 2008 .

[9]  Makoto Inagami,et al.  The Effect of Visual Stimulus on Voluntary Eye Movement Based on a VOR/OKR Model , 2017 .

[10]  W. Becker,et al.  Gaze Stabilization by Optokinetic Reflex (OKR) and Vestibulo-ocular Reflex (VOR) During Active Head Rotation in Man , 1997, Vision Research.

[11]  Hirofumi Aoki,et al.  A Novel Method for Classifying Driver Mental Workload Under Naturalistic Conditions With Information From Near-Infrared Spectroscopy , 2018, Front. Hum. Neurosci..

[12]  SchmidhuberJürgen.  Deep learning in neural networks , 2015 .

[13]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Marc Garbey,et al.  Measuring Mental Workload with EEG+fNIRS , 2017, Front. Hum. Neurosci..

[15]  Keiichi Uchimura,et al.  Driver Inattention Monitoring System for Intelligent Vehicles: A Review , 2009, IEEE Transactions on Intelligent Transportation Systems.

[16]  M. Okada,et al.  Novel method to classify hemodynamic response obtained using multi-channel fNIRS measurements into two groups: exploring the combinations of channels , 2014, Front. Hum. Neurosci..

[17]  Peter Kenning,et al.  Near-infrared spectroscopy (NIRS) as a new tool for neuroeconomic research , 2014, Front. Hum. Neurosci..

[18]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[19]  Aamir Saeed Malik,et al.  EEG based driver cognitive distraction assessment , 2014, 2014 5th International Conference on Intelligent and Advanced Systems (ICIAS).

[20]  Kilseop Ryu,et al.  Evaluation of mental workload with a combined measure based on physiological indices during a dual task of tracking and mental arithmetic , 2005 .

[21]  Goro Obinata,et al.  Mental Workloads Can Be Objectively Quantified in Real-time Using VOR (Vestibulo-Ocular Reflex) , 2008 .

[22]  Meike Jipp,et al.  Assessing the Driver’s Current Level of Working Memory Load with High Density Functional Near-infrared Spectroscopy: A Realistic Driving Simulator Study , 2017, Front. Hum. Neurosci..

[23]  Johan Engström,et al.  Effects of visual and cognitive load in real and simulated motorway driving , 2005 .

[24]  Le Anh Son,et al.  Effect of Mental Workload and Aging on Driver Distraction Based on the Involuntary Eye Movement , 2017 .

[25]  Tatsuya Suzuki,et al.  Parameters optimization using genetic algorithm technique for Vestibulo-ocular reflex model , 2015 .

[26]  D A Robinson,et al.  The use of control systems analysis in the neurophysiology of eye movements. , 1981, Annual review of neuroscience.