Detecting driver distraction using stimuli-response EEG analysis

Detecting driver distraction is a significant concern for future intelligent transportation systems. We present a new approach for identifying distracted driving behavior by evaluating a stimulus and response interaction with the brain signals in two ways. First, measuring the driver response through EEG by creating various types of distraction stimuli such as reading, texting, calling and using phone camera (risk odds ratio of these activities determined by NHTSA study). Second, using a survey, comparing driver's order/perception of severity of distraction with the derived distraction index from EEG bands. A 14 electrodes headset was used to record the brain signals while driving in the pilot study with two subjects and a single dry electrode headset with 13 subjects in the main study. We used a naturalistic driving study as opposed to a virtual reality driving simulator to perform the distracted driving maneuvers, consisting of over 100 short duration trials (three to five seconds) for a subject. We overcame a big challenge in EEG analysis - reducing the number of electrodes by isolating one electrode (FC5) from 14 electrode locations to identify certain distractions. Our machine learning methods achieved a mean accuracy (averaged over the subjects and tasks) of 91.54 +/- 5.23% to detect a distracted driving event and 76.99 +/- 8.63% to distinguish between the five distraction cases in our study (read, text, call, and snapshot) using a single electrode. The quantification of distracted driving detailed in this paper is necessary to guide future policies in road safety. Our system addresses the safety concerns resulting from driver distraction and aims to bring about behavioral changes in drivers.

[1]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[2]  Keiichi Uchimura,et al.  Driver inattention monitoring system for intelligent vehicles: A review , 2009 .

[3]  Marius Marusteri,et al.  Comparing groups for statistical differences: how to choose the right statistical test? , 2010 .

[4]  Dot Hs On-Road Study of Willingness to Engage in Distracting Tasks , 2005 .

[5]  N. Kamel,et al.  Deep in thought while driving: An EEG study on drivers’ cognitive distraction , 2014 .

[6]  G. Pfurtscheller,et al.  Brain-Computer Interfaces for Communication and Control. , 2011, Communications of the ACM.

[7]  Tzyy-Ping Jung,et al.  EURASIP Journal on Applied Signal Processing 2005:19, 3165–3174 c ○ 2005 Hindawi Publishing Corporation Estimating Driving Performance Based on EEG Spectrum Analysis , 2005 .

[8]  Glyn W. Humphreys,et al.  Distinct neural substrates for the perception of real and virtual visual worlds , 2005, NeuroImage.

[9]  Cher Carney,et al.  Examining teen driver crashes and the prevalence of distraction: Recent trends, 2007-2015. , 2018, Journal of safety research.

[10]  Robert Oostenveld,et al.  The five percent electrode system for high-resolution EEG and ERP measurements , 2001, Clinical Neurophysiology.

[11]  Chin-Teng Lin,et al.  Driver's drowsiness estimation by combining EEG signal analysis and ICA-based fuzzy neural networks , 2006, 2006 IEEE International Symposium on Circuits and Systems.

[12]  Tzyy-Ping Jung,et al.  EEG-Based Attention Tracking During Distracted Driving , 2015, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Tzyy-Ping Jung,et al.  Independent Component Analysis of Electroencephalographic Data , 1995, NIPS.

[14]  Terrence J. Sejnowski,et al.  Complex Independent Component Analysis of Frequency-Domain Electroencephalographic Data , 2003, Neural Networks.

[15]  A. Pauzie,et al.  A method to assess the driver mental workload: The driving activity load index (DALI) , 2008 .

[16]  Rohan Dixit,et al.  Meditation Training and Neurofeedback Using a Personal EEG Device , 2012, AAAI Spring Symposium: Self-Tracking and Collective Intelligence for Personal Wellness.

[17]  Mayank R. Mehta,et al.  Multisensory Control of Hippocampal Spatiotemporal Selectivity , 2013, Science.

[18]  Tzyy-Ping Jung,et al.  A Cell-Phone Based Brain-Computer Interface for Communication in Daily Life , 2010, AICI.

[19]  N. A. Borghese,et al.  Different Brain Correlates for Watching Real and Virtual Hand Actions , 2001, NeuroImage.

[20]  J J Vidal,et al.  Toward direct brain-computer communication. , 1973, Annual review of biophysics and bioengineering.

[21]  Garima Bajwa,et al.  Self-Tracking via Brain-Mobile-Cloud Interface , 2013, AAAI Spring Symposium: Data Driven Wellness.

[22]  C. Spampinato,et al.  A Multi-Facets Analysis of the Driver Status by EEG and Fuzzy Hardware Processing , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[23]  Garima Bajwa,et al.  Neurokey: Towards a new paradigm of cancelable biometrics-based key generation using electroencephalograms , 2016, Comput. Secur..

[24]  Charles W. Anderson,et al.  Classification of EEG Signals from Four Subjects During Five Mental Tasks , 2007 .

[25]  M. Esmaeili Classifiers Fusion for EEG Signals Processing in Human-Computer Interface Systems , 2007, AAAI.

[26]  Arnaud Delorme,et al.  EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis , 2004, Journal of Neuroscience Methods.

[27]  Chin-Teng Lin,et al.  An EEG-Based Brain-Computer Interface for Dual Task Driving Detection , 2011, ICONIP.

[28]  Zhi-Long Chen,et al.  Using EEG to detect drivers' emotion with Bayesian Networks , 2010, 2010 International Conference on Machine Learning and Cybernetics.

[29]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[30]  Arthur F. Kramer,et al.  Handbook of Psychophysiology: Neuroergonomics: Applications of Neuroscience to Human Factors , 2007 .

[31]  R. Palaniappan,et al.  Brain Computer Interface Design Using Band Powers Extracted During Mental Tasks , 2005, Conference Proceedings. 2nd International IEEE EMBS Conference on Neural Engineering, 2005..

[32]  A. Nijholt,et al.  A survey of affective brain computer interfaces: principles, state-of-the-art, and challenges , 2014 .

[33]  Louis Tijerina,et al.  Driver Workload Metrics Task 2 Final Report , 2006 .

[34]  Matthias Roetting,et al.  Driver’s mental workload assessment using EEG data in a dual task paradigm , 2009 .

[35]  Shaohan Hu,et al.  NeuroPhone: brain-mobile phone interface using a wireless EEG headset , 2010, MobiHeld '10.

[36]  Christopher L. Asplund,et al.  Isolation of a Central Bottleneck of Information Processing with Time-Resolved fMRI , 2006, Neuron.

[37]  W. Art Chaovalitwongse,et al.  Online Prediction of Driver Distraction Based on Brain Activity Patterns , 2015, IEEE Transactions on Intelligent Transportation Systems.

[38]  Chin-Teng Lin,et al.  EEG-based brain dynamics of driving distraction , 2011, The 2011 International Joint Conference on Neural Networks.

[39]  Chin-Teng Lin,et al.  Spatial and temporal EEG dynamics of dual-task driving performance , 2011, Journal of NeuroEngineering and Rehabilitation.

[40]  Li-Wei Ko,et al.  Review of Wireless and Wearable Electroencephalogram Systems and Brain-Computer Interfaces – A Mini-Review , 2009, Gerontology.

[41]  Zhu Feng,et al.  Analysis of virtual simulation environment for driving behavior based on imaging movements , 2010, 2010 International Conference on Networking and Digital Society.

[42]  Kolusu Bhaskara Sai Parasuram,et al.  EEG Based Attention Tracking During Distracted Driving , 2018 .

[43]  Fred Tam,et al.  Brain activity during driving with distraction: an immersive fMRI study , 2013, Front. Hum. Neurosci..

[44]  Ashley Craig,et al.  Development of an algorithm for an EEG-based driver fatigue countermeasure. , 2003, Journal of safety research.

[45]  Mark Asbridge,et al.  The use of meta-analysis or research synthesis to combine driving simulation or naturalistic study results on driver distraction. , 2014, Journal of safety research.

[46]  Michael J. Goodman,et al.  NHTSA DRIVER DISTRACTION RESEARCH: PAST, PRESENT, AND FUTURE , 2001 .

[47]  M A Schier,et al.  Changes in EEG alpha power during simulated driving: a demonstration. , 2000, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[48]  Thomas A. Dingus,et al.  The Impact of Driver Inattention on Near-Crash/Crash Risk: An Analysis Using the 100-Car Naturalistic Driving Study Data , 2006 .

[49]  Christopher D. Wickens,et al.  Multiple Resources and Mental Workload , 2008, Hum. Factors.