EEG-Based Detection of Braking Intention Under Different Car Driving Conditions

The anticipatory recognition of braking is essential to prevent traffic accidents. For instance, driving assistance systems can be useful to properly respond to emergency braking situations. Moreover, the response time to emergency braking situations can be affected and even increased by different driver's cognitive states caused by stress, fatigue, and extra workload. This work investigates the detection of emergency braking from driver's electroencephalographic (EEG) signals that precede the brake pedal actuation. Bioelectrical signals were recorded while participants were driving in a car simulator while avoiding potential collisions by performing emergency braking. In addition, participants were subjected to stress, workload, and fatigue. EEG signals were classified using support vector machines (SVM) and convolutional neural networks (CNN) in order to discriminate between braking intention and normal driving. Results showed significant recognition of emergency braking intention which was on average 71.1% for SVM and 71.8% CNN. In addition, the classification accuracy for the best participant was 80.1 and 88.1% for SVM and CNN, respectively. These results show the feasibility of incorporating recognizable driver's bioelectrical responses into advanced driver-assistance systems to carry out early detection of emergency braking situations which could be useful to reduce car accidents.

[1]  Long Tang,et al.  Instantaneous Real-Time Kinematic Decimeter-Level Positioning with BeiDou Triple-Frequency Signals over Medium Baselines , 2015, Sensors.

[2]  Tamitza Toroyan,et al.  Global status report on road safety , 2009, Injury Prevention.

[3]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[4]  A. Craig,et al.  Driver fatigue: electroencephalography and psychological assessment. , 2002, Psychophysiology.

[5]  Ron Chepesiuk.  Decibel Hell: The Effects of Living in a Noisy World , 2005, Environmental health perspectives.

[6]  Fátima Pereira da Silva.  Mental Workload, Task Demand and Driving Performance: What Relation?☆ , 2014 .

[7]  Simon G Hosking,et al.  Predicting driver drowsiness using vehicle measures: recent insights and future challenges. , 2009, Journal of safety research.

[8]  Dean P. Chiang,et al.  Braking Response Times for 100 Drivers in the Avoidance of an Unexpected Obstacle as Measured in a Driving Simulator , 1996 .

[9]  Fabio Babiloni,et al.  Evaluation of the workload and drowsiness during car driving by using high resolution EEG activity and neurophysiologic indices , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  Stefan Haufe,et al.  Detection of braking intention in diverse situations during simulated driving based on EEG feature combination , 2015, Journal of neural engineering.

[11]  Zuojin Li,et al.  Online Detection of Driver Fatigue Using Steering Wheel Angles for Real Driving Conditions , 2017, Sensors.

[12]  Rubén Usamentiaga,et al.  Driver Distraction Using Visual-Based Sensors and Algorithms , 2016, Sensors.

[13]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[14]  E. Petridou,et al.  Human factors in the causation of road traffic crashes , 2004, European Journal of Epidemiology.

[15]  Adnan Shaout,et al.  Advanced Driver Assistance Systems - Past, present and future , 2011, 2011 Seventh International Computer Engineering Conference (ICENCO'2011).

[16]  Petr Bouchner,et al.  DRIVER'S ATTENTION LEVEL IMPROVEMENT WITH USE OF , 2009 .

[17]  Ugur Halici,et al.  A novel deep learning approach for classification of EEG motor imagery signals , 2017, Journal of neural engineering.

[18]  M Congedo,et al.  A review of classification algorithms for EEG-based brain–computer interfaces , 2007, Journal of neural engineering.

[19]  David Ellis,et al.  Stress Detection Using Wearable Physiological and Sociometric Sensors , 2017, Int. J. Neural Syst..

[20]  Kenneth Sundaraj,et al.  Detecting Driver Drowsiness Based on Sensors: A Review , 2012, Sensors.

[21]  Luzheng Bi,et al.  A novel EEG-based detection method of emergency situations for assistive vehicles , 2017, 2017 Seventh International Conference on Information Science and Technology (ICIST).

[22]  M F Allnutt,et al.  Human factors in accidents* , 1987, British journal of anaesthesia.

[23]  L. Jazrawi,et al.  Braking Reaction Time After Right-Knee Anterior Cruciate Ligament Reconstruction: A Comparison of 3 Grafts. , 2017, Arthroscopy : the journal of arthroscopic & related surgery : official publication of the Arthroscopy Association of North America and the International Arthroscopy Association.

[24]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[25]  Thomas A. Dingus,et al.  Warning Signal Design: A Key Human Factors Issue in an In-Vehicle Front-To-Rear-End Collision Warning System , 1992 .

[26]  Stuart D Baulk,et al.  Awareness of sleepiness when driving. , 2004, Psychophysiology.

[27]  Wolfram Burgard,et al.  Deep learning with convolutional neural networks for EEG decoding and visualization , 2017, Human brain mapping.

[28]  Dick de Waard,et al.  Behavioural impacts of Advanced Driver Assistance Systems–an overview , 2019, European Journal of Transport and Infrastructure Research.

[29]  Karim Jerbi,et al.  Exceeding chance level by chance: The caveat of theoretical chance levels in brain signal classification and statistical assessment of decoding accuracy , 2015, Journal of Neuroscience Methods.

[30]  Stefan Haufe,et al.  EEG potentials predict upcoming emergency brakings during simulated driving , 2011, Journal of neural engineering.

[31]  J. Horne,et al.  Driver sleepiness--evaluation of reaction time measurement as a secondary task. , 2001, Sleep.

[32]  Ricardo Chavarriaga,et al.  Detecting Cognitive States for Enhancing Driving Experience , 2013 .

[33]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[34]  J L Kenemans,et al.  Event-related potentials and secondary task performance during simulated driving. , 2008, Accident; analysis and prevention.

[35]  Dot Hs,et al.  Automotive Collision Avoidance System Field Operational Test , 2002 .

[36]  H Summala,et al.  Fatal Accidents among Car and Truck Drivers: Effects of Fatigue, Age, and Alcohol Consumption , 1994, Human factors.

[37]  T. Kumada,et al.  Relationship between workload and mind-wandering in simulated driving , 2017, PloS one.

[38]  C. Vaughan,et al.  Rectification and non-linear pre-processing of EMG signals for cortico-muscular analysis , 2003, Journal of Neuroscience Methods.

[39]  I. Guyon,et al.  Handwritten digit recognition: applications of neural network chips and automatic learning , 1989, IEEE Communications Magazine.

[40]  T. Abe,et al.  Short sleep duration, sleep disorders, and traffic accidents , 2013 .

[41]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[42]  Zhangping Lu,et al.  Physiological signal analysis for fatigue level of experienced and inexperienced drivers , 2017, Traffic injury prevention.

[43]  Prof Arun S Tigadi.  ADVANCED DRIVER ASSISTANCE SYSTEMS , 2022 .

[44]  Michael I. Jordan,et al.  The Handbook of Brain Theory and Neural Networks , 2002 .

[45]  Mehdi Saffarian,et al.  Measuring drivers’ visual information needs during braking: A simulator study using a screen-occlusion method , 2015 .

[46]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[47]  S. Shrivastava,et al.  Global plan for the decade of action for road safety: Expectations from developing nations , 2014 .

[48]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[49]  S. Hart,et al.  Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research , 1988 .

[50]  Mahmood Fathy,et al.  A driver face monitoring system for fatigue and distraction detection , 2013 .

[51]  Laura Astolfi,et al.  Assessment of mental fatigue during car driving by using high resolution EEG activity and neurophysiologic indices , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[52]  H Sherk,et al.  Neural analysis of visual information during locomotion. , 2001, Progress in brain research.

[53]  Marc Green,et al.  "How Long Does It Take to Stop?" Methodological Analysis of Driver Perception-Brake Times , 2000 .

[54]  Fred Tam,et al.  Brain activity during driving with distraction: an immersive fMRI study , 2013, Front. Hum. Neurosci..

[55]  Christos Dimitrakakis,et al.  TORCS, The Open Racing Car Simulator , 2005 .

[56]  Rohan Chauhan,et al.  Advanced Driver Assistance Systems , 2016 .

[57]  Javier Mauricio Antelis,et al.  Discrimination Between Normal Driving and Braking Intention from Driver's Brain Signals , 2018, IWBBIO.

[58]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[59]  Andrew Liu,et al.  MODELING AND PREDICTION OF HUMAN DRIVER BEHAVIOR , 2001 .

[60]  Russ Greiner,et al.  Assessment of feature selection and classification methods for recognizing motor imagery tasks from electroencephalographic signals , 2016, Artif. Intell. Res..

[61]  Lanlan Chen,et al.  Automatic detection of alertness/drowsiness from physiological signals using wavelet-based nonlinear features and machine learning , 2015, Expert Syst. Appl..

[62]  Stefan Haufe,et al.  Electrophysiology-based detection of emergency braking intention in real-world driving , 2014, Journal of neural engineering.

[63]  S. G. Hart,et al.  Development of NASA-TLX(Task Load Index) , 1988 .

[64]  Yan Wu,et al.  Convolutional deep belief networks for feature extraction of EEG signal , 2014, 2014 International Joint Conference on Neural Networks (IJCNN).

[65]  Catherine Berthelon,et al.  Mental workload and driving , 2014, Front. Psychol..

[66]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.