Dynamically Weighted Ensemble-based Prediction System for Adaptively Modeling Driver Reaction Time

Predicting a driver's cognitive state, or more specifically, modeling a driver's reaction time (RT) in response to the appearance of a potential hazard warrants urgent research. In the last two decades, the electric field that is generated by the activities in the brain, monitored by an electroencephalogram (EEG), has been proven to be a robust physiological indicator of human behavior. However, mapping the human brain can be extremely challenging, especially owing to the variability in human beings over time, both within and among individuals. Factors such as fatigue, inattention and stress can induce homeostatic changes in the brain, which affect the observed relationship between brain dynamics and behavioral performance, and thus make the existing systems for predicting RT difficult to generalize. To solve this problem, an ensemble-based weighted prediction system is presented herein. This system comprises a set of prediction submodels that are individually trained using groups of data with similar EEG-RT relationships. To obtain a final prediction, the prediction outcomes of the sub-models are then multiplied by weights that are derived from the EEG alpha coherences of 10 channels plus theta band powers of 30 channels, whose changes were found to be indicators of variations in the EEG-RT relationship. The results thus obtained reveal that the proposed system with a time-varying adaptive weighting mechanism significantly outperforms the conventional system in modeling a driver's RT. The adaptive design of the proposed system demonstrates its feasibility in coping with the variability in the brain-behavior relationship. In this contribution surprisingly simple EEG-based adaptive methods are used in combination with an ensemble scheme to significantly increase system performance.

[1]  Mervyn V. M. Yeo,et al.  Can SVM be used for automatic EEG detection of drowsiness during car driving , 2009 .

[2]  S Pozzi,et al.  A passive brain-computer interface application for the mental workload assessment on professional air traffic controllers during realistic air traffic control tasks. , 2016, Progress in brain research.

[3]  Siobhan Banks,et al.  Low levels of alcohol impair driving simulator performance and reduce perception of crash risk in partially sleep deprived subjects. , 2004, Sleep.

[4]  Fabio Babiloni,et al.  Passive BCI in Operational Environments: Insights, Recent Advances, and Future Trends , 2017, IEEE Transactions on Biomedical Engineering.

[5]  Jacques Bergeron,et al.  Monotony of road environment and driver fatigue: a simulator study. , 2003, Accident; analysis and prevention.

[6]  Tzyy-Ping Jung,et al.  EURASIP Journal on Applied Signal Processing 2005:19, 3165–3174 c ○ 2005 Hindawi Publishing Corporation Estimating Driving Performance Based on EEG Spectrum Analysis , 2005 .

[7]  M. Ferrara,et al.  How much sleep do we need? , 2001, Sleep Medicine Reviews.

[8]  Li-Wei Ko,et al.  EEG-Based Assessment of Driver Cognitive Responses in a Dynamic Virtual-Reality Driving Environment , 2007, IEEE Transactions on Biomedical Engineering.

[9]  K. Inanaga,et al.  Frontal midline theta rhythm and mental activity , 1998, Psychiatry and Clinical Neurosciences.

[10]  Tzyy-Ping Jung,et al.  Mind-Wandering Tends to Occur under Low Perceptual Demands during Driving , 2016, Scientific Reports.

[11]  Evangelos Bekiaris,et al.  Using EEG spectral components to assess algorithms for detecting fatigue , 2009, Expert Syst. Appl..

[12]  Madhu Sharma,et al.  Detection of Drowsiness and Fatigue level of Driver , 2015 .

[13]  Tzyy-Ping Jung,et al.  Tonic Changes in EEG Power Spectra during Simulated Driving , 2009, HCI.

[14]  Bernhard Schölkopf,et al.  A tutorial on support vector regression , 2004, Stat. Comput..

[15]  Yang Wang,et al.  Assessing global risk factors for non-fatal injuries from road traffic accidents and falls in adults aged 35–70 years in 17 countries: a cross-sectional analysis of the Prospective Urban Rural Epidemiological (PURE) study , 2015, Injury Prevention.

[16]  Gérard Dray,et al.  An adaptive accuracy-weighted ensemble for inter-subjects classification in brain-computer interfacing , 2015, 2015 7th International IEEE/EMBS Conference on Neural Engineering (NER).

[17]  Chin-Teng Lin,et al.  Multi-channel EEG recordings during a sustained-attention driving task , 2018, Scientific Data.

[18]  Kyoko Idogawa ON THE BRAIN WAVE ACTIVITY OF PROFESSIONAL DRIVERS DURING MONOTONOUS WORK , 1991 .

[19]  Chun-Hsiang Chuang,et al.  Neurocognitive Characteristics of the Driver: A Review on Drowsiness, Distraction, Navigation, and Motion Sickness , 2012 .

[20]  Lewis B. Sheiner,et al.  Some suggestions for measuring predictive performance , 1981, Journal of Pharmacokinetics and Biopharmaceutics.

[21]  Eli Peli,et al.  Methods for Automated Identification of Informative Behaviors in Natural Bioptic Driving , 2012, IEEE Transactions on Biomedical Engineering.

[22]  J. Habbema,et al.  Internal validation of predictive models: efficiency of some procedures for logistic regression analysis. , 2001, Journal of clinical epidemiology.

[23]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[24]  F Sagberg,et al.  Road accidents caused by drivers falling asleep. , 1999, Accident; analysis and prevention.

[25]  F. Varela,et al.  Measuring phase synchrony in brain signals , 1999, Human brain mapping.

[26]  Eric Laciar,et al.  Automatic detection of drowsiness in EEG records based on multimodal analysis. , 2014, Medical engineering & physics.

[27]  Chris Berka,et al.  Drowsiness/alertness algorithm development and validation using synchronized EEG and cognitive performance to individualize a generalized model , 2011, Biological Psychology.

[28]  Kai-Quan Shen,et al.  EEG-based mental fatigue measurement using multi-class support vector machines with confidence estimate , 2008, Clinical Neurophysiology.

[29]  A. Muzet,et al.  Correlation between driving errors and vigilance level: influence of the driver's age , 2004, Physiology & Behavior.

[30]  A. Muzet,et al.  Effect of driving duration and partial sleep deprivation on subsequent alertness and performance of car drivers , 2005, Physiology & Behavior.

[31]  Keiichi Uchimura,et al.  Driver Inattention Monitoring System for Intelligent Vehicles: A Review , 2009, IEEE Transactions on Intelligent Transportation Systems.

[32]  R. Heinzer,et al.  [Driver fatigue]. , 2007, Revue medicale suisse.

[33]  José del R. Millán,et al.  Improving Human Performance in a Real Operating Environment through Real-Time Mental Workload Detection , 2007 .

[34]  Chin-Teng Lin,et al.  A Real-Time Wireless Brain–Computer Interface System for Drowsiness Detection , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[35]  William J. Horrey,et al.  The challenges and opportunities of technological approaches to fatigue management. , 2011, Accident; analysis and prevention.

[36]  Min Zhao,et al.  Multivariate autoregressive models and kernel learning algorithms for classifying driving mental fatigue based on electroencephalographic , 2011, Expert Syst. Appl..

[37]  Domen Novak,et al.  Identifying the Causes of Drivers’ Hazardous States Using Driver Characteristics, Vehicle Kinematics, and Physiological Measurements , 2018, Front. Neurosci..

[38]  Chun-Hsiang Chuang,et al.  Wireless and Wearable EEG System for Evaluating Driver Vigilance , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[39]  William J Horrey,et al.  Future directions in fatigue and safety research. , 2011, Accident; analysis and prevention.

[40]  M. Chung,et al.  Electroencephalographic study of drowsiness in simulated driving with sleep deprivation , 2005 .

[41]  Chun-Hsiang Chuang,et al.  Brain Electrodynamic and Hemodynamic Signatures Against Fatigue During Driving , 2018, Front. Neurosci..

[42]  D. Dinges,et al.  Maximizing sensitivity of the psychomotor vigilance test (PVT) to sleep loss. , 2011, Sleep.

[43]  Tzyy-Ping Jung,et al.  Adaptive EEG-Based Alertness Estimation System by Using ICA-Based Fuzzy Neural Networks , 2006, IEEE Transactions on Circuits and Systems I: Regular Papers.

[44]  Luis M. Bergasa,et al.  Controlled inducement and measurement of drowsiness in a driving simulator , 2010 .

[45]  Ashley Craig,et al.  Development of an algorithm for an EEG-based driver fatigue countermeasure. , 2003, Journal of safety research.

[46]  Tzyy-Ping Jung,et al.  Tonic and phasic EEG and behavioral changes induced by arousing feedback , 2010, NeuroImage.

[47]  W. Klimesch,et al.  EEG alpha oscillations: The inhibition–timing hypothesis , 2007, Brain Research Reviews.

[48]  Tzyy-Ping Jung,et al.  EEG-based drowsiness estimation for safety driving using independent component analysis , 2005, IEEE Transactions on Circuits and Systems I: Regular Papers.

[49]  Amit Shahar,et al.  Risk perception of driving as a function of advanced training aimed at recognizing and handling risks in demanding driving situations. , 2008, Accident; analysis and prevention.

[50]  Roman Rosipal,et al.  EEG-Based Drivers' Drowsiness Monitoring Using a Hierarchical Gaussian Mixture Model , 2007, HCI.

[51]  M. Chavent,et al.  ClustOfVar: An R Package for the Clustering of Variables , 2011, 1112.0295.

[52]  Nilanjan Sarkar,et al.  EEG-Based Affect and Workload Recognition in a Virtual Driving Environment for ASD Intervention , 2018, IEEE Transactions on Biomedical Engineering.

[53]  Scott E. Kerick,et al.  Review of Fatigue Management Technologies for Enhanced Military Vehicle Safety and Performance , 2013 .

[54]  Gamini Dissanayake,et al.  Driver Drowsiness Classification Using Fuzzy Wavelet-Packet-Based Feature-Extraction Algorithm , 2011, IEEE Transactions on Biomedical Engineering.

[55]  Darrell S Bowman,et al.  Development and Assessment of a Driver Drowsiness Monitoring System , 2012 .

[56]  S. MacDonald,et al.  Intra-individual variability in behavior: links to brain structure, neurotransmission and neuronal activity , 2006, Trends in Neurosciences.