Regression-Based Continuous Driving Fatigue Estimation: Toward Practical Implementation

Mental fatigue in drivers is one of the leading causes that give rise to traffic accidents. Electroencephalography (EEG)-based driving fatigue studies showed promising performance in fatigue monitoring. However, complex methodologies are not suitable for practical implementation. In our simulation-based setup that retained the constraints of real driving, we took a step closer to fatigue estimation in a practical scenario. We adopted a preprocessing pipeline with low computational complexity, which can be easily and practically implemented in real time. Moreover, regression-based continuous fatigue estimation was achieved using power spectral features in conjunction with time as the fatigue label. We sought to compare three regression models and three time windows to demonstrate their effects on the performance of fatigue estimation. Dynamic time warping was proposed as a new measure for evaluating the performance of fatigue estimation. The results derived from the validation of the proposed framework on 19 subjects showed that our proposed framework was promising toward practical implementation. Fatigue estimation by the support vector regression with radial basis function kernel and 5-s window length achieved the best performance. We also provided a comprehensive analysis on the spatial distribution of channels and frequency bands mostly contributing to fatigue estimation, which can inform the feature and channel reduction for real-time fatigue monitoring in practical driving. After reducing the number of electrodes by 75%, the proposed framework retained comparable performance in fatigue estimation. This paper demonstrates the feasibility and adaptability of our proposed framework in practical implementation of mental fatigue estimation.

[1]  Farookh Khadeer Hussain,et al.  Support vector regression with chaos-based firefly algorithm for stock market price forecasting , 2013, Appl. Soft Comput..

[2]  Nitish V. Thakor,et al.  Boosting Transfer Learning Improves Performance of Driving Drowsiness Classification Using EEG , 2018, 2018 International Workshop on Pattern Recognition in Neuroimaging (PRNI).

[3]  Ganesh R. Naik,et al.  Improving EEG-Based Driver Fatigue Classification Using Sparse-Deep Belief Networks , 2017, Front. Neurosci..

[4]  Fabio Babiloni,et al.  Assessment of driving fatigue based on intra/inter-region phase synchronization , 2017, Neurocomputing.

[5]  Tianwei Shi,et al.  Real-Time EEG-Based Detection of Fatigue Driving Danger for Accident Prediction , 2015, Int. J. Neural Syst..

[6]  Min Zhao,et al.  Multivariate autoregressive models and kernel learning algorithms for classifying driving mental fatigue based on electroencephalographic , 2011, Expert Syst. Appl..

[7]  Bao-Liang Lu,et al.  Driving fatigue detection with fusion of EEG and forehead EOG , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[8]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[9]  Nitish Thakor,et al.  Between-Frequency Topographical and Dynamic High-Order Functional Connectivity for Driving Drowsiness Assessment , 2019, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Chin-Teng Lin,et al.  Single channel wireless EEG device for real-time fatigue level detection , 2015, 2015 International Joint Conference on Neural Networks (IJCNN).

[11]  Rongrong Fu,et al.  Automated Detection of Driver Fatigue Based on Entropy and Complexity Measures , 2014, IEEE Transactions on Intelligent Transportation Systems.

[12]  Chin-Teng Lin,et al.  A Real-Time Wireless Brain–Computer Interface System for Drowsiness Detection , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[13]  E. L. Fisk,et al.  Fatigue in Industry. , 1922, American journal of public health.

[14]  S. Chiba,et al.  Dynamic programming algorithm optimization for spoken word recognition , 1978 .

[15]  Ashley Craig,et al.  Development of an algorithm for an EEG-based driver fatigue countermeasure. , 2003, Journal of safety research.

[16]  Hiroaki Sakoe,et al.  A Dynamic Programming Approach to Continuous Speech Recognition , 1971 .

[17]  Witold Pedrycz,et al.  Fuzzy clustering of time series data using dynamic time warping distance , 2015, Eng. Appl. Artif. Intell..

[18]  Lars Petersson,et al.  Vision in and out of Vehicles , 2003, IEEE Intell. Syst..

[19]  Sylvie Charbonnier,et al.  EEG index for control operators' mental fatigue monitoring using interactions between brain regions , 2016, Expert Syst. Appl..

[20]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[21]  K. Koçak,et al.  River flow prediction using hybrid models of support vector regression with the wavelet transform, singular spectrum analysis and chaotic approach , 2018, Meteorology and Atmospheric Physics.

[22]  Min Zhao,et al.  The Reorganization of Human Brain Networks Modulated by Driving Mental Fatigue , 2017, IEEE Journal of Biomedical and Health Informatics.

[23]  Yu Sun,et al.  Driving Mental Fatigue Classification Based on Brain Functional Connectivity , 2017, EANN.

[24]  T. Jung,et al.  Tonic, phasic, and transient EEG correlates of auditory awareness in drowsiness. , 1996, Brain research. Cognitive brain research.

[25]  A. Craig,et al.  Regional brain wave activity changes associated with fatigue. , 2012, Psychophysiology.

[26]  Rongrong Fu,et al.  Dynamic driver fatigue detection using hidden Markov model in real driving condition , 2016, Expert Syst. Appl..

[27]  Chin-Teng Lin,et al.  Real-time assessment of vigilance level using an innovative Mindo4 wireless EEG system , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[28]  Mohammad Reza Mohammadi,et al.  Investigation of mental fatigue through EEG signal processing based on nonlinear analysis: Symbolic dynamics , 2011 .

[29]  Rifai Chai,et al.  Driver Fatigue Classification With Independent Component by Entropy Rate Bound Minimization Analysis in an EEG-Based System , 2017, IEEE Journal of Biomedical and Health Informatics.

[30]  Indu P. Bodala,et al.  Measuring vigilance decrement using computer vision assisted eye tracking in dynamic naturalistic environments , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[31]  Nitish V. Thakor,et al.  Performance Improvement of Driving Fatigue Identification Based on Power Spectra and Connectivity Using Feature Level and Decision Level Fusions , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[32]  Yvonne Tran,et al.  A controlled investigation into the psychological determinants of fatigue , 2006, Biological Psychology.

[33]  Pierre Gançarski,et al.  Summarizing a set of time series by averaging: From Steiner sequence to compact multiple alignment , 2012, Theor. Comput. Sci..

[34]  Tzyy-Ping Jung,et al.  EURASIP Journal on Applied Signal Processing 2005:19, 3165–3174 c ○ 2005 Hindawi Publishing Corporation Estimating Driving Performance Based on EEG Spectrum Analysis , 2005 .

[35]  Nida Itrat Abbasi,et al.  Role of multisensory stimuli in vigilance enhancement- a single trial event related potential study , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[36]  Zheng Ming Xu,et al.  Strengthening association between driver drowsiness and its physiological predictors by combining EEG with measures of body movement , 2011, 7th International Conference on Broadband Communications and Biomedical Applications.

[37]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[38]  Chin-Teng Lin,et al.  Brain Dynamics in Predicting Driving Fatigue Using a Recurrent Self-Evolving Fuzzy Neural Network , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[39]  Mohammad Reza Sabour,et al.  Application of quadratic regression model for Fenton treatment of municipal landfill leachate. , 2012, Waste management.

[40]  Pierre Gançarski,et al.  A global averaging method for dynamic time warping, with applications to clustering , 2011, Pattern Recognit..

[41]  Fabio Babiloni,et al.  Investigating Driver Fatigue versus Alertness Using the Granger Causality Network , 2015, Sensors.

[42]  Wei Li,et al.  Evaluation of driver fatigue on two channels of EEG data , 2012, Neuroscience Letters.

[43]  Brent Lance,et al.  Driver Drowsiness Estimation From EEG Signals Using Online Weighted Adaptation Regularization for Regression (OwARR) , 2017, IEEE Transactions on Fuzzy Systems.

[44]  Nida Itrat Abbasi,et al.  A novel real-time driving fatigue detection system based on wireless dry EEG , 2018, Cognitive Neurodynamics.

[45]  Bao-Liang Lu,et al.  Detecting slow eye movement for recognizing driver's sleep onset period with EEG features , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).