Improving EEG-Based Driver Fatigue Classification Using Sparse-Deep Belief Networks

This paper presents an improvement of classification performance for electroencephalography (EEG)-based driver fatigue classification between fatigue and alert states with the data collected from 43 participants. The system employs autoregressive (AR) modeling as the features extraction algorithm, and sparse-deep belief networks (sparse-DBN) as the classification algorithm. Compared to other classifiers, sparse-DBN is a semi supervised learning method which combines unsupervised learning for modeling features in the pre-training layer and supervised learning for classification in the following layer. The sparsity in sparse-DBN is achieved with a regularization term that penalizes a deviation of the expected activation of hidden units from a fixed low-level prevents the network from overfitting and is able to learn low-level structures as well as high-level structures. For comparison, the artificial neural networks (ANN), Bayesian neural networks (BNN), and original deep belief networks (DBN) classifiers are used. The classification results show that using AR feature extractor and DBN classifiers, the classification performance achieves an improved classification performance with a of sensitivity of 90.8%, a specificity of 90.4%, an accuracy of 90.6%, and an area under the receiver operating curve (AUROC) of 0.94 compared to ANN (sensitivity at 80.8%, specificity at 77.8%, accuracy at 79.3% with AUC-ROC of 0.83) and BNN classifiers (sensitivity at 84.3%, specificity at 83%, accuracy at 83.6% with AUROC of 0.87). Using the sparse-DBN classifier, the classification performance improved further with sensitivity of 93.9%, a specificity of 92.3%, and an accuracy of 93.1% with AUROC of 0.96. Overall, the sparse-DBN classifier improved accuracy by 13.8, 9.5, and 2.5% over ANN, BNN, and DBN classifiers, respectively.

[1]  Ashley Craig,et al.  Development of an algorithm for an EEG-based driver fatigue countermeasure. , 2003, Journal of safety research.

[2]  Jonathan R Wolpaw,et al.  Sensorimotor rhythm-based brain–computer interface (BCI): model order selection for autoregressive spectral analysis , 2008, Journal of neural engineering.

[3]  Chin-Teng Lin,et al.  An EEG-based perceptual function integration network for application to drowsy driving , 2015, Knowl. Based Syst..

[4]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[5]  Hung T. Nguyen,et al.  Intelligent technologies for real-time biomedical engineering applications , 2008, Int. J. Autom. Control..

[6]  Chin-Teng Lin,et al.  A Real-Time Wireless Brain–Computer Interface System for Drowsiness Detection , 2010, IEEE Transactions on Biomedical Circuits and Systems.

[7]  Rongrong Fu,et al.  Automated Detection of Driver Fatigue Based on Entropy and Complexity Measures , 2014, IEEE Transactions on Intelligent Transportation Systems.

[8]  Tomasz Stańczyk,et al.  Driver reaction time to lateral entering pedestrian in a simulated crash traffic situation , 2014 .

[9]  Andreas Schulze-Bonhage,et al.  Reaching Movement Onset- and End-Related Characteristics of EEG Spectral Power Modulations , 2012, Front. Neurosci..

[10]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[11]  G. Borghini,et al.  Neuroscience and Biobehavioral Reviews , 2022 .

[12]  Dongrui Wu,et al.  Online and Offline Domain Adaptation for Reducing BCI Calibration Effort , 2017, IEEE Transactions on Human-Machine Systems.

[13]  Ward Vanlaar,et al.  Fatigued and drowsy driving: a survey of attitudes, opinions and behaviors. , 2008, Journal of safety research.

[14]  Eric Leuthardt,et al.  An Offline Evaluation of the Autoregressive Spectrum for Electrocorticography , 2009, IEEE Transactions on Biomedical Engineering.

[15]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[16]  Jon Touryan,et al.  Estimating endogenous changes in task performance from EEG , 2014, Front. Neurosci..

[17]  Tobi Delbruck,et al.  Real-time classification and sensor fusion with a spiking deep belief network , 2013, Front. Neurosci..

[18]  Wei Li,et al.  Driver fatigue evaluation model with integration of multi-indicators based on dynamic Bayesian network , 2015 .

[19]  P. G. Student,et al.  DRIVER FATIGUE AND DROWSINESS MONITORING SYSTEM , 2015 .

[20]  A. Craig,et al.  A critical review of the psychophysiology of driver fatigue , 2001, Biological Psychology.

[21]  Steve B. Furber,et al.  Robustness of spiking Deep Belief Networks to noise and reduced bit precision of neuro-inspired hardware platforms , 2015, Front. Neurosci..

[22]  Krzysztof J Cios,et al.  Epileptic seizure detection. , 2007, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[23]  Dong Yu,et al.  Investigation of full-sequence training of deep belief networks for speech recognition , 2010, INTERSPEECH.

[24]  Tzyy-Ping Jung,et al.  EURASIP Journal on Applied Signal Processing 2005:19, 3165–3174 c ○ 2005 Hindawi Publishing Corporation Estimating Driving Performance Based on EEG Spectrum Analysis , 2005 .

[25]  S. Goldsack,et al.  IN REAL-TIME , 2008 .

[26]  Brent Lance,et al.  Transfer learning and active transfer learning for reducing calibration data in single-trial classification of visually-evoked potentials , 2014, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[27]  A. Craig,et al.  Regional brain wave activity changes associated with fatigue. , 2012, Psychophysiology.

[28]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[29]  Yvonne Tran,et al.  The Relationship Between Spectral Changes in Heart Rate Variability and Fatigue , 2009 .

[30]  Rabab K. Ward,et al.  User Customization of the Feature Generator of an Asynchronous Brain Interface , 2006, Annals of Biomedical Engineering.

[31]  Alexander J. Casson,et al.  Artificial Neural Network classification of operator workload with an assessment of time variation and noise-enhancement to increase performance , 2014, Front. Neurosci..

[32]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[33]  Yoshua. Bengio,et al.  Learning Deep Architectures for AI , 2007, Found. Trends Mach. Learn..

[34]  Akebo Yamakami,et al.  Fuzzy Receiver Operating Characteristic Curve: An Option to Evaluate Diagnostic Tests , 2007, IEEE Transactions on Information Technology in Biomedicine.

[35]  Yvonne Tran,et al.  A controlled investigation into the psychological determinants of fatigue , 2006, Biological Psychology.

[36]  Rifai Chai,et al.  Driver Fatigue Classification With Independent Component by Entropy Rate Bound Minimization Analysis in an EEG-Based System , 2017, IEEE Journal of Biomedical and Health Informatics.

[37]  Translation of EEG-Based Performance Prediction Models to Rapid Serial Visual Presentation Tasks , 2013, HCI.

[38]  Brendan Z. Allison,et al.  Is It Significant? Guidelines for Reporting BCI Performance , 2012 .

[39]  Clemens Brunner,et al.  A comparison of univariate, vector, bilinear autoregressive, and band power features for brain–computer interfaces , 2011, Medical & Biological Engineering & Computing.

[40]  Gerald Matthews,et al.  The Handbook of Operator Fatigue , 2012 .

[41]  Chun-Hsiang Chuang,et al.  Wireless and Wearable EEG System for Evaluating Driver Vigilance , 2014, IEEE Transactions on Biomedical Circuits and Systems.

[42]  Geoffrey E. Hinton Reducing the Dimensionality of Data with Neural , 2008 .

[43]  Yvonne Tran,et al.  The psychophysiological determinants of fatigue. , 2007, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[44]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[45]  Cheng-Chi Tai,et al.  AN IMPROVED AND PORTABLE EYE-BLINK DURATION DETECTION SYSTEM TO WARN OF DRIVER FATIGUE , 2013 .

[46]  Wan-Young Chung,et al.  Driver Alertness Monitoring Using Fusion of Facial Features and Bio-Signals , 2012, IEEE Sensors Journal.

[47]  Dongrui Wu,et al.  Improved Neural Signal Classification in a Rapid Serial Visual Presentation Task Using Active Learning , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[48]  Chun-Xia Zhang,et al.  A sparse-response deep belief network based on rate distortion theory , 2014, Pattern Recognit..

[49]  Charles X. Ling,et al.  Using AUC and accuracy in evaluating learning algorithms , 2005, IEEE Transactions on Knowledge and Data Engineering.

[50]  David Cella,et al.  How item banks and their application can influence measurement practice in rehabilitation medicine: a PROMIS fatigue item bank example. , 2011, Archives of physical medicine and rehabilitation.

[51]  Wentao Huang,et al.  Classifying Driving Fatigue Based on Combined Entropy Measure Using EEG Signals , 2016 .

[52]  Reflection Coefficients,et al.  A. real-time , 1982 .

[53]  Gang Bao,et al.  Epileptic Seizure Detection Based on Partial Directed Coherence Analysis , 2016, IEEE Journal of Biomedical and Health Informatics.

[54]  Wan-Young Chung,et al.  Driver fatigue and drowsiness monitoring system with embedded electrocardiogram sensor on steering wheel , 2014 .