Heavy Truck Driver's Drowsiness Detection Method Using Wearable EEG Based on Convolution Neural Network

Heavy truck drivers driving trucks under the situation of drowsiness can cause serious traffic accidents. In this paper, a heavy truck driver's drowsiness detection method using wearable electroencephalographic (EEG) based on convolution neural network (CNN) is proposed. The presented method consists of three parts: data collection using wearable EEG, heavy truck driver's drowsiness detection and the early warning strategy. Firstly, a homemade wearable brain computer interface (BCI) is used to monitor and collect the EEG signals in the simulation environment of drowsiness driving. Secondly, the neural networks with Inception module and improved AlexNet module are trained to classify the EEG signals. Finally, the early warning strategy module will function and it will sound an alarm if the heavy truck driver is judged as drowsy. The method was tested on driving EEG data from simulated drowsiness driving. The results show that using neural network with Inception module reached 95.59% correct classification in a one second time window and using improved AlexNet module reached 94.68%. The simulation and test results demonstrate the feasibility of the proposed drowsiness detection method for heavy truck driving safety.

[1]  Walid Mahdi,et al.  A visual based approach for drowsiness detection , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[2]  Hans P A Van Dongen,et al.  Efficient driver drowsiness detection at moderate levels of drowsiness. , 2013, Accident; analysis and prevention.

[3]  Mervyn V. M. Yeo,et al.  Can SVM be used for automatic EEG detection of drowsiness during car driving , 2009 .

[4]  Sahin Albayrak,et al.  Vehicles of the Future: A Survey of Research on Safety Issues , 2017, IEEE Transactions on Intelligent Transportation Systems.

[5]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[6]  Simon G Hosking,et al.  Predicting driver drowsiness using vehicle measures: recent insights and future challenges. , 2009, Journal of safety research.

[7]  Jie Lin,et al.  Towards Detection of Bus Driver Fatigue Based on Robust Visual Analysis of Eye State , 2017, IEEE Transactions on Intelligent Transportation Systems.

[8]  Shigeki Sugano,et al.  Multiclass Classification of Driver Perceived Workload Using Long Short-Term Memory based Recurrent Neural Network , 2018, 2018 IEEE Intelligent Vehicles Symposium (IV).

[9]  I. Johnstone,et al.  Ideal spatial adaptation by wavelet shrinkage , 1994 .

[10]  M. Amaç Güvensan,et al.  Driver Behavior Analysis for Safe Driving: A Survey , 2015, IEEE Transactions on Intelligent Transportation Systems.

[11]  Xiang Zhou,et al.  Vigilance detection method for high-speed rail using wireless wearable EEG collection technology based on low-rank matrix decomposition , 2018 .

[12]  Tzyy-Ping Jung,et al.  EEG-based prediction of driver's cognitive performance by deep convolutional neural network , 2016, Signal Process. Image Commun..

[13]  Chin-Teng Lin,et al.  Development of Wireless Brain Computer Interface With Embedded Multitask Scheduling and its Application on Real-Time Driver's Drowsiness Detection and Warning , 2008, IEEE Transactions on Biomedical Engineering.

[14]  Carryl L. Baldwin,et al.  Driver fatigue: The importance of identifying causal factors of fatigue when considering detection and countermeasure technologies , 2009 .

[15]  Azim Eskandarian,et al.  Effect of drowsiness on driving performance variables of commercial vehicle drivers , 2009 .

[16]  Slawomir Gruszczynski,et al.  Eye recognition in near-infrared images for driver's drowsiness monitoring , 2013, 2013 IEEE Intelligent Vehicles Symposium (IV).

[17]  Jiali Li,et al.  Design of a Fatigue Detection System for High-Speed Trains Based on Driver Vigilance Using a Wireless Wearable EEG , 2017, Sensors.

[18]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Mohan M. Trivedi,et al.  Robust and continuous estimation of driver gaze zone by dynamic analysis of multiple face videos , 2014, 2014 IEEE Intelligent Vehicles Symposium Proceedings.

[20]  Seong G. Kong,et al.  Visual Analysis of Eye State and Head Pose for Driver Alertness Monitoring , 2013, IEEE Transactions on Intelligent Transportation Systems.