Innovative deep learning models for EEG-based vigilance detection

Electroencephalography (EEG) is one of the most signals used for studying and demonstrating the electrical activity of the brain due to the absence of side effects, its noninvasive nature and its well temporal resolution. Indeed, it provides real-time information, so it can be easily suitable for predicting drivers’ vigilance states. The classification of these states through this signal requires sophisticated approaches in order to achieve the best prediction performance. Furthermore, deep learning (DL) approaches have shown a good performance in learning the high-level features of the EEG signal and in resolving classification issues. In this paper, we will predict individuals’ states of vigilance based on the study of their brain activity by analyzing EEG signals using DL architectures. In fact, we propose two types of networks: (i) a 1D-UNet model, which is composed only of deep one-dimensional convolutional neural network (1D-CNN) layers and (ii) 1D-UNet-long short-term memory (1D-UNet-LSTM) that combines the proposed 1D-UNet architecture with the LSTM recurrent model. The experimental results reveal that the suggested models can stabilize the training model, well recognize the subject vigilance states and compete with the state of art on multiple performance metrics. The per-class average of precision and recall can be, respectively, up to 86% with 1D-UNet and 85% with 1D-UNet-LSTM, hence the effectiveness of the proposed methods. In order to complete our virtual prototyping and to get a real evaluation of our alert equipment, these proposed DL models are implemented also on a Raspberry Pi3 device allowing measuring the execution time necessary for predicting the state vigilance in real time.

[1]  Ravinder Agarwal,et al.  Classification of EEG signals using hybrid combination of features for lie detection , 2019, Neural Computing and Applications.

[2]  Milan Stehlík,et al.  “SPOCU”: scaled polynomial constant unit activation function , 2020, Neural Computing and Applications.

[3]  Alexandros T. Tzallas,et al.  Epileptic Seizures Classification Based on Long-Term EEG Signal Wavelet Analysis , 2017, BHI 2017.

[4]  Mohamed Bedoui Hedi,et al.  LVQ neural network optimized implementation on FPGA devices with multiple-wordlength operations for real-time systems , 2016, Neural Computing and Applications.

[5]  Jianfeng Zhao,et al.  Speech emotion recognition using deep 1D & 2D CNN LSTM networks , 2019, Biomed. Signal Process. Control..

[6]  Mohamed Akil,et al.  Implementation of an LVQ neural network with a variable size: algorithmic specification, architectural exploration and optimized implementation on FPGA devices , 2009, Neural Computing and Applications.

[7]  Mohammad A. Almogbel,et al.  EEG-signals based cognitive workload detection of vehicle driver using deep learning , 2018, 2018 20th International Conference on Advanced Communication Technology (ICACT).

[8]  H. Adeli,et al.  Fractality and a Wavelet-chaos-Methodology for EEG-based Diagnosis of Alzheimer Disease , 2011, Alzheimer disease and associated disorders.

[9]  Weidong Zhou,et al.  Epileptic EEG Identification via LBP Operators on Wavelet Coefficients , 2018, Int. J. Neural Syst..

[10]  U. Rajendra Acharya,et al.  An efficient compression of ECG signals using deep convolutional autoencoders , 2018, Cognitive Systems Research.

[11]  Qingshan Liu,et al.  Convolutional neural networks with large-margin softmax loss function for cognitive load recognition , 2017, 2017 36th Chinese Control Conference (CCC).

[12]  U. Raghavendra,et al.  A deep learning approach for Parkinson’s disease diagnosis from EEG signals , 2018, Neural Computing and Applications.

[13]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[14]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[15]  Patrick M. Pilarski,et al.  First steps towards an intelligent laser welding architecture using deep neural networks and reinforcement learning , 2014 .

[16]  Mehrdad Heydarzadeh,et al.  Automated EEG-Based Epileptic Seizure Detection Using Deep Neural Networks , 2017, 2017 IEEE International Conference on Healthcare Informatics (ICHI).

[17]  Onur Avci,et al.  1-D Convolutional Neural Networks for Signal Processing Applications , 2019, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[18]  U. Rajendra Acharya,et al.  A deep convolutional neural network model for automated identification of abnormal EEG signals , 2018, Neural Computing and Applications.

[19]  Tzyy-Ping Jung,et al.  EEG-based prediction of driver's cognitive performance by deep convolutional neural network , 2016, Signal Process. Image Commun..

[20]  Özal Yildirim,et al.  A novel wavelet sequence based on deep bidirectional LSTM network model for ECG signal classification , 2018, Comput. Biol. Medicine.

[21]  Guojun Dai,et al.  EEG classification of driver mental states by deep learning , 2018, Cognitive Neurodynamics.

[22]  Saeid Sanei,et al.  Deep learning for epileptic intracranial EEG data , 2016, 2016 IEEE 26th International Workshop on Machine Learning for Signal Processing (MLSP).

[23]  Christoph Lehmann,et al.  Application and comparison of classification algorithms for recognition of Alzheimer's disease in electrical brain activity (EEG) , 2007, Journal of Neuroscience Methods.

[24]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[25]  Mohamed Bedoui Hedi,et al.  Multi-width fixed-point coding based on reprogrammable hardware implementation of a multi-layer perceptron neural network for alertness classification , 2010, 2010 10th International Conference on Intelligent Systems Design and Applications.

[26]  Hao Dong,et al.  Mixed Neural Network Approach for Temporal Sleep Stage Classification , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  U. Rajendra Acharya,et al.  Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals , 2017, Comput. Biol. Medicine.

[29]  Ridha Djemal,et al.  Single-channel-based automatic drowsiness detection architecture with a reduced number of EEG features , 2018, Microprocess. Microsystems.

[30]  Guohui Zhang,et al.  Learning Convolutional Ranking-Score Function by Query Preference Regularization , 2017, IDEAL.

[31]  Taghi M. Khoshgoftaar,et al.  Deep learning applications and challenges in big data analytics , 2015, Journal of Big Data.

[32]  Luay Fraiwan,et al.  Neonatal sleep state identification using deep learning autoencoders , 2017, 2017 IEEE 13th International Colloquium on Signal Processing & its Applications (CSPA).

[33]  Jiawei Yang,et al.  Convolutional neural networks for seizure prediction using intracranial and scalp electroencephalogram , 2018, Neural Networks.

[34]  Onur Avci,et al.  1D Convolutional Neural Networks and Applications: A Survey , 2019, Mechanical Systems and Signal Processing.

[35]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[36]  Cüneyt Güzelis,et al.  Object recognition and detection with deep learning for autonomous driving applications , 2017, Simul..

[37]  F. Alexandre,et al.  Analysis of vigilance states by neural networks , 2004, Proceedings. 2004 International Conference on Information and Communication Technologies: From Theory to Applications, 2004..

[38]  Guohui Zhang,et al.  A Novel Image Tag Completion Method Based on Convolutional Neural Transformation , 2017, ICANN.

[39]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[40]  César Alexandre Teixeira,et al.  Application of self-organizing map to identify nocturnal epileptic seizures , 2017, Neural Computing and Applications.

[41]  U. Rajendra Acharya,et al.  Characterization of focal EEG signals: A review , 2019, Future Gener. Comput. Syst..

[42]  Yufei Huang,et al.  Driver's fatigue prediction by deep covariance learning from EEG , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[43]  Guohui Zhang,et al.  Cross-domain attribute representation based on convolutional neural network , 2018, ICIC.