Automatic Sleep Stage Classification Using Temporal Convolutional Neural Network and New Data Augmentation Technique from Raw Single-Channel EEG

BACKGROUND AND OBJECTIVE This paper presents a new framework for automatic classification of sleep stages using a deep learning algorithm from single-channel EEG signals. Each segmented EEG signal appended with its label of stages is fed into a deep learning model to create an automatic sleep stage classification. This is one of the most important problems that is critical to the realization of monitoring patients with sleep disorder. METHODS In the present study, a neural network architecture is introduced utilizing Convolutional Neural Networks (CNNs) to extract features, followed by Temporal Convolutional Neural Network to extract the temporal features from the extracted features vector of CNN. Finally, the performance of our model is improved by a Conditional Random Field layer. We also employed a new data augmentation technique to enhance the CNNs training which has auxiliary effects. RESULTS We evaluated our model by two different single-channel EEG signals (i.e., Fpz-Cz and Pz-Oz EEG channels) from two public sleep datasets, named Sleep-EDF-2013 and Sleep-EDF-2018. The evaluation results on both datasets showed that our model obtains the best total accuracy and kappa score (EDF-2013: 85.39%- 0.80, EDF-2018: 82.46%- 0.76) compared to the state-of-the-art methods. CONCLUSIONS This study will possibly allow us to have a wearable sleep monitoring system with a single-channel EEG. Also, unlike hand-crafted features methods, our model finds its own patterns through training epochs, and therefore, it may minimize engineering bias.

[1]  Timo Leppänen,et al.  Accurate Deep Learning-Based Sleep Staging in a Clinical Population With Suspected Obstructive Sleep Apnea , 2019, IEEE Journal of Biomedical and Health Informatics.

[2]  Zhong-Ke Gao,et al.  A Graph-Temporal Fused Dual-Input Convolutional Neural Network for Detecting Sleep Stages from EEG Signals , 2021, IEEE Transactions on Circuits and Systems - II - Express Briefs.

[3]  Carolina Ruiz,et al.  Deep Learning for Automated Feature Discovery and Classification of Sleep Stages , 2020, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[4]  Yike Guo,et al.  Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks , 2016, ArXiv.

[5]  Fenglong Ma,et al.  A hybrid self-attention deep learning framework for multivariate sleep stage classification , 2019, BMC Bioinformatics.

[6]  Yu-Liang Hsu,et al.  Automatic sleep stage recurrent neural classifier using energy features of EEG signals , 2013, Neurocomputing.

[7]  Nitish V. Thakor,et al.  Stable Electromyographic Sequence Prediction During Movement Transitions using Temporal Convolutional Networks , 2019, 2019 9th International IEEE/EMBS Conference on Neural Engineering (NER).

[8]  Zheru Chi,et al.  A Residual Based Attention Model for EEG Based Sleep Staging , 2020, IEEE Journal of Biomedical and Health Informatics.

[9]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Cheng Zhang,et al.  Sleep staging from single-channel EEG with multi-scale feature and contextual information , 2019, Sleep and Breathing.

[11]  Yi Wang,et al.  Ensemble learning algorithm based on multi-parameters for sleep staging , 2019, Medical & Biological Engineering & Computing.

[12]  Sepp Hochreiter,et al.  Self-Normalizing Neural Networks , 2017, NIPS.

[13]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[14]  Aeilko H. Zwinderman,et al.  Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG , 2000, IEEE Transactions on Biomedical Engineering.

[15]  C. O’Reilly,et al.  Montreal Archive of Sleep Studies: an open‐access resource for instrument benchmarking and exploratory research , 2014, Journal of sleep research.

[16]  U. Rajendra Acharya,et al.  Cascaded LSTM recurrent neural network for automated sleep stage classification using single-channel EEG signals , 2019, Comput. Biol. Medicine.

[17]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[19]  K. Müller,et al.  Automatic sleep stage classification using two-channel electro-oculography , 2007, Journal of Neuroscience Methods.

[20]  U Rajendra Acharya,et al.  A Deep Learning Model for Automated Sleep Stages Classification Using PSG Signals , 2019, International journal of environmental research and public health.

[21]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Xiang Zhang,et al.  HyCLASSS: A Hybrid Classifier for Automatic Sleep Stage Scoring , 2018, IEEE Journal of Biomedical and Health Informatics.

[23]  Xi Long,et al.  Cardiorespiratory Sleep Stage Detection Using Conditional Random Fields , 2017, IEEE Journal of Biomedical and Health Informatics.

[24]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[25]  Chao Wu,et al.  DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Sheng-Fu Liang,et al.  Automatic Stage Scoring of Single-Channel Sleep EEG by Using Multiscale Entropy and Autoregressive Models , 2012, IEEE Transactions on Instrumentation and Measurement.

[27]  Aki Vehtari,et al.  Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC , 2015, Statistics and Computing.

[28]  Yike Guo,et al.  Automatic Sleep Stage Scoring Using Time-Frequency Analysis and Stacked Sparse Autoencoders , 2015, Annals of Biomedical Engineering.

[29]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[30]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[31]  T Penzel,et al.  A review of signals used in sleep analysis , 2014, Physiological measurement.

[32]  Wanli Min,et al.  Subject-Adaptive Real-Time Sleep Stage Classification Based on Conditional Random Field , 2007, AMIA.

[33]  Vladlen Koltun,et al.  An Empirical Evaluation of Generic Convolutional and Recurrent Networks for Sequence Modeling , 2018, ArXiv.

[34]  Wei Chen,et al.  A Two-Stage Neural Network for Sleep Stage Classification Based on Feature Learning, Sequence Learning, and Data Augmentation , 2019, IEEE Access.

[35]  U. Rajendra Acharya,et al.  SleepEEGNet: Automated sleep stage scoring with sequence to sequence deep learning approach , 2019, PloS one.

[36]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[37]  Boris Hanin,et al.  Which Neural Net Architectures Give Rise To Exploding and Vanishing Gradients? , 2018, NeurIPS.

[38]  Maarten De Vos,et al.  Automatic Sleep Stage Classification Using Single-Channel EEG: Learning Sequential Features with Attention-Based Recurrent Neural Networks , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[39]  Asghar Zarei,et al.  Automatic Detection of Obstructive Sleep Apnea Using Wavelet Transform and Entropy-Based Features From Single-Lead ECG Signal , 2019, IEEE Journal of Biomedical and Health Informatics.

[40]  Chen Chen,et al.  A Hierarchical Neural Network for Sleep Stage Classification Based on Comprehensive Feature Learning and Multi-Flow Sequence Learning , 2020, IEEE Journal of Biomedical and Health Informatics.

[41]  Yan Li,et al.  Analysis and Classification of Sleep Stages Based on Difference Visibility Graphs From a Single-Channel EEG Signal , 2014, IEEE Journal of Biomedical and Health Informatics.

[42]  Yu Ma,et al.  Robust sleep stage classification with single-channel EEG signals using multimodal decomposition and HMM-based refinement , 2019, Expert Syst. Appl..

[43]  Yann Dauphin,et al.  Language Modeling with Gated Convolutional Networks , 2016, ICML.