Convolutional neural networks for sleep stage scoring on a two-channel EEG signal

Sleeping problems have become one of the major diseases all over the world. To tackle this issue, the basic tool used by specialists is the polysomnogram, which is a collection of different signals recorded during sleep. After its recording, the specialists have to score the different signals according to one of the standard guidelines. This process is carried out manually, which can be a high-time-consuming task and very prone to annotation errors. Therefore, over the years, many approaches have been explored in an attempt to support the specialists in this task. In this paper, an approach based on convolutional neural networks is presented, where an in-depth comparison is made in order to determine the convenience of using more than one signal simultaneously as input. This approach is similar to the one made in other problems although, additionally to those models, they were also used as parts of an ensemble model to check whether any useful information can be extracted from processing a single signal at a time which the dual-signal model cannot identify. Tests have been performed by using a well-known dataset called sleep-EDF-expanded, which is the most commonly used dataset as benchmark for this problem. The tests were carried out with a leave-one-out cross-validation over the patients, which ensures that there is no possible contamination between training and testing. The resulting proposal is a network smaller than previously published ones, but it overcomes the results of any previous models on the same dataset. The best result shows an accuracy of 92.67% and a Cohen’s kappa value over 0.84 compared to human experts.

[1]  Daniel Rivero,et al.  Classification of Two-channel Signals by Means of Genetic Programming , 2015, GECCO.

[2]  Yu-Liang Hsu,et al.  Automatic sleep stage recurrent neural classifier using energy features of EEG signals , 2013, Neurocomputing.

[3]  Dong Yu,et al.  Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition , 2012, IEEE Transactions on Audio, Speech, and Language Processing.

[4]  S V Selishchev,et al.  Classification of human sleep stages based on EEG processing using hidden Markov models , 2007, Meditsinskaia tekhnika.

[5]  Timothy J Cunningham,et al.  Trends in outpatient visits for insomnia, sleep apnea, and prescriptions for sleep medications among US adults: findings from the National Ambulatory Medical Care survey 1999-2010. , 2014, Sleep.

[6]  Geoffrey E. Hinton Deep belief networks , 2009, Scholarpedia.

[7]  Abdulhamit Subasi,et al.  Automatic identification of epileptic seizures from EEG signals using linear programming boosting , 2016, Comput. Methods Programs Biomed..

[8]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[9]  Ethem Alpaydin Combining Pattern Classifiers: Methods and Algorithms , 2004 .

[10]  Q. Gu,et al.  Prescription sleep aid use among adults: United States, 2005-2010. , 2013, NCHS data brief.

[11]  Yan Li,et al.  Analysis and Classification of Sleep Stages Based on Difference Visibility Graphs From a Single-Channel EEG Signal , 2014, IEEE Journal of Biomedical and Health Informatics.

[12]  Chao Wu,et al.  DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Tara N. Sainath,et al.  Deep Neural Networks for Acoustic Modeling in Speech Recognition: The Shared Views of Four Research Groups , 2012, IEEE Signal Processing Magazine.

[14]  Dimitrios I. Fotiadis,et al.  A Time-Frequency Based Method for the Detection of Epileptic Seizures in EEG Recordings , 2007, Twentieth IEEE International Symposium on Computer-Based Medical Systems (CBMS'07).

[15]  Daniel Rivero,et al.  Classification of signals by means of Genetic Programming , 2013, Soft Computing.

[16]  Rama Chellappa,et al.  HyperFace: A Deep Multi-Task Learning Framework for Face Detection, Landmark Localization, Pose Estimation, and Gender Recognition , 2019, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Laurent Vercueil,et al.  A convolutional neural network for sleep stage scoring from raw single-channel EEG , 2018, Biomed. Signal Process. Control..

[18]  Yike Guo,et al.  Automatic Sleep Stage Scoring Using Time-Frequency Analysis and Stacked Sparse Autoencoders , 2015, Annals of Biomedical Engineering.

[19]  D. Rapoport,et al.  Interobserver agreement among sleep scorers from different centers in a large dataset. , 2000, Sleep.

[20]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[21]  Sheng-Fu Liang,et al.  A rule-based automatic sleep staging method , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[22]  Mohammed Imamul Hassan Bhuiyan,et al.  On the classification of sleep states by means of statistical and spectral features from single channel Electroencephalogram , 2015, 2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[23]  M. Littner,et al.  Practice parameters for the evaluation of chronic insomnia. An American Academy of Sleep Medicine report. Standards of Practice Committee of the American Academy of Sleep Medicine. , 2000, Sleep.

[24]  Cabir Vural,et al.  Determination of Sleep Stage Separation Ability of Features Extracted from EEG Signals Using Principle Component Analysis , 2010, Journal of Medical Systems.

[25]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  U. Rajendra Acharya,et al.  Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals , 2017, Comput. Biol. Medicine.

[27]  Ahmet Alkan,et al.  Visual Interpretation of Biomedical Time Series Using Parzen Window-Based Density-Amplitude Domain Transformation , 2016, PloS one.

[28]  N. Smirnov Table for Estimating the Goodness of Fit of Empirical Distributions , 1948 .

[29]  Boualem Boashash,et al.  Automatic signal abnormality detection using time-frequency features and machine learning: A newborn EEG seizure case study , 2016, Knowl. Based Syst..

[30]  Ngianga-Bakwin Kandala,et al.  Sleep problems: an emerging global epidemic? Findings from the INDEPTH WHO-SAGE study among more than 40,000 older adults from 8 countries across Africa and Asia. , 2012, Sleep.

[31]  Poul Jennum,et al.  Inter-expert and intra-expert reliability in sleep spindle scoring , 2015, Clinical Neurophysiology.

[32]  J. Mattout,et al.  Automatic analysis of single-channel sleep EEG: validation in healthy individuals. , 2007, Sleep.

[33]  James C. Spall,et al.  Introduction to Stochastic Search and Optimization. Estimation, Simulation, and Control (Spall, J.C. , 2007 .

[34]  Mohammed Imamul Hassan Bhuiyan,et al.  Automated identification of sleep states from EEG signals by means of ensemble empirical mode decomposition and random under sampling boosting , 2017, Comput. Methods Programs Biomed..

[35]  Elif Derya íbeyli Lyapunov exponents/probabilistic neural networks for analysis of EEG signals , 2010 .

[36]  C. O’Reilly,et al.  Montreal Archive of Sleep Studies: an open‐access resource for instrument benchmarking and exploratory research , 2014, Journal of sleep research.

[37]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[38]  G. McLachlan Discriminant Analysis and Statistical Pattern Recognition , 1992 .

[39]  Sheng-Fu Liang,et al.  Automatic Stage Scoring of Single-Channel Sleep EEG by Using Multiscale Entropy and Autoregressive Models , 2012, IEEE Transactions on Instrumentation and Measurement.

[40]  Aeilko H. Zwinderman,et al.  Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG , 2000, IEEE Transactions on Biomedical Engineering.

[41]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[42]  Ludmila I. Kuncheva,et al.  A Theoretical Study on Six Classifier Fusion Strategies , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[43]  Mohammed Imamul Hassan Bhuiyan,et al.  Automatic sleep scoring using statistical features in the EMD domain and ensemble methods , 2016 .

[44]  Mohammed Imamul Hassan Bhuiyan,et al.  Computer-aided sleep staging using Complete Ensemble Empirical Mode Decomposition with Adaptive Noise and bootstrap aggregating , 2016, Biomed. Signal Process. Control..

[45]  Kunihiko Fukushima,et al.  Neocognitron: A self-organizing neural network model for a mechanism of pattern recognition unaffected by shift in position , 1980, Biological Cybernetics.

[46]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[47]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[48]  Dong Yu,et al.  Deep Learning: Methods and Applications , 2014, Found. Trends Signal Process..

[49]  Mohammed Imamul Hassan Bhuiyan,et al.  Automatic classification of sleep stages from single-channel electroencephalogram , 2015, 2015 Annual IEEE India Conference (INDICON).

[50]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[51]  Abdulhamit Subasi,et al.  A decision support system for automated identification of sleep stages from single-channel EEG signals , 2017, Knowl. Based Syst..

[52]  Conrad Iber,et al.  Das AASM-Manual zum Scoring von Schlaf und assoziierten Ereignissen , 2008 .

[53]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[54]  A. Hassan,et al.  A decision support system for automatic sleep staging from EEG signals using tunable Q-factor wavelet transform and spectral features , 2016, Journal of Neuroscience Methods.

[55]  Marina Ronzhina,et al.  Sleep scoring using artificial neural networks. , 2012, Sleep medicine reviews.

[56]  Shuicheng Yan,et al.  Learning Temporal Information for Brain-Computer Interface Using Convolutional Neural Networks , 2018, IEEE Transactions on Neural Networks and Learning Systems.

[57]  J. Samet,et al.  The Sleep Heart Health Study: design, rationale, and methods. , 1997, Sleep.

[58]  BoashashBoualem,et al.  Automatic signal abnormality detection using time-frequency features and machine learning , 2016 .