Intra- and Inter-epoch Temporal Context Network (IITNet) for Automatic Sleep Stage Scoring

This study proposes a novel deep learning model, called IITNet, to learn intra- and inter-epoch temporal contexts from a raw single channel electroencephalogram (EEG) for automatic sleep stage scoring. When sleep experts identify the sleep stage of a 30-second PSG data called an epoch, they investigate the sleep-related events such as sleep spindles, K-complex, and frequency components from local segments of an epoch (sub-epoch) and consider the relations between sleep-related events of successive epochs to follow the transition rules. Inspired by this, IITNet learns how to encode sub-epoch into representative feature via a deep residual network, then captures contextual information in the sequence of representative features via BiLSTM. Thus, IITNet can extract features in sub-epoch level and consider temporal context not only between epochs but also in an epoch. IITNet is an end-to-end architecture and does not need any preprocessing, handcrafted feature design, balanced sampling, pre-training, or fine-tuning. Our model was trained and evaluated in Sleep-EDF and MASS datasets and outperformed other state-of-the-art results on both the datasets with the overall accuracy (ACC) of 84.0% and 86.6%, macro F1-score (MF1) of 77.7 and 80.8, and Cohen's kappa of 0.78 and 0.80 in Sleep-EDF and MASS, respectively.

[1]  Jürgen Schmidhuber,et al.  Learning Precise Timing with LSTM Recurrent Networks , 2003, J. Mach. Learn. Res..

[2]  Guy Lapalme,et al.  A systematic analysis of performance measures for classification tasks , 2009, Inf. Process. Manag..

[3]  Amy Loutfi,et al.  Sleep Stage Classification Using Unsupervised Feature Learning , 2012, Adv. Artif. Neural Syst..

[4]  Karim Jerbi,et al.  Learning machines and sleeping brains: Automatic sleep stage classification using decision-tree multi-class support vector machines , 2015, Journal of Neuroscience Methods.

[5]  Mohammed Imamul Hassan Bhuiyan,et al.  Computer-aided sleep staging using Complete Ensemble Empirical Mode Decomposition with Adaptive Noise and bootstrap aggregating , 2016, Biomed. Signal Process. Control..

[6]  Yann LeCun,et al.  Classification of patterns of EEG synchronization for seizure prediction , 2009, Clinical Neurophysiology.

[7]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[8]  Jimeng Sun,et al.  SLEEPNET: Automated Sleep Staging System via Deep Learning , 2017, ArXiv.

[9]  Hao Dong,et al.  Mixed Neural Network Approach for Temporal Sleep Stage Classification , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Geoffrey E. Hinton,et al.  Speech recognition with deep recurrent neural networks , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Jiasen Lu,et al.  Hierarchical Question-Image Co-Attention for Visual Question Answering , 2016, NIPS.

[12]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[13]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[14]  A. Rechtschaffen A manual of Standardized Terminology , 1968 .

[15]  A. Hassan,et al.  A decision support system for automatic sleep staging from EEG signals using tunable Q-factor wavelet transform and spectral features , 2016, Journal of Neuroscience Methods.

[16]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[17]  B. Koley,et al.  An ensemble system for automatic sleep stage classification using single channel EEG signal , 2012, Comput. Biol. Medicine.

[18]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[19]  Natheer Khasawneh,et al.  Automated sleep stage identification system based on time-frequency analysis of a single EEG channel and random forest classifier , 2012, Comput. Methods Programs Biomed..

[20]  Laurent Vercueil,et al.  A convolutional neural network for sleep stage scoring from raw single-channel EEG , 2018, Biomed. Signal Process. Control..

[21]  Yike Guo,et al.  Automatic Sleep Stage Scoring Using Time-Frequency Analysis and Stacked Sparse Autoencoders , 2015, Annals of Biomedical Engineering.

[22]  Yan Li,et al.  Analysis and Classification of Sleep Stages Based on Difference Visibility Graphs From a Single-Channel EEG Signal , 2014, IEEE Journal of Biomedical and Health Informatics.

[23]  Jürgen Schmidhuber,et al.  Framewise phoneme classification with bidirectional LSTM and other neural network architectures , 2005, Neural Networks.

[24]  Oliver Y. Chén,et al.  SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Xiang Bai,et al.  An End-to-End Trainable Neural Network for Image-Based Sequence Recognition and Its Application to Scene Text Recognition , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Sheng-Fu Liang,et al.  Automatic Stage Scoring of Single-Channel Sleep EEG by Using Multiscale Entropy and Autoregressive Models , 2012, IEEE Transactions on Instrumentation and Measurement.

[27]  Djordje Popovic,et al.  Scoring accuracy of automated sleep staging from a bipolar electroocular recording compared to manual scoring by multiple raters. , 2013, Sleep medicine.

[28]  Aeilko H. Zwinderman,et al.  Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG , 2000, IEEE Transactions on Biomedical Engineering.

[29]  Justin A. Blanco,et al.  Modeling electroencephalography waveforms with semi-supervised deep belief nets: fast classification and anomaly measurement , 2011, Journal of neural engineering.

[30]  Chen Sun,et al.  Rethinking Spatiotemporal Feature Learning For Video Understanding , 2017, ArXiv.

[31]  A. Chesson,et al.  The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Techinical Specifications , 2007 .

[32]  R. Foster,et al.  Sleep and circadian rhythm disruption in psychiatric and neurodegenerative disease , 2010, Nature Reviews Neuroscience.

[33]  Rajeev Sharma,et al.  Automatic sleep stages classification based on iterative filtering of electroencephalogram signals , 2017, Neural Computing and Applications.

[34]  Chao Wu,et al.  DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[35]  Oliver Y. Chén,et al.  Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification , 2018, IEEE Transactions on Biomedical Engineering.

[36]  C. O’Reilly,et al.  Montreal Archive of Sleep Studies: an open‐access resource for instrument benchmarking and exploratory research , 2014, Journal of sleep research.

[37]  Lars Kai Hansen,et al.  Deep convolutional neural networks for interpretable analysis of EEG sleep stage scoring , 2017, 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP).

[38]  Mohammad Torabi-Nami,et al.  Withstanding the obstructive sleep apnea syndrome at the expense of arousal instability, altered cerebral autoregulation and neurocognitive decline. , 2015, Journal of integrative neuroscience.

[39]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[40]  Ran Manor,et al.  Convolutional Neural Network for Multi-Category Rapid Serial Visual Presentation BCI , 2015, Front. Comput. Neurosci..

[41]  Miad Faezipour,et al.  Sleep Stage Classification Using EEG Signal Analysis: A Comprehensive Survey and New Investigation , 2016, Entropy.

[42]  R. Rosenberg,et al.  The American Academy of Sleep Medicine inter-scorer reliability program: sleep stage scoring. , 2013, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[43]  J. Mattout,et al.  Automatic analysis of single-channel sleep EEG: validation in healthy individuals. , 2007, Sleep.

[44]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[45]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[46]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .

[47]  Yu-Liang Hsu,et al.  Automatic sleep stage recurrent neural classifier using energy features of EEG signals , 2013, Neurocomputing.

[48]  Hubert Cecotti,et al.  Convolutional Neural Networks for P300 Detection with Application to Brain-Computer Interfaces , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  Lucas C. Parra,et al.  Recipes for the linear analysis of EEG , 2005, NeuroImage.

[50]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).