Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning

BACKGROUND Despite recent significant progress in the development of automatic sleep staging methods, building a good model still remains a big challenge for sleep studies with a small cohort due to the data-variability and data-inefficiency issues. This work presents a deep transfer learning approach to overcome these issues and enable transferring knowledge from a large dataset to a small cohort for automatic sleep staging. METHODS We start from a generic end-to-end deep learning framework for sequence-to-sequence sleep staging and derive two networks as the means for transfer learning. The networks are first trained in the source domain (i.e. the large database). The pretrained networks are then finetuned in the target domain (i.e. the small cohort) to complete knowledge transfer. We employ the Montreal Archive of Sleep Studies (MASS) database consisting of 200 subjects as the source domain and study deep transfer learning on three different target domains: the Sleep Cassette subset and the Sleep Telemetry subset of the Sleep-EDF Expanded database, and the Surrey-cEEGrid database. The target domains are purposely adopted to cover different degrees of data mismatch to the source domains. RESULTS Our experimental results show significant performance improvement on automatic sleep staging on the target domains achieved with the proposed deep transfer learning approach. CONCLUSIONS These results suggest the efficacy of the proposed approach in addressing the above-mentioned data-variability and data-inefficiency issues. SIGNIFICANCE As a consequence, it would enable one to improve the quality of automatic sleep staging models when the amount of data is relatively small.

[1]  Maarten De Vos,et al.  Multichannel Sleep Stage Classification and Transfer Learning using Convolutional Neural Networks , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[2]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[3]  Oliver Y. Chén,et al.  Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification , 2018, IEEE Transactions on Biomedical Engineering.

[4]  Huy Phan,et al.  Recurrent Neural Network Based Early Prediction of Future Hand Movements , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[5]  Preben Kidmose,et al.  A Study of Evoked Potentials From Ear-EEG , 2013, IEEE Transactions on Biomedical Engineering.

[6]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[7]  Julie A. E. Christensen,et al.  A Noise-Assisted Data Analysis Method for Automatic EOG-Based Sleep Stage Classification Using Ensemble Learning , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Mark A. Clements,et al.  Sleep stage classification with cross frequency coupling , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  B. Koley,et al.  An ensemble system for automatic sleep stage classification using single channel EEG signal , 2012, Comput. Biol. Medicine.

[10]  Kaare B. Mikkelsen,et al.  Personalizing deep learning models for automatic sleep staging , 2018, 1801.02645.

[11]  Maarten De Vos,et al.  Visualising convolutional neural network decisions in automated sleep scoring , 2018, AIH@IJCAI.

[12]  Maarten De Vos,et al.  DNN Filter Bank Improves 1-Max Pooling CNN for Single-Channel EEG Automatic Sleep Stage Classification , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[13]  Hao Dong,et al.  Mixed Neural Network Approach for Temporal Sleep Stage Classification , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  D. Dijk,et al.  Modelling changes in sleep timing and duration across the lifespan: Changes in circadian rhythmicity or sleep homeostasis? , 2016, Sleep medicine reviews.

[15]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[16]  Seunghyeok Back,et al.  Intra- and Inter-epoch Temporal Context Network (IITNet) for Automatic Sleep Stage Scoring , 2019, ArXiv.

[17]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  Semi-Supervised Sleep-Stage Scoring Based on Single Channel EEG , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[19]  Aaron C. Courville,et al.  Recurrent Batch Normalization , 2016, ICLR.

[20]  Maarten De Vos,et al.  Automatic Sleep Stage Classification Using Single-Channel EEG: Learning Sequential Features with Attention-Based Recurrent Neural Networks , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[21]  José Luis Rodríguez-Sotelo,et al.  Automatic Sleep Stages Classification Using EEG Entropy Features and Unsupervised Pattern Analysis Techniques , 2014, Entropy.

[22]  Aeilko H. Zwinderman,et al.  Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG , 2000, IEEE Transactions on Biomedical Engineering.

[23]  Poul Jennum,et al.  Neural network analysis of sleep stages enables efficient diagnosis of narcolepsy , 2017, Nature Communications.

[24]  C. O’Reilly,et al.  Montreal Archive of Sleep Studies: an open‐access resource for instrument benchmarking and exploratory research , 2014, Journal of sleep research.

[25]  Miad Faezipour,et al.  Sleep Stage Classification Using EEG Signal Analysis: A Comprehensive Survey and New Investigation , 2016, Entropy.

[26]  U. Rajendra Acharya,et al.  A review of automated sleep stage scoring based on physiological signals for the new millennia , 2019, Comput. Methods Programs Biomed..

[27]  S. Debener,et al.  Unobtrusive ambulatory EEG using a smartphone and flexible printed electrodes around the ear , 2015, Scientific Reports.

[28]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[29]  Maarten De Vos,et al.  Fusion of End-to-End Deep Learning Models for Sequence-to-Sequence Sleep Staging , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[30]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[31]  Chao Wu,et al.  DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[32]  Stefan Debener,et al.  Sleep EEG Derived From Behind-the-Ear Electrodes (cEEGrid) Compared to Standard Polysomnography: A Proof of Concept Study , 2018, Front. Hum. Neurosci..

[33]  Stefan Debener,et al.  Machine‐learning‐derived sleep–wake staging from around‐the‐ear electroencephalogram outperforms manual scoring and actigraphy , 2018, Journal of sleep research.

[34]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[35]  Yike Guo,et al.  Automatic Sleep Stage Scoring Using Time-Frequency Analysis and Stacked Sparse Autoencoders , 2015, Annals of Biomedical Engineering.

[36]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[37]  Conor Heneghan,et al.  Cardiorespiratory-based sleep staging in subjects with obstructive sleep apnea , 2006, IEEE Transactions on Biomedical Engineering.

[38]  Huy Phan,et al.  Metric learning for automatic sleep stage classification , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[39]  Christian Igel,et al.  U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Staging , 2019, NeurIPS.

[40]  Olga Sourina,et al.  Large-Scale Automated Sleep Staging , 2017, Sleep.

[41]  A. Chesson,et al.  The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Techinical Specifications , 2007 .

[42]  A. Rechtschaffen,et al.  A manual of standardized terminology, technique and scoring system for sleep stages of human subjects , 1968 .

[43]  Laurent Vercueil,et al.  A convolutional neural network for sleep stage scoring from raw single-channel EEG , 2018, Biomed. Signal Process. Control..

[44]  Esther Rodríguez-Villegas,et al.  An open-source toolbox for standardized use of PhysioNet Sleep EDF Expanded Database , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[45]  Tiago H. Falk,et al.  Deep learning-based electroencephalography analysis: a systematic review , 2019, Journal of neural engineering.

[46]  Haoqi Sun,et al.  Expert-level sleep scoring with deep neural networks , 2018, J. Am. Medical Informatics Assoc..

[47]  Huy Phan,et al.  Recurrent Neural Networks with Weighting Loss for Early prediction of Hand Movements , 2018, 2018 26th European Signal Processing Conference (EUSIPCO).

[48]  Preben Kidmose,et al.  In-Ear EEG From Viscoelastic Generic Earpieces: Robust and Unobtrusive 24/7 Monitoring , 2016, IEEE Sensors Journal.

[49]  Oliver Y. Chén,et al.  SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[50]  Ju Lynn Ong,et al.  An end-to-end framework for real-time automatic sleep stage classification , 2018, Sleep.

[51]  A. Chesson,et al.  The American Academy of Sleep Medicine (AASM) Manual for the Scoring of Sleep and Associated Events: Rules, Terminology and Technical Specifications , 2007 .

[52]  Hau-Tieng Wu,et al.  Diffuse to fuse EEG spectra - Intrinsic geometry of sleep dynamics for classification , 2018, Biomed. Signal Process. Control..

[53]  Alessandro Puiatti,et al.  Automated sleep scoring: A review of the latest approaches. , 2019, Sleep medicine reviews.

[54]  Esther Rodríguez-Villegas,et al.  Recommendations for performance assessment of automatic sleep staging algorithms , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[55]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[56]  Yike Guo,et al.  Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks , 2016, ArXiv.

[57]  Maarten De Vos,et al.  Deep Transfer Learning for Single-Channel Automatic Sleep Staging with Channel Mismatch , 2019, 2019 27th European Signal Processing Conference (EUSIPCO).

[58]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[59]  E. Wolpert.  A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[60]  Lars Kai Hansen,et al.  Deep convolutional neural networks for interpretable analysis of EEG sleep stage scoring , 2017, 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP).

[61]  D. Mandic,et al.  A wearable in-ear encephalography sensor for monitoring sleep: preliminary observations from nap studies , 2016 .

[62]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[63]  Alexander Neergaard Olesen,et al.  Deep residual networks for automatic sleep stage classification of raw polysomnographic waveforms , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[64]  Maarten De Vos,et al.  Detection of REM sleep behaviour disorder by automated polysomnography analysis , 2018, Clinical Neurophysiology.

[65]  Maarten De Vos,et al.  Personalized automatic sleep staging with single-night data: a pilot study with Kullback–Leibler divergence regularization , 2020, Physiological measurement.

[66]  Sheng-Fu Liang,et al.  Automatic stage scoring of single-channel sleep EEG based on multiscale permutation entropy , 2011, 2011 IEEE Biomedical Circuits and Systems Conference (BioCAS).

[67]  Jimeng Sun,et al.  SLEEPNET: Automated Sleep Staging System via Deep Learning , 2017, ArXiv.

[68]  S. Debener,et al.  How about taking a low-cost, small, and wireless EEG for a walk? , 2012, Psychophysiology.

[69]  Yen-Chen Liu,et al.  Development of an EOG-Based Automatic Sleep-Monitoring Eye Mask , 2015, IEEE Transactions on Instrumentation and Measurement.