Transferring Structured Knowledge in Unsupervised Domain Adaptation of a Sleep Staging Network

Automatic sleep staging based on deep learning (DL) has been attracting attention for analyzing sleep quality and determining treatment effects. It is challenging to acquire long-term sleep data from numerous subjects and manually labeling them even though most DL-based models are trained using large-scale sleep data to provide state-of-the-art performance. One way to overcome this data shortage is to create a pre-trained network with an existing large-scale dataset (source domain) that is applicable to small cohorts of datasets (target domain); however, discrepancies in data distribution between the domains prevent successful refinement of this approach. In this paper, we propose an unsupervised domain adaptation method for sleep staging networks to reduce discrepancies by re-aligning the domains in the same space and producing domain-invariant features. Specifically, in addition to a classical domain discriminator, we introduce local discriminators - subject and stage - to maintain the intrinsic structure of sleep data to decrease local misalignments while using adversarial learning to play a minimax game between the feature extractor and discriminators. Moreover, we present several optimization schemes during training because the conventional adversarial learning is not effective to our training scheme. We evaluate the performance of the proposed method by examining the staging performances of a baseline network compared with direct transfer (DT) learning in various conditions. The experimental results demonstrate that the proposed domain adaptation significantly improves the performance though it needs no labeled sleep data in target domain.

[1]  Kimiaki Shirahama,et al.  Sleep stage classification for child patients using DeConvolutional Neural Network , 2020, Artif. Intell. Medicine.

[2]  Kyoobin Lee,et al.  Intra- and inter-epoch temporal context network (IITNet) using sub-epoch features for automatic sleep scoring on raw single-channel EEG , 2020, Biomed. Signal Process. Control..

[3]  Xilin Chen,et al.  Unsupervised Domain Adaptation With Hierarchical Gradient Synchronization , 2020, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  S. Myllymaa,et al.  Deep learning enables sleep staging from photoplethysmogram for patients with suspected sleep apnea , 2020, Sleep.

[5]  Chen Chen,et al.  A Hierarchical Neural Network for Sleep Stage Classification Based on Comprehensive Feature Learning and Multi-Flow Sequence Learning , 2020, IEEE Journal of Biomedical and Health Informatics.

[6]  Jun Zhou,et al.  Progressive Transfer Learning and Adversarial Domain Adaptation for Cross-Domain Skin Disease Classification , 2020, IEEE Journal of Biomedical and Health Informatics.

[7]  E. Chuangsuwanich,et al.  MetaSleepLearner: A Pilot Study on Fast Adaptation of Bio-Signals-Based Sleep Stage Classifier to New Individual Subject Using Meta-Learning , 2020, IEEE Journal of Biomedical and Health Informatics.

[8]  Zheru Chi,et al.  A Residual Based Attention Model for EEG Based Sleep Staging , 2020, IEEE Journal of Biomedical and Health Informatics.

[9]  Kuangen Zhang,et al.  Unsupervised Cross-Subject Adaptation for Predicting Human Locomotion Intent , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[10]  Sabine Van Huffel,et al.  A convolutional neural network outperforming state-of-the-art sleep staging algorithms for both preterm and term infants , 2020, Journal of neural engineering.

[11]  Timo Leppänen,et al.  Accurate Deep Learning-Based Sleep Staging in a Clinical Population With Suspected Obstructive Sleep Apnea , 2019, IEEE Journal of Biomedical and Health Informatics.

[12]  Je-Won Kang,et al.  Multi-channel fusion convolutional neural network to classify syntactic anomaly from language-related ERP components , 2019, Inf. Fusion.

[13]  R. Thomas,et al.  Sleep Staging from Electrocardiography and Respiration with Deep Learning. , 2019, Sleep.

[14]  Maarten De Vos,et al.  Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning , 2019, IEEE Transactions on Biomedical Engineering.

[15]  A. Boulier,et al.  A Double-Blind, Randomized, Placebo-Controlled Crossover Clinical Study of the Effects of Alpha-s1 Casein Hydrolysate on Sleep Disturbance , 2019, Nutrients.

[16]  Stefan Debener,et al.  Machine‐learning‐derived sleep–wake staging from around‐the‐ear electroencephalogram outperforms manual scoring and actigraphy , 2018, Journal of sleep research.

[17]  Maarten De Vos,et al.  Detection of REM sleep behaviour disorder by automated polysomnography analysis , 2018, Clinical Neurophysiology.

[18]  Oliver Y. Chén,et al.  SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[19]  Maarten De Vos,et al.  Automatic Sleep Stage Classification Using Single-Channel EEG: Learning Sequential Features with Attention-Based Recurrent Neural Networks , 2018, 2018 40th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[20]  Oliver Y. Chén,et al.  Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification , 2018, IEEE Transactions on Biomedical Engineering.

[21]  Jianmin Wang,et al.  Multi-Adversarial Domain Adaptation , 2018, AAAI.

[22]  Kaare B. Mikkelsen,et al.  Personalizing deep learning models for automatic sleep staging , 2018, 1801.02645.

[23]  Dimitri Perrin,et al.  Neural network analysis of sleep stages enables efficient diagnosis of narcolepsy , 2017, Nature Communications.

[24]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[25]  Chao Wu,et al.  DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[26]  Yu-Chiang Frank Wang,et al.  Unsupervised Domain Adaptation With Label and Structural Consistency , 2016, IEEE Transactions on Image Processing.

[27]  Hao Dong,et al.  Mixed Neural Network Approach for Temporal Sleep Stage Classification , 2016, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[28]  Julie A. E. Christensen,et al.  A Noise-Assisted Data Analysis Method for Automatic EOG-Based Sleep Stage Classification Using Ensemble Learning , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[29]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[30]  C. O’Reilly,et al.  Montreal Archive of Sleep Studies: an open‐access resource for instrument benchmarking and exploratory research , 2014, Journal of sleep research.

[31]  Victor S. Lempitsky,et al.  Unsupervised Domain Adaptation by Backpropagation , 2014, ICML.

[32]  Urbano Nunes,et al.  Automatic sleep staging: A computer assisted approach for optimal combination of features and polysomnographic channels , 2013, Expert Syst. Appl..

[33]  Ming Shao,et al.  Low-Rank Transfer Subspace Learning , 2012, 2012 IEEE 12th International Conference on Data Mining.

[34]  Hans Stenlund,et al.  Sleep in women: Normal values for sleep stages and position and the effect of age, obesity, sleep apnea, smoking, alcohol and hypertension. , 2009, Sleep medicine.

[35]  Conor Heneghan,et al.  Cardiorespiratory-based sleep staging in subjects with obstructive sleep apnea , 2006, IEEE Transactions on Biomedical Engineering.

[36]  Yoshua Bengio,et al.  Semi-supervised Learning by Entropy Minimization , 2004, CAP.

[37]  S. Redline,et al.  The effects of age, sex, ethnicity, and sleep-disordered breathing on sleep architecture. , 2004, Archives of internal medicine.

[38]  R. Dahl,et al.  Pathways to adolescent health sleep regulation and behavior. , 2002, The Journal of adolescent health : official publication of the Society for Adolescent Medicine.

[39]  Aeilko H. Zwinderman,et al.  Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG , 2000, IEEE Transactions on Biomedical Engineering.

[40]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[41]  Gari D. Clifford,et al.  Attentive Adversarial Network for Large-Scale Sleep Staging , 2020, MLHC.

[42]  Alexander Neergaard Olesen,et al.  A Noise-Assisted Data Analysis Method for Automatic EOG-Based Sleep Stage Classification Using Ensemble Learning. , 2016, Conference proceedings : ... Annual International Conference of the IEEE Engineering in Medicine and Biology Society. IEEE Engineering in Medicine and Biology Society. Annual Conference.

[43]  A. Chesson,et al.  The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Techinical Specifications , 2007 .

[44]  S. Havlin,et al.  Physionet: components of a new research resource for complex physiologic signals , 2000 .

[45]  A. Rechtschaffen,et al.  A manual of standardized terminology, technique and scoring system for sleep stages of human subjects , 1968 .