Unsupervised sleep staging system based on domain adaptation

Abstract Currently, most deep-learning-based sleep staging system relies heavily on a large number of labeled physiological signals. However, sleep-related data, such as polysommography (PSG), are often manually labeled by one or more than one professional experts with much effort. Meanwhile, due to physiological differences that existed among different subjects, how to boost the performance of trained models on an unseen dataset is still an open issue. One potential solution to this issue is to borrow knowledge from a labeled dataset to train an unlabeled or few labeled dataset by way of unsupervised or semi-unsupervised domain adaptation. To overcome the problem of insufficient labeled data for training robust sleep staging systems, this study aims to investigate the training of an unlabeled target sleep dataset from a labeled source sleep dataset in a deep learning framework, which integrates a conditional and collaborative adversarial domain adaptation module. To facilitate the network to learn domain-invariant features, a domain classifier is deployed for each feature extraction block at different scale. The input to the domain classifier at different level is the multilinear mapping of the sleep stage prediction vector and the corresponding feature vector at this level. It is assumed that the feedback of the class information provided by the network into the domain classifier can be beneficial to help the network to reduce the feature distribution distance between different domains. Experiments on public Sleep-EDF dataset demonstrate the effectiveness of the proposed approach. Compared to other domain adaptation approaches, the proposed approaches can provide better sleep staging performance in different model transferring tasks.

[1]  Matteo Matteucci,et al.  Sleep Staging Based on Signals Acquired Through Bed Sensor , 2010, IEEE Transactions on Information Technology in Biomedicine.

[2]  Chao Wu,et al.  DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[3]  Jonathon Shlens,et al.  Conditional Image Synthesis with Auxiliary Classifier GANs , 2016, ICML.

[4]  Rama Chellappa,et al.  Visual Domain Adaptation: A survey of recent advances , 2015, IEEE Signal Processing Magazine.

[5]  Ling Shao,et al.  Transfer Learning for Visual Categorization: A Survey , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[6]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[7]  Mohammed Imamul Hassan Bhuiyan,et al.  End-to-end Sleep Staging with Raw Single Channel EEG using Deep Residual ConvNets , 2019, 2019 IEEE EMBS International Conference on Biomedical & Health Informatics (BHI).

[8]  U. Rajendra Acharya,et al.  Use of features from RR-time series and EEG signals for automated classification of sleep stages in deep neural network framework , 2018 .

[9]  Dong Xu,et al.  Collaborative and Adversarial Network for Unsupervised Domain Adaptation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[10]  Gari D. Clifford,et al.  Attentive Adversarial Network for Large-Scale Sleep Staging , 2020, MLHC.

[11]  Can Yang,et al.  Unsupervised Cross-Dataset Person Re-identification by Transfer Learning of Spatial-Temporal Patterns , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[12]  Oliver Y. Chén,et al.  Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification , 2018, IEEE Transactions on Biomedical Engineering.

[13]  Nico Surantha,et al.  Automatic Sleep Stage Classification using Weighted ELM and PSO on Imbalanced Data from Single Lead ECG , 2019, ICCSCI.

[14]  E. Wolpert A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[15]  S. Quan,et al.  Rules for scoring respiratory events in sleep: update of the 2007 AASM Manual for the Scoring of Sleep and Associated Events. Deliberations of the Sleep Apnea Definitions Task Force of the American Academy of Sleep Medicine. , 2012, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[16]  Xiang Li,et al.  Cross-Domain Fault Diagnosis of Rolling Element Bearings Using Deep Generative Neural Networks , 2019, IEEE Transactions on Industrial Electronics.

[17]  Oliver Y. Chén,et al.  SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[18]  M. Shamim Hossain,et al.  Multilevel Weighted Feature Fusion Using Convolutional Neural Networks for EEG Motor Imagery Classification , 2019, IEEE Access.

[19]  Aeilko H. Zwinderman,et al.  Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG , 2000, IEEE Transactions on Biomedical Engineering.

[20]  Chenglu Sun,et al.  A hierarchical sequential neural network with feature fusion for sleep staging based on EOG and RR signals , 2019, Journal of neural engineering.

[21]  Yaguo Lei,et al.  Deep Convolutional Transfer Learning Network: A New Method for Intelligent Fault Diagnosis of Machines With Unlabeled Data , 2019, IEEE Transactions on Industrial Electronics.

[22]  Maarten De Vos,et al.  Towards More Accurate Automatic Sleep Staging via Deep Transfer Learning , 2019, IEEE Transactions on Biomedical Engineering.

[23]  U. Rajendra Acharya,et al.  SleepEEGNet: Automated sleep stage scoring with sequence to sequence deep learning approach , 2019, PloS one.

[24]  Laurens van der Maaten,et al.  Accelerating t-SNE using tree-based algorithms , 2014, J. Mach. Learn. Res..

[25]  J. Allan Hobson,et al.  A manual of standardized terminology, techniques and scoring system for sleep stages of human subjects: A. Rechtschaffen and A. Kales (Editors). (Public Health Service, U.S. Government Printing Office, Washington, D.C., 1968, 58 p., $4.00) , 1969 .

[26]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[27]  Zheru Chi,et al.  A Residual Based Attention Model for EEG Based Sleep Staging , 2020, IEEE Journal of Biomedical and Health Informatics.

[28]  Yongmei Ren,et al.  Multi-Feature Fusion with Convolutional Neural Network for Ship Classification in Optical Images , 2019 .

[29]  Haoqi Sun,et al.  Sleep Staging from Electrocardiography and Respiration with Deep Learning. , 2019, Sleep.

[30]  S. Chokroverty,et al.  The visual scoring of sleep in adults. , 2007, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[31]  Michael I. Jordan,et al.  Learning Transferable Features with Deep Adaptation Networks , 2015, ICML.

[32]  Linhui Sun,et al.  Deep and shallow features fusion based on deep convolutional neural network for speech emotion recognition , 2018, Int. J. Speech Technol..

[33]  A. Chesson,et al.  The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Techinical Specifications , 2007 .