Self-supervised Contrastive Learning for EEG-based Sleep Staging

EEG signals are usually simple to obtain but expensive to label. Although supervised learning has been widely used in the field of EEG signal analysis, its generalization performance is limited by the amount of annotated data. Self-supervised learning (SSL), as a popular learning paradigm in computer vision (CV) and natural language processing (NLP), can employ unlabeled data to make up for the data shortage of supervised learning. In this paper, we propose a self-supervised contrastive learning method of EEG signals for sleep stage classification. During the training process, we set up a pretext task for the network in order to match the right transformation pairs generated from EEG signals. In this way, the network improves the representation ability by learning the general features of EEG signals. The robustness of the network also gets improved in dealing with diverse data, that is, extracting constant features from changing data. In detail, the network's performance depends on the choice of transformations and the amount of unlabeled data used in the training process of self-supervised learning. To verify the effectiveness of the proposed method, we take Sleep-edf, Sleep-edfx, Dod-O, and Dod-H datasets with more than 300k samples to conduct our experiments. Empirical evaluations on the Sleep-edf dataset demonstrate the competitive performance of our method on sleep staging (88.16% accuracy and 81.96% F1 score) and verify the effectiveness of SSL strategy for EEG signal analysis in limited labeled data regimes. All codes are provided publicly online.11https://githuh.com/XueJiang16/ssl-torch

[1]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[2]  R Devon Hjelm,et al.  Learning Representations by Maximizing Mutual Information Across Views , 2019, NeurIPS.

[3]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[4]  Léon Bottou,et al.  Large-Scale Machine Learning with Stochastic Gradient Descent , 2010, COMPSTAT.

[5]  Nikos Komodakis,et al.  Unsupervised Representation Learning by Predicting Image Rotations , 2018, ICLR.

[6]  Mustafa Poyraz,et al.  Application of adaptive neuro-fuzzy inference system for vigilance level estimation by using wavelet-entropy feature extraction , 2009, Expert Syst. Appl..

[7]  Ihsan Ullah,et al.  An Automated System for Epilepsy Detection using EEG Brain Signals based on Deep Learning Approach , 2018, Expert Syst. Appl..

[8]  Chao Wu,et al.  DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Oriol Vinyals,et al.  Representation Learning with Contrastive Predictive Coding , 2018, ArXiv.

[10]  Ming-Wei Chang,et al.  BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding , 2019, NAACL.

[11]  Frank Hutter,et al.  SGDR: Stochastic Gradient Descent with Warm Restarts , 2016, ICLR.

[12]  Masoumeh Haghpanahi,et al.  Cardiologist-level arrhythmia detection and classification in ambulatory electrocardiograms using a deep neural network , 2019, Nature Medicine.

[13]  Geoffrey E. Hinton,et al.  A Simple Framework for Contrastive Learning of Visual Representations , 2020, ICML.

[14]  Aapo Hyvärinen,et al.  Uncovering the structure of clinical EEG signals with self-supervised learning , 2020, Journal of neural engineering.

[15]  Alexander Kolesnikov,et al.  Revisiting Self-Supervised Visual Representation Learning , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Ali Etemad,et al.  Self-Supervised Learning for ECG-Based Emotion Recognition , 2020, ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Martial Hebert,et al.  Shuffle and Learn: Unsupervised Learning Using Temporal Order Verification , 2016, ECCV.

[18]  Abdulhamit Subasi,et al.  Ensemble SVM Method for Automatic Sleep Stage Classification , 2018, IEEE Transactions on Instrumentation and Measurement.

[19]  Nicolas Y. Masse,et al.  Reach and grasp by people with tetraplegia using a neurally controlled robotic arm , 2012, Nature.

[20]  Judith Amores,et al.  Real-time Smartphone-based Sleep Staging using 1-Channel EEG , 2019, 2019 IEEE 16th International Conference on Wearable and Implantable Body Sensor Networks (BSN).

[21]  Christian Igel,et al.  U-Time: A Fully Convolutional Network for Time Series Segmentation Applied to Sleep Staging , 2019, NeurIPS.

[22]  Oliver Y. Chén,et al.  Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification , 2018, IEEE Transactions on Biomedical Engineering.

[23]  Edward F. Chang,et al.  Speech synthesis from neural decoding of spoken sentences , 2019, Nature.

[24]  Feng Yu,et al.  Convolution- and Attention-Based Neural Network for Automated Sleep Stage Classification , 2020, International journal of environmental research and public health.

[25]  Aeilko H. Zwinderman,et al.  Analysis of a sleep-dependent neuronal feedback loop: the slow-wave microcontinuity of the EEG , 2000, IEEE Transactions on Biomedical Engineering.

[26]  Alexei A. Efros,et al.  Colorful Image Colorization , 2016, ECCV.

[27]  U. Rajendra Acharya,et al.  SleepEEGNet: Automated sleep stage scoring with sequence to sequence deep learning approach , 2019, PloS one.

[28]  Valentin Thorey,et al.  Dreem Open Datasets: Multi-Scored Sleep Datasets to Compare Human and Automated Sleep Staging , 2020, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[29]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[30]  Seunghyeok Back,et al.  Intra- and inter-epoch temporal context network (IITNet) using sub-epoch features for automatic sleep scoring on raw single-channel EEG , 2020, Biomed. Signal Process. Control..

[31]  Stanislas Chambon,et al.  DOSED: A deep learning approach to detect multiple sleep micro-events in EEG signal , 2018, Journal of Neuroscience Methods.

[32]  Flora D. Salim,et al.  Federated Self-Supervised Learning of Multisensor Representations for Embedded Intelligence , 2020, IEEE Internet of Things Journal.