Orthogonal convolutional neural networks for automatic sleep stage classification based on single-channel EEG

BACKGROUND AND OBJECTIVE In recent years, several automatic sleep stage classification methods based on convolutional neural networks (CNN) by learning hierarchical feature representation automatically from raw EEG data have been proposed. However, the state-of-the-art of such methods are quite complex. Using a simple CNN architecture to classify sleep stages is important for portable sleep devices. In addition, employing CNNs to learn rich and diverse representations remains a challenge. Therefore, we propose a novel CNN model for sleep stage classification. METHODS Generally, EEG signals are better described in the frequency domain; thus, we convert EEG data to a time-frequency representation via Hilbert-Huang transform. To learn rich and effective feature representations, we propose an orthogonal convolutional neural network (OCNN). First, we construct an orthogonal initialization of weights. Second, to avoid destroying the orthogonality of the weights in the training process, orthogonality regularizations are proposed to maintain the orthogonality of weights. Simultaneously, a squeeze-and-excitation (SE) block is employed to perform feature recalibration across different channels. RESULTS The proposed method achieved a total classification accuracy of 88.4% and 87.6% on two public datasets, respectively. The classification performances of different convolutional neural networks models were compared to that of the proposed method. The experiment results demonstrated that the proposed method is effective for sleep stage classification. CONCLUSIONS Experiment results indicate that the proposed OCNN can learn rich and diverse feature representations from time-frequency images of EEG data, which is important for deep learning. In addition, the proposed orthogonality regularization is simple and can be easily adapted to other architectures.

[1]  Suzanne Lesecq,et al.  Feature selection for sleep/wake stages classification using data driven methods , 2007, Biomed. Signal Process. Control..

[2]  Lu Wang,et al.  Automated pulmonary nodule detection in CT images using 3D deep squeeze-and-excitation networks , 2019, International Journal of Computer Assisted Radiology and Surgery.

[3]  Sheng-Fu Liang,et al.  Automatic Stage Scoring of Single-Channel Sleep EEG by Using Multiscale Entropy and Autoregressive Models , 2012, IEEE Transactions on Instrumentation and Measurement.

[4]  Yi Wang,et al.  Comparative analysis of different characteristics of automatic sleep stages , 2019, Comput. Methods Programs Biomed..

[5]  Yi Yang,et al.  Attention to Scale: Scale-Aware Semantic Image Segmentation , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Laurent Vercueil,et al.  A convolutional neural network for sleep stage scoring from raw single-channel EEG , 2018, Biomed. Signal Process. Control..

[7]  Oliver Y. Chén,et al.  Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification , 2018, IEEE Transactions on Biomedical Engineering.

[8]  Yu Qiao,et al.  A Discriminative Feature Learning Approach for Deep Face Recognition , 2016, ECCV.

[9]  Roman Genov,et al.  Electronic Sleep Stage Classifiers: A Survey and VLSI Design Methodology , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[10]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[11]  Junming Zhang,et al.  Complex-valued unsupervised convolutional neural networks for sleep stage classification , 2018, Comput. Methods Programs Biomed..

[12]  N. Huang,et al.  The empirical mode decomposition and the Hilbert spectrum for nonlinear and non-stationary time series analysis , 1998, Proceedings of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[13]  A. Hassan,et al.  A decision support system for automatic sleep staging from EEG signals using tunable Q-factor wavelet transform and spectral features , 2016, Journal of Neuroscience Methods.

[14]  Ram Bilas Pachori,et al.  Automatic classification of sleep stages based on the time-frequency image of EEG signals , 2013, Comput. Methods Programs Biomed..

[15]  Ioanna Chouvarda,et al.  Assessment of the EEG complexity during activations from sleep , 2011, Comput. Methods Programs Biomed..

[16]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Yosuke Kurihara,et al.  Sleep-Stage Decision Algorithm by Using Heartbeat and Body-Movement Signals , 2012, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[18]  Gulay Tezel,et al.  Effect of EEG Time Domain Features on the Classification of Sleep Stages , 2016 .

[19]  G. Moody,et al.  Development of the polysomnographic database on CD‐ROM , 1999, Psychiatry and clinical neurosciences.

[20]  Sule Yücelbas,et al.  Automatic sleep staging based on SVD, VMD, HHT and morphological features of single-lead ECG signal , 2018, Expert Syst. Appl..

[21]  Hau-Tieng Wu,et al.  Assess Sleep Stage by Modern Signal Processing Techniques , 2014, IEEE Transactions on Biomedical Engineering.

[22]  Mohammed Imamul Hassan Bhuiyan,et al.  Automatic sleep scoring using statistical features in the EMD domain and ensemble methods , 2016 .

[23]  Marcel van Gerven,et al.  Convolutional neural network-based encoding and decoding of visual object recognition in space and time , 2017, NeuroImage.

[24]  Kemal Polat,et al.  Efficient sleep stage recognition system based on EEG signal using k-means clustering based feature weighting , 2010, Expert Syst. Appl..

[25]  R. Foster,et al.  Sleep and circadian rhythm disruption in psychiatric and neurodegenerative disease , 2010, Nature Reviews Neuroscience.

[26]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[27]  B. Koley,et al.  An ensemble system for automatic sleep stage classification using single channel EEG signal , 2012, Comput. Biol. Medicine.

[28]  Wuming Zhang,et al.  Sleep Quality Analysis Based on HHT , 2011 .

[29]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[30]  Ju Lynn Ong,et al.  An end-to-end framework for real-time automatic sleep stage classification , 2018, Sleep.

[31]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Surya Ganguli,et al.  Resurrecting the sigmoid in deep learning through dynamical isometry: theory and practice , 2017, NIPS.

[33]  J. Mattout,et al.  Automatic analysis of single-channel sleep EEG: validation in healthy individuals. , 2007, Sleep.

[34]  Mi-Jung Kim,et al.  A Study on Industrial Accident for Broken Prosthesis : with Focus on July 10. 2014 ruling 2012 du 20991 in Supreme Court of Korea , 2016 .

[35]  U. Rajendra Acharya,et al.  A review of automated sleep stage scoring based on physiological signals for the new millennia , 2019, Comput. Methods Programs Biomed..

[36]  Kristína Susmáková,et al.  Discrimination ability of individual measures used in sleep stages classification , 2008, Artif. Intell. Medicine.

[37]  Sule Yücelbas,et al.  A novel system for automatic detection of K-complexes in sleep EEG , 2017, Neural Computing and Applications.

[38]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[39]  Junming Zhang,et al.  A New Method for Automatic Sleep Stage Classification , 2017, IEEE Transactions on Biomedical Circuits and Systems.

[40]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[41]  Yan Wu,et al.  Automatic sleep stage classification of single-channel EEG by using complex-valued convolutional neural network , 2017, Biomedizinische Technik. Biomedical engineering.

[42]  Sule Yücelbas,et al.  NEW TRENDS IN DATA PRE-PROCESSING METHODS FOR SIGNAL AND IMAGE CLASSIFICATION Automatic detection of sleep spindles with the use of STFT, EMD and DWT methods , 2016 .

[43]  Chao Wu,et al.  DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[44]  Dario Floreano,et al.  Sleep and Wake Classification With ECG and Respiratory Effort Signals , 2009, IEEE Transactions on Biomedical Circuits and Systems.

[45]  Gulay Tezel,et al.  Detection of Sleep Spindles in Sleep EEG by using the PSD Methods , 2016 .

[46]  Xiaohan Chen,et al.  Can We Gain More from Orthogonality Regularizations in Training Deep CNNs? , 2018, NeurIPS.

[47]  Surya Ganguli,et al.  Identifying and attacking the saddle point problem in high-dimensional non-convex optimization , 2014, NIPS.

[48]  Sule Yücelbas,et al.  A new approach to eliminating EOG artifacts from the sleep EEG signals for the automatic sleep stage classification , 2016, Neural Computing and Applications.

[49]  Gulay Tezel,et al.  Detection of REM in Sleep EOG Signals , 2016 .