Cascaded LSTM recurrent neural network for automated sleep stage classification using single-channel EEG signals

Automated evaluation of a subject's neurocognitive performance (NCP) is a relevant topic in neurological and clinical studies. NCP represents the mental/cognitive human capacity in performing a specific task. It is difficult to develop the study protocols as the subject's NCP changes in a known predictable way. Sleep is time-varying NCP and can be used to develop novel NCP techniques. Accurate analysis and interpretation of human sleep electroencephalographic (EEG) signals is needed for proper NCP assessment. In addition, sleep deprivation may cause prominent cognitive risks in performing many common activities such as driving or controlling a generic device; therefore, sleep scoring is a crucial part of the process. In the sleep cycle, the first stage of non-rapid eye movement (NREM) sleep or stage N1 is the transition between wakefulness and drowsiness and becomes relevant for the study of NCP. In this study, a novel cascaded recurrent neural network (RNN) architecture based on long short-term memory (LSTM) blocks, is proposed for the automated scoring of sleep stages using EEG signals derived from a single-channel. Fifty-five time and frequency-domain features were extracted from the EEG signals and fed to feature reduction algorithms to select the most relevant ones. The selected features constituted as the inputs to the LSTM networks. The cascaded architecture is composed of two LSTM RNNs: the first network performed 4-class classification (i.e. the five sleep stages with the merging of stages N1 and REM into a single stage) with a classification rate of 90.8%, and the second one obtained a recognition performance of 83.6% for 2-class classification (i.e. N1 vs REM). The overall percentage of correct classification for five sleep stages is found to be 86.7%. The objective of this work is to improve classification performance in sleep stage N1, as a first step of NCP assessment, and at the same time obtain satisfactory classification results in the other sleep stages.

[1]  Jeffrey M. Hausdorff,et al.  Physionet: Components of a New Research Resource for Complex Physiologic Signals". Circu-lation Vol , 2000 .

[2]  U. Rajendra Acharya,et al.  Non-linear analysis of EEG signals at various sleep stages , 2005, Comput. Methods Programs Biomed..

[3]  Ali Motie Nasrabadi,et al.  A new automatic sleep staging system based on statistical behavior of local extrema using single channel EEG signal , 2018, Expert Syst. Appl..

[4]  José Luis Rodríguez-Sotelo,et al.  Automatic Sleep Stages Classification Using EEG Entropy Features and Unsupervised Pattern Analysis Techniques , 2014, Entropy.

[5]  Igor Kononenko,et al.  Estimating Attributes: Analysis and Extensions of RELIEF , 1994, ECML.

[6]  Kuldip K. Paliwal,et al.  Bidirectional recurrent neural networks , 1997, IEEE Trans. Signal Process..

[7]  Reza Boostani,et al.  A comparative review on sleep stage classification methods in patients and healthy individuals , 2017, Comput. Methods Programs Biomed..

[8]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[9]  Meng Zhang,et al.  Neural Network Methods for Natural Language Processing , 2017, Computational Linguistics.

[10]  Necmettin Sezgin,et al.  Estimation of Sleep Stages by an Artificial Neural Network Employing EEG, EMG and EOG , 2010, Journal of Medical Systems.

[11]  D. Dinges,et al.  Neurocognitive consequences of sleep deprivation. , 2005, Seminars in neurology.

[12]  Mohammed Imamul Hassan Bhuiyan,et al.  Computer-aided sleep staging using Complete Ensemble Empirical Mode Decomposition with Adaptive Noise and bootstrap aggregating , 2016, Biomed. Signal Process. Control..

[13]  Joel E. W. Koh,et al.  Nonlinear Dynamics Measures for Automated EEG-Based Sleep Stage Detection , 2015, European Neurology.

[14]  U. Rajendra Acharya,et al.  Use of features from RR-time series and EEG signals for automated classification of sleep stages in deep neural network framework , 2018 .

[15]  U. Rajendra Acharya,et al.  An accurate sleep stages classification system using a new class of optimally time-frequency localized three-band wavelet filter bank , 2018, Comput. Biol. Medicine.

[16]  I A Basheer,et al.  Artificial neural networks: fundamentals, computing, design, and application. , 2000, Journal of microbiological methods.

[17]  U. Rajendra Acharya,et al.  Entropies for detection of epilepsy in EEG , 2005, Comput. Methods Programs Biomed..

[18]  Natheer Khasawneh,et al.  Automated sleep stage identification system based on time-frequency analysis of a single EEG channel and random forest classifier , 2012, Comput. Methods Programs Biomed..

[19]  Ruth O'Hara,et al.  DSM-5 sleep-wake disorders classification: overview for use in clinical practice. , 2013, The American journal of psychiatry.

[20]  U. Rajendra Acharya,et al.  Application of stacked convolutional and long short-term memory network for accurate identification of CAD ECG signals , 2018, Comput. Biol. Medicine.

[21]  U. Rajendra Acharya,et al.  Analysis and Automatic Identification of Sleep Stages Using Higher Order Spectra , 2010, Int. J. Neural Syst..

[22]  Eric Laciar,et al.  Automatic detection of drowsiness in EEG records based on multimodal analysis. , 2014, Medical engineering & physics.

[23]  Kazuhiko Fukuda,et al.  Proposed supplements and amendments to ‘A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects’, the Rechtschaffen & Kales (1968) standard , 2001, Psychiatry and clinical neurosciences.

[24]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[25]  Özal Yildirim,et al.  A novel wavelet sequence based on deep bidirectional LSTM network model for ECG signal classification , 2018, Comput. Biol. Medicine.

[26]  R. Rosenberg,et al.  The American Academy of Sleep Medicine inter-scorer reliability program: sleep stage scoring. , 2013, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[27]  U. Rajendra Acharya,et al.  Automated detection of atrial fibrillation using long short-term memory network with RR interval signals , 2018, Comput. Biol. Medicine.

[28]  Fuhui Long,et al.  Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy , 2003, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Karim Jerbi,et al.  Learning machines and sleeping brains: Automatic sleep stage classification using decision-tree multi-class support vector machines , 2015, Journal of Neuroscience Methods.

[30]  Li-Wei Ko,et al.  Applying the fuzzy c-means based dimension reduction to improve the sleep classification system , 2013, 2013 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[31]  Elif Derya Übeyli,et al.  Recurrent neural networks employing Lyapunov exponents for EEG signals classification , 2005, Expert Syst. Appl..

[32]  Mohammed Imamul Hassan Bhuiyan,et al.  On the classification of sleep states by means of statistical and spectral features from single channel Electroencephalogram , 2015, 2015 International Conference on Advances in Computing, Communications and Informatics (ICACCI).

[33]  Sepp Hochreiter,et al.  The Vanishing Gradient Problem During Learning Recurrent Neural Nets and Problem Solutions , 1998, Int. J. Uncertain. Fuzziness Knowl. Based Syst..

[34]  Jing Wang,et al.  Time-Frequency Convolutional Neural Network for Automatic Sleep Stage Classification Based on Single-Channel EEG , 2017, 2017 IEEE 29th International Conference on Tools with Artificial Intelligence (ICTAI).

[35]  Suzanne Lesecq,et al.  Self-evaluated automatic classifier as a decision-support tool for sleep/wake staging , 2011, Comput. Biol. Medicine.

[36]  P. Welch.  The use of fast Fourier transform for the estimation of power spectra: A method based on time averaging over short, modified periodograms , 1967 .

[37]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[38]  H. Colten,et al.  Sleep Disorders and Sleep Deprivation , 2006 .

[39]  B. Hjorth.  EEG analysis based on time domain properties. , 1970, Electroencephalography and clinical neurophysiology.

[40]  Yu-Liang Hsu,et al.  Automatic sleep stage recurrent neural classifier using energy features of EEG signals , 2013, Neurocomputing.

[41]  Laurent Vercueil,et al.  A convolutional neural network for sleep stage scoring from raw single-channel EEG , 2018, Biomed. Signal Process. Control..

[42]  T Hori,et al.  Topographical characteristics and principal component structure of the hypnagogic EEG. , 1997, Sleep.