Automatic Sleep Staging Employing Convolutional Neural Networks and Cortical Connectivity Images

Understanding of the neuroscientific sleep mechanisms is associated with mental/cognitive and physical well-being and pathological conditions. A prerequisite for further analysis is the identification of the sleep macroarchitecture through manual sleep staging. Several computer-based approaches have been proposed to extract time and/or frequency-domain features with accuracy ranging from 80% to 95% compared with the golden standard of manual staging. However, their acceptability by the medical community is still suboptimal. Recently, utilizing deep learning methodologies increased the research interest in computer-assisted recognition of sleep stages. Aiming to enhance the arsenal of automatic sleep staging, we propose a novel classification framework based on convolutional neural networks. These receive as input synchronizations features derived from cortical interactions within various electroencephalographic rhythms (delta, theta, alpha, and beta) for specific cortical regions which are critical for the sleep deepening. These functional connectivity metrics are then processed as multidimensional images. We also propose to augment the small portion of sleep onset (N1 stage) through the Synthetic Minority Oversampling Technique in order to deal with the great difference in its duration when compared with the remaining sleep stages. Our results (99.85%) indicate the flexibility of deep learning techniques to learn sleep-related neurophysiological patterns.

[1]  Mark A. Clements,et al.  Sleep stage classification with cross frequency coupling , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[2]  A. Hassan,et al.  A decision support system for automatic sleep staging from EEG signals using tunable Q-factor wavelet transform and spectral features , 2016, Journal of Neuroscience Methods.

[3]  S. Chokroverty,et al.  The visual scoring of sleep in adults. , 2007, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[4]  Y. Shao,et al.  Functional connectivity of paired default mode network subregions in primary insomnia , 2015, Neuropsychiatric disease and treatment.

[5]  Panagiotis D. Bamidis,et al.  Achieving Accurate Automatic Sleep Staging on Manually Pre-processed EEG Data Through Synchronization Feature Extraction and Graph Metrics , 2018, Front. Hum. Neurosci..

[6]  Terrence J. Sejnowski,et al.  An Information-Maximization Approach to Blind Separation and Blind Deconvolution , 1995, Neural Computation.

[7]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[8]  Stanislas Chambon,et al.  A Deep Learning Architecture for Temporal Sleep Stage Classification Using Multivariate and Multimodal Time Series , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[9]  Samy Bengio,et al.  Show and tell: A neural image caption generator , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Eckehard Olbrich,et al.  The multiple time scales of sleep dynamics as a challenge for modelling the sleeping brain , 2011, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[11]  Gulay Tezel,et al.  Effect of EEG Time Domain Features on the Classification of Sleep Stages , 2016 .

[12]  S. Quan,et al.  AASM Scoring Manual Updates for 2017 (Version 2.4). , 2017, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[13]  Magda Tsolaki,et al.  Functional disorganization of small-world brain networks in mild Alzheimer's Disease and amnestic Mild Cognitive Impairment: an EEG study using Relative Wavelet Entropy (RWE) , 2014, Front. Aging Neurosci..

[14]  Esther Rodríguez-Villegas,et al.  Automatic sleep staging using state machine-controlled decision trees , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[15]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[16]  Yoshua Bengio,et al.  Show, Attend and Tell: Neural Image Caption Generation with Visual Attention , 2015, ICML.

[17]  Andrew Zisserman,et al.  Deep Face Recognition , 2015, BMVC.

[18]  E. Basar,et al.  Wavelet entropy: a new tool for analysis of short duration brain electrical signals , 2001, Journal of Neuroscience Methods.

[19]  Edward T. Bullmore,et al.  Reproducibility of graph metrics of human brain functional networks , 2009, NeuroImage.

[20]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[21]  M. Raichle The brain's default mode network. , 2015, Annual review of neuroscience.

[22]  Magda Tsolaki,et al.  Cognitive and physical training for the elderly: evaluating outcome efficacy by means of neurophysiological synchronization. , 2014, International journal of psychophysiology : official journal of the International Organization of Psychophysiology.

[23]  Dean Cvetkovic,et al.  Automatic sleep-wake detection using electrooculogram signals , 2014, 2014 IEEE Conference on Biomedical Engineering and Sciences (IECBES).

[24]  V. Brümmer,et al.  Changes in brain cortical activity measured by EEG are related to individual exercise preferences , 2009, Physiology & Behavior.

[25]  Syed Anas Imtiaz,et al.  An Ultralow Power System on Chip for Automatic Sleep Staging , 2017, IEEE Journal of Solid-State Circuits.

[26]  Chao Wu,et al.  DeepSleepNet: A Model for Automatic Sleep Stage Scoring Based on Raw Single-Channel EEG , 2017, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[27]  Hui Li,et al.  A study of sleep staging based on a sample entropy analysis of electroencephalogram. , 2015, Bio-medical materials and engineering.

[28]  Danilo Rastovic,et al.  From Non-Markovian Processes to Stochastic Real Time Control for Tokamak Plasma Turbulence Via Artificial Intelligence Techniques , 2015 .

[29]  Sheng-Fu Liang,et al.  Combination of Expert Knowledge and a Genetic Fuzzy Inference System for Automatic Sleep Staging , 2016, IEEE Transactions on Biomedical Engineering.

[30]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[31]  Luis Antonio Aguirre,et al.  Automatic sleep staging from ventilator signals in non-invasive ventilation , 2013, Comput. Biol. Medicine.

[32]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[33]  C. Stam,et al.  Nonlinear synchronization in EEG and whole‐head MEG recordings of healthy subjects , 2003, Human brain mapping.

[34]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[35]  Urbano Nunes,et al.  A two-step automatic sleep stage classification method with dubious range detection , 2015, Comput. Biol. Medicine.

[36]  Erik Naylor,et al.  Aerobic exercise improves self-reported sleep and quality of life in older adults with insomnia. , 2010, Sleep medicine.

[37]  Yanjun Zhang,et al.  Automatic sleep staging using multi-dimensional feature extraction and multi-kernel fuzzy support vector machine. , 2014, Journal of healthcare engineering.

[38]  Stefan Haufe,et al.  A critical assessment of connectivity measures for EEG data: A simulation study , 2013, NeuroImage.

[39]  Theiler,et al.  Spurious dimension from correlation algorithms applied to limited time-series data. , 1986, Physical review. A, General physics.

[40]  M. Czisch,et al.  Development of the brain's default mode network from wakefulness to slow wave sleep. , 2011, Cerebral cortex.

[41]  Panagiotis D. Bamidis,et al.  Automatic Sleep Stage Classification Applying Machine Learning Algorithms on EEG Recordings , 2017, 2017 IEEE 30th International Symposium on Computer-Based Medical Systems (CBMS).

[42]  Yike Guo,et al.  Automatic Sleep Stage Scoring with Single-Channel EEG Using Convolutional Neural Networks , 2016, ArXiv.

[43]  A. Gollhofer,et al.  High-Intensity Jump Training Is Tolerated during 60 Days of Bed Rest and Is Very Effective in Preserving Leg Power and Lean Body Mass: An Overview of the Cologne RSL Study , 2017, PloS one.

[44]  James Philbin,et al.  FaceNet: A unified embedding for face recognition and clustering , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Amr F. Farag,et al.  A Sleep Scoring System Using EEG Combined Spectral and Detrended Fluctuation Analysis Features , 2014 .

[46]  R D Pascual-Marqui,et al.  Standardized low-resolution brain electromagnetic tomography (sLORETA): technical details. , 2002, Methods and findings in experimental and clinical pharmacology.

[47]  Miad Faezipour,et al.  A comparison of different machine learning algorithms using single channel EEG signal for classifying human sleep stages , 2015, 2015 Long Island Systems, Applications and Technology.

[48]  J. Schoffelen,et al.  Source connectivity analysis with MEG and EEG , 2009, Human brain mapping.

[49]  Danilo Rastovic,et al.  Targeting and synchronization at tokamak with recurrent artificial neural networks , 2012, Neural Computing and Applications.

[50]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[51]  I. Segal A Note on the Concept of Entropy , 1960 .

[52]  Ming Yang,et al.  DeepFace: Closing the Gap to Human-Level Performance in Face Verification , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[53]  David Gozal,et al.  An Official American Thoracic Society Statement: The Importance of Healthy Sleep. Recommendations and Future Priorities. , 2015, American journal of respiratory and critical care medicine.

[54]  Richard M. Leahy,et al.  Brainstorm: A User-Friendly Application for MEG/EEG Analysis , 2011, Comput. Intell. Neurosci..

[55]  M. Mohanraj,et al.  Applications of artificial neural networks for thermal analysis of heat exchangers – A review , 2015 .

[56]  Polyxeni T. Gkivogkli,et al.  Cortical connectivity analysis for assessing the impact of microgravity and the efficacy of reactive sledge jumps countermeasure to NREM 2 sleep , 2020 .

[57]  Vinod Menon,et al.  Functional connectivity in the resting brain: A network analysis of the default mode hypothesis , 2002, Proceedings of the National Academy of Sciences of the United States of America.