Expert-level automated sleep staging of long-term scalp EEG recordings using deep learning.

STUDY OBJECTIVES Develop a high-performing, automated sleep scoring algorithm that can be applied to long-term scalp electroencephalography (EEG) recordings. METHODS Using a clinical dataset of polysomnograms from 6,431 patients (MGH-PSG dataset), we trained a deep neural network to classify sleep stages based on scalp EEG data. The algorithm consists of a convolutional neural network (CNN) for feature extraction, followed by a recurrent neural network (RNN) that extracts temporal dependencies of sleep stages. The algorithm's inputs are 4 scalp EEG bipolar channels (F3-C3, C3-O1, F4-C4, C4-O2), which can be derived from any standard PSG or scalp EEG recording. We initially trained the algorithm on the MGH-PSG dataset and used transfer learning to fine-tune it on a dataset of long-term (24-72 hour) scalp EEG recordings from 112 patients (scalpEEG dataset). RESULTS The algorithm achieved a Cohen's kappa of 0.74 on the MGH-PSG holdout testing set and cross-validated Cohen's kappa of 0.78 after optimization on the scalpEEG dataset. The algorithm also performed well on two publicly available PSG datasets, demonstrating high generalizability. Performance on all datasets was comparable to the inter-rater agreement of human sleep staging experts (Cohen's kappa ~ 0.75±0.11). The algorithm's performance on long-term scalp EEGs was robust over a wide age range and across common EEG background abnormalities. CONCLUSION We developed a deep learning algorithm that achieves human expert level sleep staging performance on long-term scalp EEG recordings. This algorithm, which we have made publicly available, greatly facilitates the use of large long-term EEG clinical datasets for sleep-related research.

[1]  Erik Bresch,et al.  Recurrent Deep Neural Networks for Real-Time Sleep Stage Classification From Single Channel EEG , 2018, Front. Comput. Neurosci..

[2]  C. Iber,et al.  A multisite randomized trial of portable sleep studies and positive airway pressure autotitration versus laboratory-based polysomnography for the diagnosis and treatment of obstructive sleep apnea: the HomePAP study. , 2012, Sleep.

[3]  Stefan Debener,et al.  Machine‐learning‐derived sleep–wake staging from around‐the‐ear electroencephalogram outperforms manual scoring and actigraphy , 2018, Journal of sleep research.

[4]  C. O’Reilly,et al.  Montreal Archive of Sleep Studies: an open‐access resource for instrument benchmarking and exploratory research , 2014, Journal of sleep research.

[5]  A. Pack,et al.  Performance of an automated polysomnography scoring system versus computer-assisted manual scoring. , 2013, Sleep.

[6]  Chen Sun,et al.  Revisiting Unreasonable Effectiveness of Data in Deep Learning Era , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[7]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[8]  M. Younes,et al.  Accuracy of Automatic Polysomnography Scoring Using Frontal Electrodes. , 2016, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[9]  P. Anderer,et al.  Interrater reliability for sleep scoring according to the Rechtschaffen & Kales and the new AASM standard , 2009, Journal of sleep research.

[10]  Tim Bressmann,et al.  Self-inflicted cosmetic tongue split: a case report. , 2004, Journal.

[11]  Oliver Y. Chén,et al.  SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[12]  Ram Bilas Pachori,et al.  Automatic classification of sleep stages based on the time-frequency image of EEG signals , 2013, Comput. Methods Programs Biomed..

[13]  Milena Pavlova,et al.  Co-morbid sleep disorders and epilepsy: A narrative review and case examples , 2018, Epilepsy Research.

[14]  Georg Dorffner,et al.  Computer-Assisted Automated Scoring of Polysomnograms Using the Somnolyzer System. , 2015, Sleep.

[15]  Barbara A. Dworetzky,et al.  Diagnostic yield of ambulatory EEGs in the elderly , 2017, Clinical Neurophysiology.

[16]  Sheng-Fu Liang,et al.  A rule-based automatic sleep staging method , 2012, Journal of Neuroscience Methods.

[17]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[18]  Véronique Latreille,et al.  Novel non-pharmacological insomnia treatment – a pilot study , 2019, Nature and science of sleep.

[19]  Ying Zhang,et al.  Interrater agreement between American and Chinese sleep centers according to the 2014 AASM standard , 2019, Sleep and Breathing.

[20]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[21]  Yu-Liang Hsu,et al.  Automatic sleep stage recurrent neural classifier using energy features of EEG signals , 2013, Neurocomputing.

[22]  Armin Mohamed,et al.  The utility of prolonged outpatient ambulatory EEG , 2012, Seizure.

[23]  K. Loparo,et al.  Evaluation of an automated single-channel sleep staging algorithm , 2015, Nature and science of sleep.

[24]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[25]  Guo-Qiang Zhang,et al.  The National Sleep Research Resource: towards a sleep data commons , 2018, BCB.

[26]  A. Muzet,et al.  Sleep stage scoring using the neural network model: comparison between visual and automatic analysis in normal subjects and patients. , 1996, Sleep.

[27]  Mohammed Imamul Hassan Bhuiyan,et al.  An automated method for sleep staging from EEG signals using normal inverse Gaussian parameters and adaptive boosting , 2017, Neurocomputing.

[28]  M. McHugh Interrater reliability: the kappa statistic , 2012, Biochemia medica.

[29]  Haoqi Sun,et al.  Expert-level sleep scoring with deep neural networks , 2018, J. Am. Medical Informatics Assoc..

[30]  R. Rosenberg,et al.  The American Academy of Sleep Medicine inter-scorer reliability program: sleep stage scoring. , 2013, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[31]  J. Mattout,et al.  Automatic analysis of single-channel sleep EEG: validation in healthy individuals. , 2007, Sleep.

[32]  T. Kjaer,et al.  Drug taper during long‐term video‐EEG monitoring: efficiency and safety , 2017, Acta neurologica Scandinavica.

[33]  Marcus Ng,et al.  Why Are Seizures Rare in Rapid Eye Movement Sleep? Review of the Frequency of Seizures in Different Sleep Stages , 2013, Epilepsy research and treatment.

[34]  David Kent,et al.  Automated Sleep Stage Scoring of the Sleep Heart Health Study Using Deep Neural Networks. , 2019, Sleep.

[35]  Martin Luessi,et al.  MEG and EEG data analysis with MNE-Python , 2013, Front. Neuroinform..

[36]  Wei Wang,et al.  Gastric Banding Surgery versus Continuous Positive Airway Pressure for Obstructive Sleep Apnea: A Randomized Controlled Trial. , 2017, American journal of respiratory and critical care medicine.

[37]  K. Müller,et al.  Automatic sleep stage classification using two-channel electro-oculography , 2007, Journal of Neuroscience Methods.

[38]  Tobias Loddenkemper,et al.  The Need for Antiepileptic Drug Chronotherapy to Treat Selected Childhood Epilepsy Syndromes and Avert the Harmful Consequences of Drug Resistance , 2017, Journal of central nervous system disease.

[39]  Leigh Anne Shafer,et al.  Breakthrough Spikes in Rapid Eye Movement Sleep from the Epilepsy Monitoring Unit are Associated with Peak Seizure Frequency. , 2019, Sleep.

[40]  Urbano Nunes,et al.  Automatic sleep staging: A computer assisted approach for optimal combination of features and polysomnographic channels , 2013, Expert Syst. Appl..

[41]  H. Dickhaus,et al.  Classification of Sleep Stages Using Multi-wavelet Time Frequency Entropy and LDA , 2010, Methods of Information in Medicine.

[42]  Justin Dauwels,et al.  Development of Expert-Level Automated Detection of Epileptiform Discharges During Electroencephalogram Interpretation. , 2020, JAMA neurology.

[43]  Karim Jerbi,et al.  Learning machines and sleeping brains: Automatic sleep stage classification using decision-tree multi-class support vector machines , 2015, Journal of Neuroscience Methods.

[44]  A. Hassan,et al.  A decision support system for automatic sleep staging from EEG signals using tunable Q-factor wavelet transform and spectral features , 2016, Journal of Neuroscience Methods.

[45]  Catherine P. Jayapandian,et al.  Scaling Up Scientific Discovery in Sleep Medicine: The National Sleep Research Resource. , 2016, Sleep.