Deepsleep: Fast and Accurate Delineation of Sleep Arousals at Millisecond Resolution by Deep Learning

Background: Sleep arousals are transient periods of wakefulness punctuated into sleep. Excessive sleep arousals are associated with many negative effects including daytime sleepiness and sleep disorders. High-quality annotation of polysomnographic recordings is crucial for the diagnosis of sleep arousal disorders. Currently, sleep arousals are mainly annotated by human experts through looking at millions of data points manually, which requires considerable time and effort. Methods: We used the polysomnograms of 2,994 individuals from two independent datasets (i) PhysioNet Challenge dataset (n=994), and (ii) Sleep Heart Health Study dataset (n=2000) for model training (60%), validation (15%), and testing (25%). We developed a deep convolutional neural network approach, DeepSleep, to automatically segment sleep arousal events. Our method captured the long-range and short-range interactions among physiological signals at multiple time scales to empower the detection of sleep arousals. A novel augmentation strategy by randomly swapping similar physiological channels was further applied to improve the prediction accuracy. Findings: Compared with other computational methods in sleep study, DeepSleep features accurate (area under receiver operating characteristic curve of 0.93 and area under the precision recall curve of 0.55), high-resolution (5-millisecond resolution), and fast (10 seconds per sleep record) delineation of sleep arousals. This method ranked first in segmenting non-apenic arousals when evaluated on a large held-out dataset (n=989) in the 2018 PhysioNet Challenge. We found that DeepSleep provided more detailed delineations than humans, especially at the low-confident boundary regions between arousal and non-arousal events. This indicates that in silico annotations is a complement to human annotations and potentially advances the current binary label system and scoring criteria for sleep arousals. Interpretation: The proposed deep learning model achieved state-of-the-art performance in detection of sleep arousals. By introducing the probability of annotation confidence, this model would provide more accurate information for the diagnosis of sleep disorders and the evaluation of sleep quality. Funding Statement: This work is supported by NSF-US14-PAF07599 (CAREER: On-line Service for Predicting Protein Phosphorylation Dynamics Under Unseen Perturbations NSF), AWD007950 (Digital Biomarkers in Voices for Parkinson's Disease American Parkinson's Disease Association), University of Michigan O'Brien Kidney Translational Core Center, 19AMTG34850176 (American Heart Association and Amazon Web Services3.0 Data Grant Portfolio: Artificial Intelligence and Machine Learning Training Grants), and Michael J. Fox Foundation #17373. Declaration of Interests: YG receives personal payment from Eli Lilly and Company, Genentech Inc, F. Hoffmann-La Roche AG, and Cleerly Inc; holds equity shares at Cleerly Inc and Ann Arbor Algorithms Inc; receives research support from Merck KGaA as research contracts and Ryss Tech as unrestricted donation. Ethics Approval Statement: Not required.

[1]  Qiao Li,et al.  You Snooze, You Win: the PhysioNet/Computing in Cardiology Challenge 2018 , 2018, 2018 Computing in Cardiology Conference (CinC).

[2]  Emmanuel Mignot,et al.  Automatic, electrocardiographic-based detection of autonomic arousals and their association with cortical arousals, leg movements, and respiratory events in sleep , 2018, Sleep.

[3]  Y Q Jiang,et al.  Recognizing basal cell carcinoma on smartphone‐captured digital histopathology images with a deep neural network , 2019, The British journal of dermatology.

[4]  M H Bonnet,et al.  Effect of sleep disruption on sleep, performance, and mood. , 1985, Sleep.

[5]  Masun Nabhan Homsi,et al.  Sleep Arousal Detection From Polysomnography Using the Scattering Transform and Recurrent Neural Networks , 2018, 2018 Computing in Cardiology Conference (CinC).

[6]  Enzo Pasquale Scilingo,et al.  Automated Recognition of Sleep Arousal Using Multimodal and Personalized Deep Ensembles of Neural Networks , 2018, 2018 Computing in Cardiology Conference (CinC).

[7]  T. Paiva,et al.  Sleep deprivation in adolescents: correlations with health complaints and health-related quality of life. , 2015, Sleep medicine.

[8]  Bálint Varga,et al.  Using Auxiliary Loss to Improve Sleep Arousal Detection With Neural Network , 2018, 2018 Computing in Cardiology Conference (CinC).

[9]  Henggui Zhang,et al.  Identification of Arousals With Deep Neural Networks (DNNs) Using Different Physiological Signals , 2018, 2018 Computing in Cardiology Conference (CinC).

[10]  Frédéric Bénard,et al.  Automated Detection of Sleep Arousals From Polysomnography Data Using a Dense Convolutional Neural Network , 2018, 2018 Computing in Cardiology Conference (CinC).

[11]  Yuanfang Guan,et al.  Accurate prediction of personalized olfactory perception from large-scale chemoinformatic features , 2017, GigaScience.

[12]  Lino Nobili,et al.  Sleep, sleep deprivation, autonomic nervous system and cardiovascular diseases , 2017, Neuroscience & Biobehavioral Reviews.

[13]  Arpan Pal,et al.  SleepTight: Identifying Sleep Arousals Using Inter and Intra-Relation of Multimodal Signals , 2018, 2018 Computing in Cardiology Conference (CinC).

[14]  Timothy J Cunningham,et al.  Prevalence of Healthy Sleep Duration among Adults--United States, 2014. , 2016, MMWR. Morbidity and mortality weekly report.

[15]  Laurent Vercueil,et al.  A convolutional neural network for sleep stage scoring from raw single-channel EEG , 2018, Biomed. Signal Process. Control..

[16]  Oliver Y. Chén,et al.  Joint Classification and Prediction CNN Framework for Automatic Sleep Stage Classification , 2018, IEEE Transactions on Biomedical Engineering.

[17]  Haoqi Sun,et al.  Expert-level sleep scoring with deep neural networks , 2018, J. Am. Medical Informatics Assoc..

[18]  Róbert Bódizs,et al.  The nature of arousal in sleep , 2004, Journal of sleep research.

[19]  Oliver Y. Chén,et al.  SeqSleepNet: End-to-End Hierarchical Recurrent Neural Network for Sequence-to-Sequence Automatic Sleep Staging , 2018, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[20]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[21]  Geoffrey E. Hinton,et al.  Learning representations by back-propagating errors , 1986, Nature.

[22]  T. Lallukka,et al.  Prevalence of insomnia‐related symptoms continues to increase in the Finnish working‐age population , 2016, Journal of sleep research.

[23]  Deepak Kumar,et al.  Abstract 5446: Serotonin modulates AKT-mTOR and Notch signaling pathways, promotes liver cancer cell steatosis and cell survival , 2018, Molecular and Cellular Biology / Genetics.

[24]  M. St-Onge Sleep–obesity relation: underlying mechanisms and consequences for treatment , 2017, Obesity reviews : an official journal of the International Association for the Study of Obesity.

[25]  Yuanfang Guan,et al.  Waking up to data challenges , 2019, Nat. Mach. Intell..

[26]  Dorothy Bruck,et al.  The economic cost of inadequate sleep , 2018, Sleep.

[27]  M. Vitiello The interrelationship of sleep and depression: new answers but many questions remain. , 2018, Sleep medicine.

[28]  Nicholas Bambos,et al.  Automatic Sleep Arousal Identification From Physiological Waveforms Using Deep Learning , 2018, 2018 Computing in Cardiology Conference (CinC).

[29]  P. Ainslie,et al.  Influence of nocturnal and daytime sleep on initial orthostatic hypotension , 2014, European Journal of Applied Physiology.

[30]  Olga Sourina,et al.  Large-Scale Automated Sleep Staging , 2017, Sleep.

[31]  David Gozal,et al.  An Official American Thoracic Society Statement: The Importance of Healthy Sleep. Recommendations and Future Priorities. , 2015, American journal of respiratory and critical care medicine.

[32]  Timothy J Cunningham,et al.  Trends in insomnia and excessive daytime sleepiness among U.S. adults from 2002 to 2012. , 2015, Sleep medicine.

[33]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[34]  Y. Guan,et al.  Anchor: trans-cell type prediction of transcription factor binding sites , 2018, Genome research.

[35]  Hanna Ragnarsdóttir,et al.  Automatic Detection of Target Regions of Respiratory Effort-Related Arousals Using Recurrent Neural Networks , 2018, 2018 Computing in Cardiology Conference (CinC).

[36]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[37]  Diego Álvarez-Estévez,et al.  Identification of Electroencephalographic Arousals in Multichannel Sleep Recordings , 2011, IEEE Transactions on Biomedical Engineering.

[38]  András Bánhalmi,et al.  Detection of Respiratory Effort-Related Arousals Using a Hidden Markov Model and Random Decision Forest , 2018, 2018 Computing in Cardiology Conference (CinC).

[39]  J. Samet,et al.  The Sleep Heart Health Study: design, rationale, and methods. , 1997, Sleep.

[40]  Isaac Fernández-Varela,et al.  Combining machine learning models for the automatic detection of EEG arousals , 2017, Neurocomputing.

[41]  Laxmidhar Behera,et al.  Artificial neural network based arousal detection from sleep electroencephalogram data , 2014, 2014 International Conference on Computer, Communications, and Control Technology (I4CT).

[42]  M H Bonnet,et al.  Performance and sleepiness as a function of frequency and placement of sleep disruption. , 1986, Psychophysiology.

[43]  S. Quan,et al.  AASM Scoring Manual Updates for 2017 (Version 2.4). , 2017, Journal of clinical sleep medicine : JCSM : official publication of the American Academy of Sleep Medicine.

[44]  Isaac Fernández-Varela,et al.  Large-scale validation of an automatic EEG arousal detection algorithm using different heterogeneous databases. , 2018, Sleep medicine.

[45]  Mathias Basner,et al.  An ECG-based algorithm for the automatic identification of autonomic activations associated with cortical arousal. , 2007, Sleep.