Supervised and Unsupervised Machine Learning for Automated Scoring of Sleep-Wake and Cataplexy in a Mouse Model of Narcolepsy.

Despite commercial availability of software to facilitate sleep-wake scoring of electroencephalography (EEG) and electromyography (EMG) in animals, automated scoring of rodent models of abnormal sleep, such as narcolepsy with cataplexy, has remained elusive. We optimize two machine-learning approaches, supervised and unsupervised, for automated scoring of behavioral states in orexin/ataxin-3 transgenic mice, a validated model of narcolepsy type 1, and additionally test them on wild-type mice. The supervised learning approach uses previously labeled data to facilitate training of a classifier for sleep states, whereas the unsupervised approach aims to discover latent structure and similarities in unlabeled data from which sleep stages are inferred. For the supervised approach, we employ a deep convolutional neural network architecture that is trained on expert-labeled segments of wake, non-REM sleep, and REM sleep in EEG/EMG time series data. The resulting trained classifier is then used to infer on the labels of previously unseen data. For the unsupervised approach, we leverage data dimensionality reduction and clustering techniques. Both approaches successfully score EEG/EMG data, achieving mean accuracies of 95% and 91%, respectively, in narcoleptic mice, and accuracies of 93% and 89%, respectively, in wild-type mice. Notably, the supervised approach generalized well on previously unseen data from the same animals on which it was trained but exhibited lower performance on animals not present in the training data due to inter-subject variability. Cataplexy is scored with a sensitivity of 85% and 57% using the supervised and unsupervised approaches, respectively, when compared to manual scoring, and the specificity exceeds 99% in both cases.

[1]  Qiao Li,et al.  You Snooze, You Win: the PhysioNet/Computing in Cardiology Challenge 2018 , 2018, 2018 Computing in Cardiology Conference (CinC).

[2]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[3]  Kirsi-Marja Rytkönen,et al.  Automated sleep scoring in rats and mice using the naive Bayes classifier , 2011, Journal of Neuroscience Methods.

[4]  Alexei L. Vyssotski,et al.  EEG gamma frequency and sleep–wake scoring in mice: Comparing two types of supervised classifiers , 2010, Brain Research.

[5]  Christelle Anaclet,et al.  Orexin/Hypocretin and Histamine: Distinct Roles in the Control of Wakefulness Demonstrated Using Knock-Out Mouse Models , 2009, The Journal of Neuroscience.

[6]  A. Gabrielli,et al.  SCOPRISM: A new algorithm for automatic sleep scoring in mice , 2014, Journal of Neuroscience Methods.

[7]  Jon T. Willie,et al.  Genetic Ablation of Orexin Neurons in Mice Results in Narcolepsy, Hypophagia, and Obesity , 2001, Neuron.

[8]  Vance Gao,et al.  Multiple classifier systems for automatic sleep scoring in mice , 2016, Journal of Neuroscience Methods.

[9]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[10]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[11]  Jon T. Willie,et al.  A consensus definition of cataplexy in mouse models of narcolepsy. , 2009, Sleep.

[12]  E. Kochs,et al.  Sleep scoring made easy—Semi-automated sleep analysis software and manual rescoring tools for basic sleep research in mice , 2015, MethodsX.

[13]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[14]  Cecilia G Diniz Behn,et al.  Abnormal sleep/wake dynamics in orexin knockout mice. , 2010, Sleep.

[15]  Genshiro A. Sunagawa,et al.  FASTER: an unsupervised fully automated sleep staging method for mice , 2013, Genes to cells : devoted to molecular & cellular mechanisms.

[16]  Damien Gervasoni,et al.  Unsupervised online classifier in sleep scoring for sleep deprivation studies. , 2015, Sleep.

[17]  Jon T. Willie,et al.  Distinct Narcolepsy Syndromes in Orexin Receptor-2 and Orexin Null Mice Molecular Genetic Dissection of Non-REM and REM Sleep Regulatory Processes , 2003, Neuron.

[18]  Seiji Nishino,et al.  Specificity of direct transition from wake to REM sleep in orexin/ataxin-3 transgenic narcoleptic mice , 2009, Experimental Neurology.

[19]  Poul Jennum,et al.  Neural network analysis of sleep stages enables efficient diagnosis of narcolepsy , 2017, Nature Communications.