Deep Neural Dynamic Bayesian Networks Applied to EEG Sleep Spindles Modeling

We propose a generative model for single-channel EEG that incorporates the constraints experts actively enforce during visual scoring. The framework takes the form of a dynamic Bayesian network with depth in both the latent variables and the observation likelihoods-while the hidden variables control the durations, state transitions, and robustness, the observation architectures parameterize Normal-Gamma distributions. The resulting model allows for time series segmentation into local, reoccurring dynamical regimes by exploiting probabilistic models and deep learning. Unlike typical detectors, our model takes the raw data (up to resampling) without pre-processing (e.g., filtering, windowing, thresholding) or post-processing (e.g., event merging). This not only makes the model appealing to real-time applications, but it also yields interpretable hyperparameters that are analogous to known clinical criteria. We derive algorithms for exact, tractable inference as a special case of Generalized Expectation Maximization via dynamic programming and backpropagation. We validate the model on three public datasets and provide support that more complex models are able to surpass state-of-the-art detectors while being transparent, auditable, and generalizable.

[1]  Bhiksha Raj,et al.  Hidden Markov Model Variational Autoencoder for Acoustic Unit Discovery , 2017, INTERSPEECH.

[2]  David Duvenaud,et al.  Inference Suboptimality in Variational Autoencoders , 2018, ICML.

[3]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[4]  C. Phillips,et al.  Sleep Spindles as an Electrographic Element: Description and Automatic Detection Methods , 2016, Neural plasticity.

[5]  I. Fried,et al.  Regional Slow Waves and Spindles in Human Sleep , 2011, Neuron.

[6]  Andrew J. Viterbi,et al.  Error bounds for convolutional codes and an asymptotically optimum decoding algorithm , 1967, IEEE Trans. Inf. Theory.

[7]  William D. Penny,et al.  Dynamic Models for Nonstationary Signal Segmentation , 1999, Comput. Biomed. Res..

[8]  Thierry Dutoit,et al.  Automatic sleep spindles detection — Overview and development of a standard proposal assessment method , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[9]  Rodrigo Quian Quiroga,et al.  Imaging Brain Function With EEG , 2013, Springer New York.

[10]  Pietro Perona,et al.  Sleep spindle detection: crowdsourcing and evaluating performance of experts, non-experts, and automated methods , 2014, Nature Methods.

[11]  Marcello Massimini,et al.  Reduced sleep spindle activity in schizophrenia patients , 2007 .

[12]  Max Welling,et al.  Auto-Encoding Variational Bayes , 2013, ICLR.

[13]  Walter J. Freeman,et al.  Imaging Brain Function With EEG: Advanced Temporal and Spatial Analysis of Electroencephalographic Signals , 2012 .

[14]  L. Colgin Rhythms of the hippocampal network , 2016, Nature Reviews Neuroscience.

[15]  Julie Carrier,et al.  Topography of age-related changes in sleep spindles , 2013, Neurobiology of Aging.

[16]  A. Chesson,et al.  The AASM Manual for the Scoring of Sleep and Associated Events: Rules, Terminology, and Techinical Specifications , 2007 .

[17]  Graham Neubig,et al.  Lagging Inference Networks and Posterior Collapse in Variational Autoencoders , 2019, ICLR.

[18]  Nir Friedman,et al.  Probabilistic Graphical Models - Principles and Techniques , 2009 .

[19]  Lawrence R. Rabiner,et al.  A tutorial on hidden Markov models and selected applications in speech recognition , 1989, Proc. IEEE.

[20]  Christophe Phillips,et al.  fMRI Artefact Rejection and Sleep Scoring Toolbox , 2011, Comput. Intell. Neurosci..

[21]  Uri Shalit,et al.  Structured Inference Networks for Nonlinear State Space Models , 2016, AAAI.

[22]  J. Born,et al.  Fast and slow spindles during the sleep slow oscillation: disparate coalescence and engagement in memory processing. , 2011, Sleep.

[23]  Geoffrey J. McLachlan,et al.  Robust mixture modelling using the t distribution , 2000, Stat. Comput..

[24]  Ernst Fernando Lopes Da Silva Niedermeyer,et al.  Electroencephalography, basic principles, clinical applications, and related fields , 1982 .

[25]  Ryan P. Adams,et al.  Composing graphical models with neural networks for structured representations and fast inference , 2016, NIPS.

[26]  Shunzheng Yu,et al.  Hidden semi-Markov models , 2010, Artif. Intell..

[27]  A. Rechtschaffen,et al.  A manual of standardized terminology, technique and scoring system for sleep stages of human subjects , 1968 .

[28]  Ivan W. Selesnick,et al.  Sleep spindle detection using time-frequency sparsity , 2014, 2014 IEEE Signal Processing in Medicine and Biology Symposium (SPMB).

[29]  Julie A. E. Christensen,et al.  Validation of a novel automatic sleep spindle detector with high performance during sleep in middle aged subjects , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[30]  Ann K. Shinn,et al.  Reduced Sleep Spindles and Spindle Coherence in Schizophrenia: Mechanisms of Impaired Memory Consolidation? , 2012, Biological Psychiatry.

[31]  Manuel Schabus,et al.  Sleep spindles and their significance for declarative memory consolidation. , 2004, Sleep.

[32]  E. Wolpert A Manual of Standardized Terminology, Techniques and Scoring System for Sleep Stages of Human Subjects. , 1969 .

[33]  T. Sejnowski,et al.  Thalamocortical oscillations in the sleeping and aroused brain. , 1993, Science.

[34]  Alexander M. Rush,et al.  Avoiding Latent Variable Collapse With Generative Skip Models , 2018, AISTATS.

[35]  Zhe Dong,et al.  Collapsed Amortized Variational Inference for Switching Nonlinear Dynamical Systems , 2020, ICML.

[36]  A. Rechtschaffen A manual of Standardized Terminology , 1968 .