Attention-Based Network for Weak Labels in Neonatal Seizure Detection

Seizures are a common emergency in the neonatal intesive care unit (NICU) among newborns receiving therapeutic hypothermia for hypoxic ischemic encephalopathy. The high incidence of seizures in this patient population necessitates continuous electroencephalographic (EEG) monitoring to detect and treat them. Due to EEG recordings being reviewed intermittently throughout the day, inevitable delays to seizure identification and treatment arise. In recent years, work on neonatal seizure detection using deep learning algorithms has started gaining momentum. These algorithms face numerous challenges: first, the training data for such algorithms comes from individual patients, each with varying levels of label imbalance since the seizure burden in NICU patients differs by several orders of magnitude. Second, seizures in neonates are usually localized in a subset of EEG channels, and performing annotations per channel is very time-consuming. Hence models which make use of labels only per time periods, and not per channels, are preferable. In this work we assess how different deep learning models and data balancing methods influence learning in neonatal seizure detection in EEGs. We propose a model which provides a level of importance to each of the EEG channels - a proxy to whether a channel exhibits seizure activity or not, and we provide a quantitative assessment of how well this mechanism works. The model is portable to EEG devices with differing layouts without retraining, facilitating its potential deployment across different medical centers. We also provide a first assessment of how a deep learning model for neonatal seizure detection agrees with human rater decisions - an important milestone for deployment to clinical practice. We show that high AUC values in a deep learning model do not necessarily correspond to agreement with a human expert, and there is still a need to further refine such algorithms for optimal seizure discrimination.

[1]  Wenyu Liu,et al.  Revisiting multiple instance neural networks , 2016, Pattern Recognit..

[2]  Yixin Chen,et al.  Predicting Hospital Readmission via Cost-Sensitive Deep Learning , 2018, IEEE/ACM Transactions on Computational Biology and Bioinformatics.

[3]  Max Welling,et al.  Attention-based Deep Multiple Instance Learning , 2018, ICML.

[4]  Qingming Huang,et al.  Relay Backpropagation for Effective Learning of Deep Convolutional Neural Networks , 2015, ECCV.

[5]  Lawrence J Hirsch,et al.  Use of EEG Monitoring and Management of Non-Convulsive Seizures in Critically Ill Patients: A Survey of Neurologists , 2010, Neurocritical care.

[6]  Guideline Two: Minimum Technical Standards for Pediatric Electroencephalography , 1986, American journal of electroneurodiagnostic technology.

[7]  H. Glass,et al.  Continuous Video Electroencephalographic (EEG) Monitoring for Electrographic Seizure Diagnosis in Neonates: A Single-Center Study , 2016, Journal of child neurology.

[8]  Ah Chung Tsoi,et al.  Neural Network Classification and Prior Class Probabilities , 1996, Neural Networks: Tricks of the Trade.

[9]  Guideline Thirteen: Guidelines for Standard Electrode Position Nomenclature , 1994, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[10]  Zhi-Hua Zhou,et al.  Ieee Transactions on Knowledge and Data Engineering 1 Training Cost-sensitive Neural Networks with Methods Addressing the Class Imbalance Problem , 2022 .

[11]  Sampsa Vanhatalo,et al.  Interobserver agreement for neonatal seizure detection using multichannel EEG , 2015, Annals of clinical and translational neurology.

[12]  Weidong Zhou,et al.  Epileptic seizure detection based on imbalanced classification and wavelet packet transform , 2017, Seizure.

[13]  F. Wilcoxon Individual Comparisons by Ranking Methods , 1945 .

[14]  William P. Marnane,et al.  Validation of an automated seizure detection algorithm for term neonates , 2016, Clinical Neurophysiology.

[15]  Jimmy Ming-Tai Wu,et al.  Intelligent Signal Classifier for Brain Epileptic EEG Based on Decision Tree, Multilayer Perceptron and Over-Sampling Approach , 2019, Lecture Notes in Networks and Systems.

[16]  A. Verma Long-term prognosis in children with neonatal seizures: A population-based study , 2008 .

[17]  N. J. Stevenson,et al.  Descriptor : A dataset of neonatal EEG recordings with seizure annotations , 2019 .

[18]  Geraldine B. Boylan,et al.  Neonatal seizure detection using convolutional neural networks , 2017, 2017 IEEE 27th International Workshop on Machine Learning for Signal Processing (MLSP).

[19]  Jan Claassen,et al.  Continuous EEG monitoring: A survey of neurophysiologists and neurointensivists , 2014, Epilepsia.

[20]  A. Temko,et al.  In-depth performance analysis of an EEG based neonatal seizure detection algorithm , 2016, Clinical Neurophysiology.

[21]  Charles Elkan,et al.  The Foundations of Cost-Sensitive Learning , 2001, IJCAI.

[22]  William P. Marnane,et al.  Robust neonatal EEG seizure Detection through Adaptive Background Modeling , 2013, Int. J. Neural Syst..

[23]  Jacob Cohen,et al.  The Equivalence of Weighted Kappa and the Intraclass Correlation Coefficient as Measures of Reliability , 1973 .

[24]  H. Frndova,et al.  Seizure burden is independently associated with short term outcome in critically ill children. , 2014, Brain : a journal of neurology.

[25]  Nitesh V. Chawla,et al.  SMOTE: Synthetic Minority Over-sampling Technique , 2002, J. Artif. Intell. Res..

[26]  William P. Marnane,et al.  Clinical implementation of a neonatal seizure detection algorithm , 2015, Decis. Support Syst..

[27]  Gordon Lightbody,et al.  Neonatal seizure detection from raw multi-channel EEG using a fully convolutional architecture , 2019, Neural Networks.

[28]  Atsuto Maki,et al.  A systematic study of the class imbalance problem in convolutional neural networks , 2017, Neural Networks.

[29]  Sampsa Vanhatalo,et al.  Time-Varying EEG Correlations Improve Automated Neonatal Seizure Detection , 2019, Int. J. Neural Syst..

[30]  Victor S. Sheng,et al.  Cost-Sensitive Learning and the Class Imbalance Problem , 2008 .

[31]  Jacob Cohen A Coefficient of Agreement for Nominal Scales , 1960 .

[32]  G. Lightbody,et al.  Detecting Neonatal Seizures With Computer Algorithms. , 2016, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[33]  G. Lightbody,et al.  Performance assessment for EEG-based neonatal seizure detectors , 2011, Clinical Neurophysiology.

[34]  N. Chiu,et al.  Prognostic factors of developmental outcome in neonatal seizures in term infants. , 2013, Pediatrics and neonatology.

[35]  D. Ferriero,et al.  Video-EEG monitoring in newborns with hypoxic-ischemic encephalopathy treated with hypothermia , 2011, Neurology.

[36]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[37]  Steven P. Miller,et al.  Clinical Neonatal Seizures are Independently Associated with Outcome in Infants at Risk for Hypoxic-Ischemic Brain Injury. , 2009, The Journal of pediatrics.

[38]  Werner Vach,et al.  The dependence of Cohen's kappa on the prevalence does not matter. , 2005, Journal of clinical epidemiology.

[39]  Brendan J. Frey,et al.  Classifying and segmenting microscopy images with deep multiple instance learning , 2015, Bioinform..

[40]  Taeun Chang,et al.  The American Clinical Neurophysiology Society's Guideline on Continuous Electroencephalography Monitoring in Neonates. , 2011, Journal of clinical neurophysiology : official publication of the American Electroencephalographic Society.

[41]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[42]  Reid A. Johnson,et al.  Calibrating Probability with Undersampling for Unbalanced Classification , 2015, 2015 IEEE Symposium Series on Computational Intelligence.

[43]  Mohammed Bennamoun,et al.  Cost-Sensitive Learning of Deep Feature Representations From Imbalanced Data , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[44]  G. Lightbody,et al.  EEG-based neonatal seizure detection with Support Vector Machines , 2011, Clinical Neurophysiology.

[45]  G. Boylan,et al.  Seizure burden and neurodevelopmental outcome in neonates with hypoxic–ischemic encephalopathy , 2016, Developmental medicine and child neurology.

[46]  Taghi M. Khoshgoftaar,et al.  Survey on deep learning with class imbalance , 2019, J. Big Data.