Ensembling crowdsourced seizure prediction algorithms using long‐term human intracranial EEG

Seizure prediction is feasible, but greater accuracy is needed to make seizure prediction clinically viable across a large group of patients. Recent work crowdsourced state‐of‐the‐art prediction algorithms in a worldwide competition, yielding improvements in seizure prediction performance for patients whose seizures were previously found hard to anticipate. The aim of the current analysis was to explore potential performance improvements using an ensemble of the top competition algorithms. The results suggest that minor increments in performance may be possible; however, the outcomes of statistical testing limit the confidence in these increments. Our results suggest that for the specific algorithms, evaluation framework, and data considered here, incremental improvements are achievable but there may be upper bounds on machine learning–based seizure prediction performance for some patients whose seizures are challenging to predict. Other more tailored approaches that, for example, take into account a deeper understanding of preictal mechanisms, patient‐specific sleep‐wake rhythms, or novel measurement approaches, may still offer further gains for these types of patients.

[1]  Gerhard Nahler,et al.  Pearson Correlation Coefficient , 2020, Definitions.

[2]  Brian Litt,et al.  Epilepsyecosystem.org: crowd-sourcing reproducible seizure prediction with long-term human intracranial EEG , 2018, Brain : a journal of neurology.

[3]  Levin Kuhlmann,et al.  The circadian profile of epilepsy improves seizure forecasting , 2017, Brain : a journal of neurology.

[4]  L. Tarassenko,et al.  Dynamic Data During Hypotensive Episode Improves Mortality Predictions Among Patients With Sepsis and Hypotension* , 2013, Critical care medicine.

[5]  Cha Zhang,et al.  Ensemble Machine Learning , 2012 .

[6]  S. Hyakin,et al.  Neural Networks: A Comprehensive Foundation , 1994 .

[7]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[8]  Thomas G. Dietterich Multiple Classifier Systems , 2000, Lecture Notes in Computer Science.

[9]  Cha Zhang,et al.  Ensemble Machine Learning: Methods and Applications , 2012 .

[10]  J. Jefferys,et al.  Loss of neuronal network resilience precedes seizures and determines the ictogenic nature of interictal synaptic perturbations , 2018, Nature Neuroscience.

[11]  David M. Himes,et al.  Prediction of seizure likelihood with a long-term, implanted seizure advisory system in patients with drug-resistant epilepsy: a first-in-man study , 2013, The Lancet Neurology.

[12]  Brian Litt,et al.  Crowdsourcing reproducible seizure forecasting in human and canine epilepsy , 2016, Brain : a journal of neurology.

[13]  Terence O'Brien,et al.  Epileptic Seizure Prediction Using Big Data and Deep Learning: Toward a Mobile System , 2017, EBioMedicine.

[14]  G. Worrell,et al.  Seizure Forecasting from Idea to Reality. Outcomes of the My Seizure Gauge Epilepsy Innovation Institute Workshop , 2017, eNeuro.

[15]  F. Mormann,et al.  Seizure prediction: the long and winding road. , 2007, Brain : a journal of neurology.

[16]  Emily A. Mirro,et al.  Multi-day rhythms modulate seizure risk in epilepsy , 2018, Nature Communications.

[17]  Philippa J. Karoly,et al.  Seizure Prediction: Science Fiction or Soon to Become Reality? , 2015, Current Neurology and Neuroscience Reports.

[18]  J. H. Cross,et al.  Operational classification of seizure types by the International League Against Epilepsy: Position Paper of the ILAE Commission for Classification and Terminology , 2017, Epilepsia.

[19]  Jacob Benesty,et al.  Noise Reduction in Speech Processing , 2009 .

[20]  K. Lehnertz,et al.  Seizure prediction — ready for a new era , 2018, Nature Reviews Neurology.