Development of a Complication- and Treatment-Aware Prediction Model for Favorable Functional Outcome in Aneurysmal Subarachnoid Hemorrhage Based on Machine Learning.

BACKGROUND Current prognostic tools in aneurysmal subarachnoid hemorrhage (aSAH) are constrained by being primarily based on patient and disease characteristics on admission. OBJECTIVE To develop and validate a complication- and treatment-aware outcome prediction tool in aSAH. METHODS This cohort study included data from an ongoing prospective nationwide multicenter registry on all aSAH patients in Switzerland (Swiss SOS [Swiss Study on aSAH]; 2009-2015). We trained supervised machine learning algorithms to predict a binary outcome at discharge (modified Rankin scale [mRS] ≤ 3: favorable; mRS 4-6: unfavorable). Clinical and radiological variables on admission ("Early" Model) as well as additional variables regarding secondary complications and disease management ("Late" Model) were used. Performance of both models was assessed by classification performance metrics on an out-of-sample test dataset. RESULTS Favorable functional outcome at discharge was observed in 1156 (62.0%) of 1866 patients. Both models scored a high accuracy of 75% to 76% on the test set. The "Late" outcome model outperformed the "Early" model with an area under the receiver operator characteristics curve (AUC) of 0.85 vs 0.79, corresponding to a specificity of 0.81 vs 0.70 and a sensitivity of 0.71 vs 0.79, respectively. CONCLUSION Both machine learning models show good discrimination and calibration confirmed on application to an internal test dataset of patients with a wide range of disease severity treated in different institutions within a nationwide registry. Our study indicates that the inclusion of variables reflecting the clinical course of the patient may lead to outcome predictions with superior predictive power compared to a model based on admission data only.

[1]  K. Schaller,et al.  Patterns of care for ruptured aneurysms of the middle cerebral artery: analysis of a Swiss national database (Swiss SOS). , 2019, Journal of neurosurgery.

[2]  J. Sarnthein,et al.  Machine Learning Algorithm Identifies Patients at High Risk for Early Complications After Intracranial Tumor Surgery: Registry-Based Cohort Study. , 2019, Neurosurgery.

[3]  P. Brugger,et al.  The Barrow Neurological Institute Grading Scale as a Predictor for Delayed Cerebral Ischemia and Outcome After Aneurysmal Subarachnoid Hemorrhage: Data From a Nationwide Patient Registry (Swiss SOS) , 2018, Neurosurgery.

[4]  Johannes K Richter,et al.  Decision tree analysis in subarachnoid hemorrhage: prediction of outcome parameters during the course of aneurysmal subarachnoid hemorrhage using decision tree analysis. , 2018, Journal of neurosurgery.

[5]  Timothy R. Smith,et al.  Natural and Artificial Intelligence in Neurosurgery: A Systematic Review , 2018, Neurosurgery.

[6]  T. Schweizer,et al.  Prioritization and Timing of Outcomes and Endpoints After Aneurysmal Subarachnoid Hemorrhage in Clinical Trials and Observational Studies: Proposal of a Multidisciplinary Research Group , 2019, Neurocritical Care.

[7]  P. Bijlenga,et al.  Decision-making and neurosurgeons’ agreement in the management of aneurysmal subarachnoid haemorrhage based on computed tomography angiography , 2018, Acta Neurochirurgica.

[8]  Hester F. Lingsma,et al.  Development and validation of outcome prediction models for aneurysmal subarachnoid haemorrhage: the SAHIT multinational cohort study , 2018, British Medical Journal.

[9]  Jonathan H. Chen,et al.  Machine Learning and Prediction in Medicine - Beyond the Peak of Inflated Expectations. , 2017, The New England journal of medicine.

[10]  Z. Obermeyer,et al.  Predicting the Future - Big Data, Machine Learning, and Clinical Medicine. , 2016, The New England journal of medicine.

[11]  Soojin Park,et al.  Prognostication of long‐term outcomes after subarachnoid hemorrhage: The FRESH score , 2016, Annals of neurology.

[12]  J. Mandrekar,et al.  Predictors of excellent functional outcome in aneurysmal subarachnoid hemorrhage. , 2015, Journal of neurosurgery.

[13]  C. Derdeyn,et al.  Analysis of subarachnoid hemorrhage using the Nationwide Inpatient Sample: the NIS-SAH Severity Score and Outcome Measure. , 2014, Journal of neurosurgery.

[14]  R. Tamargo,et al.  The SAH Score: a comprehensive communication tool. , 2014, Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association.

[15]  B. Ouyang,et al.  Risk Stratification for the In-Hospital Mortality in Subarachnoid Hemorrhage: The HAIR Score , 2014, Neurocritical Care.

[16]  Andrew Baker,et al.  Clinical Outcome Prediction in Aneurysmal Subarachnoid Hemorrhage Using Bayesian Neural Networks with Fuzzy Logic Inferences , 2013, Comput. Math. Methods Medicine.

[17]  C. Woernle,et al.  Introducing a nationwide registry: the Swiss study on aneurysmal subarachnoid haemorrhage (Swiss SOS) , 2012, Acta Neurochirurgica.

[18]  A. Molyneux International Subarachnoid Aneurysm Trial (ISAT) of neurosurgical clipping versus endovascular coiling in 2143 patients with ruptured intracranial aneurysms: a randomised trial , 2002, The Lancet.

[19]  L. Mariani,et al.  Predictors of In-Hospital Death After Aneurysmal Subarachnoid Hemorrhage: Analysis of a Nationwide Database (Swiss SOS [Swiss Study on Aneurysmal Subarachnoid Hemorrhage]) , 2018, Stroke.

[20]  C. Drake,et al.  Report of World Federation of Neurological Surgeons Committee on a Universal Subarachnoid Hemorrhage Grading Scale. , 1988, Journal of neurosurgery.