Machine learning improves prediction of delayed cerebral ischemia in patients with subarachnoid hemorrhage

Background and purpose Delayed cerebral ischemia (DCI) is a severe complication in patients with aneurysmal subarachnoid hemorrhage. Several associated predictors have been previously identified. However, their predictive value is generally low. We hypothesize that Machine Learning (ML) algorithms for the prediction of DCI using a combination of clinical and image data lead to higher predictive accuracy than previously applied logistic regressions. Materials and methods Clinical and baseline CT image data from 317 patients with aneurysmal subarachnoid hemorrhage were included. Three types of analysis were performed to predict DCI. First, the prognostic value of known predictors was assessed with logistic regression models. Second, ML models were created using all clinical variables. Third, image features were extracted from the CT images using an auto-encoder and combined with clinical data to create ML models. Accuracy was evaluated based on the area under the curve (AUC), sensitivity and specificity with 95% CI. Results The best AUC of the logistic regression models for known predictors was 0.63 (95% CI 0.62 to 0.63). For the ML algorithms with clinical data there was a small but statistically significant improvement in the AUC to 0.68 (95% CI 0.65 to 0.69). Notably, aneurysm width and height were included in many of the ML models. The AUC was highest for ML models that also included image features: 0.74 (95% CI 0.72 to 0.75). Conclusion ML algorithms significantly improve the prediction of DCI in patients with aneurysmal subarachnoid hemorrhage, particularly when image features are also included. Our experiments suggest that aneurysm characteristics are also associated with the development of DCI.

[1]  Namkug Kim,et al.  Deep into the Brain: Artificial Intelligence in Stroke Imaging , 2017, Journal of stroke.

[2]  Wei Xiong,et al.  Stacked Convolutional Denoising Auto-Encoders for Feature Representation , 2017, IEEE Transactions on Cybernetics.

[3]  Xiangrong Zhou,et al.  Classification of teeth in cone-beam CT using deep convolutional neural network , 2017, Comput. Biol. Medicine.

[4]  Yanrong Guo,et al.  Identifying Patients at Risk for Aortic Stenosis Through Learning from Multimodal Data , 2016, MICCAI.

[5]  H. Marquering,et al.  Association of Automatically Quantified Total Blood Volume after Aneurysmal Subarachnoid Hemorrhage with Delayed Cerebral Ischemia , 2016, American Journal of Neuroradiology.

[6]  Wojtek Kowalczyk,et al.  An Incremental Algorithm for Repairing Training Sets with Missing Values , 2016, IPMU.

[7]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[8]  S. Mayer,et al.  The VASOGRADE: A Simple Grading Scale for Prediction of Delayed Cerebral Ischemia After Subarachnoid Hemorrhage , 2015, Stroke.

[9]  Mathieu Aubry,et al.  Understanding Deep Features with Computer-Generated Imagery , 2015, ICCV.

[10]  Geoffrey Zweig,et al.  An introduction to computational networks and the computational network toolkit (invited talk) , 2014, INTERSPEECH.

[11]  H. Asadi,et al.  Machine Learning for Outcome Prediction of Acute Ischemic Stroke Post Intra-Arterial Therapy , 2014, PloS one.

[12]  R. Macdonald,et al.  Delayed neurological deterioration after subarachnoid haemorrhage , 2014, Nature Reviews Neurology.

[13]  Yudong Zhang,et al.  Classification of Alzheimer Disease Based on Structural Magnetic Resonance Imaging by Kernel Support Vector Machine Decision Tree , 2014 .

[14]  J. Marrero,et al.  Machine Learning Algorithms Outperform Conventional Regression Models in Predicting Development of Hepatocellular Carcinoma , 2013, The American Journal of Gastroenterology.

[15]  N. K. de Rooij,et al.  Early Prediction of Delayed Cerebral Ischemia After Subarachnoid Hemorrhage: Development and Validation of a Practical Risk Chart , 2013, Stroke.

[16]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Jürgen Schmidhuber,et al.  Stacked Convolutional Auto-Encoders for Hierarchical Feature Extraction , 2011, ICANN.

[18]  Arthur Liberzon,et al.  Combining clinical, pathology, and gene expression data to predict recurrence of hepatocellular carcinoma. , 2011, Gastroenterology.

[19]  Daoqiang Zhang,et al.  Multimodal classification of Alzheimer's disease and mild cognitive impairment , 2011, NeuroImage.

[20]  Jan Claassen,et al.  Quantitative Analysis of Hemorrhage Volume for Predicting Delayed Cerebral Ischemia After Subarachnoid Hemorrhage , 2011, Stroke.

[21]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[22]  Joseph P Broderick,et al.  Definition of Delayed Cerebral Ischemia After Aneurysmal Subarachnoid Hemorrhage as an Outcome Event in Clinical Trials and Observational Studies: Proposal of a Multidisciplinary Research Group , 2010, Stroke.

[23]  Araceli Sanchis,et al.  Predicting the Outcome of Patients With Subarachnoid Hemorrhage Using Machine Learning Techniques , 2009, IEEE Transactions on Information Technology in Biomedicine.

[24]  A. Cruickshank,et al.  Subarachnoid haemorrhage , 2007, The Lancet.

[25]  Charles E McCulloch,et al.  Relaxing the rule of ten events per variable in logistic and Cox regression. , 2007, American journal of epidemiology.

[26]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[27]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[28]  Vladimir Vapnik,et al.  Support-vector networks , 2004, Machine Learning.

[29]  Shigeo Abe DrEng Pattern Classification , 2001, Springer London.

[30]  Ron Kohavi,et al.  A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection , 1995, IJCAI.

[31]  Heekuck Oh,et al.  Neural Networks for Pattern Recognition , 1993, Adv. Comput..

[32]  David G. Stork,et al.  Pattern Classification , 1973 .