Development and validation of machine learning prediction model based on computed tomography angiography–derived hemodynamics for rupture status of intracranial aneurysms: a Chinese multicenter study

Objectives To build models based on conventional logistic regression (LR) and machine learning (ML) algorithms combining clinical, morphological, and hemodynamic information to predict individual rupture status of unruptured intracranial aneurysms (UIAs), afterwards tested in internal and external validation datasets. Methods Patients with intracranial aneurysms diagnosed by computed tomography angiography and confirmed by invasive cerebral angiograph or clipping surgery were included. The prediction models were developed based on clinical, aneurysm morphological, and hemodynamic parameters by conventional LR and ML methods. Results The training, internal validation, and external validation cohorts were composed of 807 patients, 200 patients, and 108 patients, respectively. The area under curves (AUCs) of conventional LR models 1 (clinical), 2 (clinical and aneurysm morphological), and 3 (clinical, aneurysm morphological and hemodynamic characteristics) were 0.608, 0.765, and 0.886, respectively (all p  < 0.05). The AUCs of ML models using random forest (RF), multilayer perceptron (MLP), and support vector machine (SVM) were 0.871, 0.851, and 0.863, respectively. There were no difference among AUCs of conventional LR, RF, and SVM (all p  > 0.05/6), while the AUC of MLP was lower than that of conventional LR ( p  = 0.0055). Conclusion Hemodynamic parameters play an important role in the prediction performance of the models. ML methods cannot outperform conventional LR in prediction models for rupture status of UIAs integrating clinical, aneurysm morphological, and hemodynamic parameters. Key Points • The addition of hemodynamic parameters can improve prediction performance for rupture status of unruptured intracranial aneurysms. • Machine learning algorithms cannot outperform conventional logistic regression in prediction models for rupture status integrating clinical, aneurysm morphological, and hemodynamic parameters. • Models integrating clinical, aneurysm morphological, and hemodynamic parameters may help choose the optimal management.

[1]  Jie Ma,et al.  A systematic review shows no performance benefit of machine learning over logistic regression for clinical prediction models. , 2019, Journal of clinical epidemiology.

[2]  Elazer R. Edelman,et al.  Role of Fluid Dynamics and Inflammation in Intracranial Aneurysm Formation , 2014, Circulation.

[3]  A. Algra,et al.  Prevalence of unruptured intracranial aneurysms, with emphasis on sex, age, comorbidity, country, and time period: a systematic review and meta-analysis , 2011, The Lancet Neurology.

[4]  K. Lovblad,et al.  Wall Shear Stress Distribution of Small Aneurysms Prone to Rupture: A Case–Control Study , 2014, Stroke.

[5]  J. Mocco,et al.  Hemodynamic–Morphologic Discriminants for Intracranial Aneurysm Rupture , 2011, Stroke.

[6]  Anil Can,et al.  Association of Hemodynamic Factors With Intracranial Aneurysm Formation and Rupture: Systematic Review and Meta-analysis. , 2016, Neurosurgery.

[7]  Bing Zhao,et al.  Prediction of rupture risk in anterior communicating artery aneurysms with a feed-forward artificial neural network , 2018, European Radiology.

[8]  A. Algra,et al.  Long-term outcomes of patients with aneurysmal subarachnoid haemorrhage , 2011, The Lancet Neurology.

[9]  C. Prestigiacomo,et al.  Influence of Relative Residence Time on Side-Wall Aneurysm Inception , 2018, Neurosurgery.

[10]  O. Naggara,et al.  Endovascular treatment of intracranial unruptured aneurysms: systematic review and meta-analysis of the literature on safety and efficacy. , 2010, Radiology.

[11]  E. Ross,et al.  Philosophy of Science Association , 2022 .

[12]  Toshihiro Ishibashi,et al.  Development of the PHASES score for prediction of risk of rupture of intracranial aneurysms: a pooled analysis of six prospective cohort studies , 2014, The Lancet Neurology.

[13]  Shengzhang Wang,et al.  Influence of Hemodynamic Factors on Rupture of Intracranial Aneurysms: Patient-Specific 3D Mirror Aneurysms Model Computational Fluid Dynamics Simulation , 2011, American Journal of Neuroradiology.

[14]  Guo-Zhong Chen,et al.  Reproducibility of image-based computational models of intracranial aneurysm: a comparison between 3D rotational angiography, CT angiography and MR angiography , 2016, BioMedical Engineering OnLine.

[15]  L. Jou,et al.  Wall Shear Stress on Ruptured and Unruptured Intracranial Aneurysms at the Internal Carotid Artery , 2008, American Journal of Neuroradiology.

[16]  Eric J Topol,et al.  High-performance medicine: the convergence of human and artificial intelligence , 2019, Nature Medicine.

[17]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[18]  Joseph P Broderick,et al.  Unruptured intracranial aneurysms: epidemiology, natural history, management options, and familial screening , 2014, The Lancet Neurology.

[19]  H A Marquering,et al.  Additional Value of Intra-Aneurysmal Hemodynamics in Discriminating Ruptured versus Unruptured Intracranial Aneurysms , 2015, American Journal of Neuroradiology.

[20]  Jin Pyeong Jeon,et al.  Machine Learning Application for Rupture Risk Assessment in Small-Sized Intracranial Aneurysm , 2019, Journal of clinical medicine.

[21]  Nicole Varble,et al.  Shared and Distinct Rupture Discriminants of Small and Large Intracranial Aneurysms , 2018, Stroke.

[22]  Aki Laakso,et al.  Saccular intracranial aneurysm: pathology and mechanisms , 2012, Acta Neuropathologica.

[23]  J. Xiang,et al.  High WSS or Low WSS? Complex Interactions of Hemodynamics with Intracranial Aneurysm Initiation, Growth, and Rupture: Toward a Unifying Hypothesis , 2014, American Journal of Neuroradiology.

[24]  E. Connolly,et al.  Guidelines for the Management of Patients With Unruptured Intracranial Aneurysms: A Guideline for Healthcare Professionals From the American Heart Association/American Stroke Association , 2015, Stroke.

[25]  Yuichi Murayama,et al.  Prediction model for 3‐year rupture risk of unruptured cerebral aneurysms in Japanese patients , 2015, Annals of neurology.

[26]  Makoto Yamamoto,et al.  Hemodynamic Differences Between Unruptured and Ruptured Intracranial Aneurysms During Observation , 2012, Stroke.

[27]  F. Mut,et al.  Association of Hemodynamic Characteristics and Cerebral Aneurysm Rupture , 2011, American Journal of Neuroradiology.

[28]  H. Marquering,et al.  Rupture-Associated Changes of Cerebral Aneurysm Geometry: High-Resolution 3D Imaging before and after Rupture , 2014, American Journal of Neuroradiology.

[29]  Fujimaro Ishida,et al.  Low Wall Shear Stress Is Independently Associated With the Rupture Status of Middle Cerebral Artery Aneurysms , 2013, Stroke.

[30]  I. Kohane,et al.  Big Data and Machine Learning in Health Care. , 2018, JAMA.

[31]  Li Liang,et al.  Prediction of 30-Day All-Cause Readmissions in Patients Hospitalized for Heart Failure: Comparison of Machine Learning and Other Statistical Approaches , 2017, JAMA cardiology.

[32]  S. Fukuhara,et al.  The natural course of unruptured cerebral aneurysms in a Japanese cohort. , 2012, The New England journal of medicine.

[33]  Youxiang Li,et al.  Prediction of Aneurysm Stability Using a Machine Learning Model Based on PyRadiomics-Derived Morphological Features. , 2019, Stroke.

[34]  A. Malek,et al.  Wall shear stress association with rupture status in volume matched sidewall aneurysms , 2013, Journal of NeuroInterventional Surgery.