Deep Learning–Derived High-Level Neuroimaging Features Predict Clinical Outcomes for Large Vessel Occlusion

Supplemental Digital Content is available in the text. Background and Purpose— For patients with large vessel occlusion, neuroimaging biomarkers that evaluate the changes in brain tissue are important for determining the indications for mechanical thrombectomy. In this study, we applied deep learning to derive imaging features from pretreatment diffusion-weighted image data and evaluated the ability of these features in predicting clinical outcomes for patients with large vessel occlusion. Methods— This multicenter retrospective study included patients with anterior circulation large vessel occlusion treated with mechanical thrombectomy between 2013 and 2018. We designed a 2-output deep learning model based on convolutional neural networks (the convolutional neural network model). This model employed encoder-decoder architecture for the ischemic lesion segmentation, which automatically extracted high-level feature maps in its middle layers, and used its information to predict the clinical outcome. Its performance was internally validated with 5-fold cross-validation, externally validated, and the results compared with those from the standard neuroimaging biomarkers Alberta Stroke Program Early CT Score and ischemic core volume. The prediction target was a good clinical outcome, defined as a modified Rankin Scale score at 90-day follow-up of 0 to 2. Results— The derivation cohort included 250 patients, and the validation cohort included 74 patients. The convolutional neural network model showed the highest area under the receiver operating characteristic curve: 0.81±0.06 compared with 0.63±0.05 and 0.64±0.05 for the Alberta Stroke Program Early CT Score and ischemic core volume models, respectively. In the external validation, the area under the curve for the convolutional neural network model was significantly superior to those for the other 2 models. Conclusions— Compared with the standard neuroimaging biomarkers, our deep learning model derived a greater amount of prognostic information from pretreatment neuroimaging data. Although a confirmatory prospective evaluation is needed, the high-level imaging features derived by deep learning may offer an effective prognostic imaging biomarker.

[1]  M. Okawa,et al.  Predicting Clinical Outcomes of Large Vessel Occlusion Before Mechanical Thrombectomy Using Machine Learning. , 2019, Stroke.

[2]  J. Wassélius,et al.  Big Data Approaches to Phenotyping Acute Ischemic Stroke Using Automated Lesion Segmentation of Multi-Center Magnetic Resonance Imaging Data. , 2019, Stroke.

[3]  Michael T. McManus,et al.  Penumbral imaging and functional outcome in patients with anterior circulation ischaemic stroke treated with endovascular thrombectomy versus medical therapy: a meta-analysis of individual patient-level data , 2019, The Lancet Neurology.

[4]  Lin Shi,et al.  Automatic Segmentation of Acute Ischemic Stroke From DWI Using 3-D Fully Convolutional DenseNets , 2018, IEEE Transactions on Medical Imaging.

[5]  J. Felblinger,et al.  Pretreatment lesional volume impacts clinical outcome and thrombectomy efficacy , 2018, Annals of neurology.

[6]  C. Levi,et al.  Evaluation of hyperacute infarct volume using ASPECTS and brain CT perfusion core volume , 2017, Neurology.

[7]  Liang Chen,et al.  Fully automatic acute ischemic lesion segmentation in DWI using convolutional neural networks , 2017, NeuroImage: Clinical.

[8]  N. Henninger,et al.  Alberta Stroke Program Early CT Score Infarct Location Predicts Outcome Following M2 Occlusion , 2017, Front. Neurol..

[9]  Abdul Basit,et al.  Prediction of Ischemic Stroke Lesion and Clinical Outcome in Multi-modal MRI Images Using Random Forests , 2016, BrainLes@MICCAI.

[10]  Heinz Handels,et al.  Predicting Stroke Lesion and Clinical Outcome with Random Forests , 2016, BrainLes@MICCAI.

[11]  Joong-Ho Won,et al.  Ensemble of Deep Convolutional Neural Networks for Prognosis of Ischemic Stroke , 2016, BrainLes@MICCAI.

[12]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[13]  W. Yoon,et al.  Outcomes Are Not Different between Patients with Intermediate and High DWI-ASPECTS after Stent-Retriever Embolectomy for Acute Anterior Circulation Stroke , 2016, American Journal of Neuroradiology.

[14]  Gerhard Schroth,et al.  Younger Stroke Patients With Large Pretreatment Diffusion-Weighted Imaging Lesions May Benefit From Endovascular Treatment , 2015, Stroke.

[15]  S. Rangaraju,et al.  Relationship Between Lesion Topology and Clinical Outcome in Anterior Circulation Large Vessel Occlusions , 2015, Stroke.

[16]  M. Mlynash,et al.  Alberta Stroke Program Early Computed Tomographic Scoring Performance in a Series of Patients Undergoing Computed Tomography and MRI: Reader Agreement, Modality Agreement, and Outcome Prediction , 2015, Stroke.

[17]  A. Demchuk,et al.  Alberta Stroke Program Early Computed Tomography Score to Select Patients for Endovascular Treatment: Interventional Management of Stroke (IMS)-III Trial , 2014, Stroke.

[18]  K. Kallenberg,et al.  Alberta Stroke Program Early CT Scale Evaluation of Multimodal Computed Tomography in Predicting Clinical Outcomes of Stroke Patients Treated With Aspiration Thrombectomy , 2013, Stroke.

[19]  Marc'Aurelio Ranzato,et al.  Building high-level features using large scale unsupervised learning , 2011, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[20]  Bruce C V Campbell,et al.  Cerebral Blood Flow Is the Optimal CT Perfusion Parameter for Assessing Infarct Core , 2011, Stroke.

[21]  K. Kario,et al.  Early Ischemic Change on CT Versus Diffusion-Weighted Imaging for Patients With Stroke Receiving Intravenous Recombinant Tissue-Type Plasminogen Activator Therapy: Stroke Acute Management With Urgent Risk-factor Assessment and Improvement (SAMURAI) rt-PA Registry , 2011, Stroke.

[22]  A. Demchuk,et al.  Effect of Baseline CT Scan Appearance and Time to Recanalization on Clinical Outcomes in Endovascular Thrombectomy of Acute Ischemic Strokes , 2011, Stroke.

[23]  R. Bammer,et al.  Real‐time diffusion‐perfusion mismatch analysis in acute stroke , 2010, Journal of magnetic resonance imaging : JMRI.

[24]  T. Neumann-Haefelin,et al.  Risk Assessment of Symptomatic Intracerebral Hemorrhage After Thrombolysis Using DWI-ASPECTS , 2009, Stroke.

[25]  J. R. Landis,et al.  The measurement of observer agreement for categorical data. , 1977, Biometrics.

[26]  Yoon-Chul Kim,et al.  Evaluation of Diffusion Lesion Volume Measurements in Acute Ischemic Stroke Using Encoder-Decoder Convolutional Network. , 2019, Stroke.

[27]  Ramprasaath R. Selvaraju,et al.  Grad-CAM: Why did you say that? Visual Explanations from Deep Networks via Gradient-based Localization , 2016 .