Prediction of Tissue Outcome and Assessment of Treatment Effect in Acute Ischemic Stroke Using Deep Learning

Background and Purpose— Treatment options for patients with acute ischemic stroke depend on the volume of salvageable tissue. This volume assessment is currently based on fixed thresholds and single imagine modalities, limiting accuracy. We wish to develop and validate a predictive model capable of automatically identifying and combining acute imaging features to accurately predict final lesion volume. Methods— Using acute magnetic resonance imaging, we developed and trained a deep convolutional neural network (CNNdeep) to predict final imaging outcome. A total of 222 patients were included, of which 187 were treated with rtPA (recombinant tissue-type plasminogen activator). The performance of CNNdeep was compared with a shallow CNN based on the perfusion-weighted imaging biomarker Tmax (CNNTmax), a shallow CNN based on a combination of 9 different biomarkers (CNNshallow), a generalized linear model, and thresholding of the diffusion-weighted imaging biomarker apparent diffusion coefficient (ADC) at 600×10−6 mm2/s (ADCthres). To assess whether CNNdeep is capable of differentiating outcomes of ±intravenous rtPA, patients not receiving intravenous rtPA were included to train CNNdeep, −rtpa to access a treatment effect. The networks’ performances were evaluated using visual inspection, area under the receiver operating characteristic curve (AUC), and contrast. Results— CNNdeep yields significantly better performance in predicting final outcome (AUC=0.88±0.12) than generalized linear model (AUC=0.78±0.12; P=0.005), CNNTmax (AUC=0.72±0.14; P<0.003), and ADCthres (AUC=0.66±0.13; P<0.0001) and a substantially better performance than CNNshallow (AUC=0.85±0.11; P=0.063). Measured by contrast, CNNdeep improves the predictions significantly, showing superiority to all other methods (P⩽0.003). CNNdeep also seems to be able to differentiate outcomes based on treatment strategy with the volume of final infarct being significantly different (P=0.048). Conclusions— The considerable prediction improvement accuracy over current state of the art increases the potential for automated decision support in providing recommendations for personalized treatment plans.

[1]  Jens K. Boldsen,et al.  Transit time homogenization in ischemic stroke – A novel biomarker of penumbral microvascular failure? , 2017, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[2]  Roberto Cipolla,et al.  Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understanding , 2015, BMVC.

[3]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Thomas Lindner,et al.  Comparison of Perfusion CT Software to Predict the Final Infarct Volume After Thrombectomy , 2016, Stroke.

[5]  Martín Abadi,et al.  TensorFlow: Large-Scale Machine Learning on Heterogeneous Distributed Systems , 2016, ArXiv.

[6]  K. Mouridsen,et al.  Automated estimation of salvageable tissue: Comparison with expert readers , 2016, Journal of magnetic resonance imaging : JMRI.

[7]  Nils Daniel Forkert,et al.  Classifiers for Ischemic Stroke Lesion Segmentation: A Comparison Study , 2015, PloS one.

[8]  Fabien Scalzo,et al.  Deep learning of tissue fate features in acute ischemic stroke , 2015, 2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[9]  Konstantinos Kamnitsas,et al.  Multi-scale 3D convolutional neural networks for lesion segmentation in brain MRI , 2015 .

[10]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[11]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Kim Mouridsen,et al.  Reliable Estimation of Capillary Transit Time Distributions Using DSC-MRI , 2014, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[13]  H. Bøtker,et al.  Remote Ischemic Perconditioning as an Adjunct Therapy to Thrombolysis in Patients With Acute Ischemic Stroke: A Randomized Trial , 2014, Stroke.

[14]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[15]  Ronan Collobert,et al.  Recurrent Convolutional Neural Networks for Scene Parsing , 2013, ArXiv.

[16]  Brian A. Nosek,et al.  Power failure: why small sample size undermines the reliability of neuroscience , 2013, Nature Reviews Neuroscience.

[17]  Kim Mouridsen,et al.  The role of the cerebral capillaries in acute ischemic stroke: the extended penumbra model , 2013, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[18]  H. Bøtker,et al.  Remote Ischemic Perconditioning in Thrombolysed Stroke Patients: Randomized Study of Activating Endogenous Neuroprotection – Design and MRI Measurements , 2013, International journal of stroke : official journal of the International Stroke Society.

[19]  Hsin-Chieh Yeh,et al.  Effect of the 2011 vs 2003 duty hour regulation-compliant models on sleep duration, trainee education, and continuity of patient care among internal medicine house staff: a randomized trial. , 2013, JAMA internal medicine.

[20]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[21]  Leif Østergaard,et al.  The roles of cerebral blood flow, capillary transit time heterogeneity, and oxygen tension in brain oxygenation and metabolism , 2011, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[22]  Kim Mouridsen,et al.  Predicting Infarction Within the Diffusion-Weighted Imaging Lesion: Does the Mean Transit Time Have Added Value? , 2011, Stroke.

[23]  Peter S. Jones,et al.  Infarction of 'non-core-non-penumbral' tissue after stroke: multivariate modelling of clinical impact. , 2011, Brain : a journal of neurology.

[24]  R. Bammer,et al.  Real‐time diffusion‐perfusion mismatch analysis in acute stroke , 2010, Journal of magnetic resonance imaging : JMRI.

[25]  Shiliang Huang,et al.  Artificial Neural Network Prediction of Ischemic Tissue Fate in Acute Stroke Imaging , 2010, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[26]  Kim Mouridsen,et al.  Interrater Agreement for Final Infarct MRI Lesion Delineation , 2009, Stroke.

[27]  Kim Mouridsen,et al.  Predicting Tissue Outcome From Acute Stroke Magnetic Resonance Imaging: Improving Model Performance by Optimal Sampling of Training Data , 2009, Stroke.

[28]  KimMouridsen,et al.  Comparison of 10 Perfusion MRI Parameters in 97 Sub-6-Hour Stroke Patients Using Voxel-Based Receiver Operating Characteristics Analysis , 2009 .

[29]  Kim Mouridsen,et al.  Comparison of 10 Perfusion MRI Parameters in 97 Sub-6-Hour Stroke Patients Using Voxel-Based Receiver Operating Characteristics Analysis , 2009, Stroke.

[30]  R. Bammer,et al.  Optimal Tmax Threshold for Predicting Penumbral Tissue in Acute Stroke , 2009, Stroke.

[31]  B. Rosen,et al.  Infarct Prediction and Treatment Assessment with MRI-based Algorithms in Experimental Stroke Models , 2007, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[32]  Karl J. Friston,et al.  Bayesian estimation of cerebral perfusion using a physiological model of microvasculature , 2006, NeuroImage.

[33]  L. Østergaard,et al.  Characterizing physiological heterogeneity of infarction risk in acute human ischaemic stroke using MRI. , 2006, Brain : a journal of neurology.

[34]  Søren Christensen,et al.  Automatic selection of arterial input function using cluster analysis , 2006, Magnetic resonance in medicine.

[35]  B. Rosen,et al.  Tracer arrival timing‐insensitive technique for estimating flow in MR perfusion‐weighted imaging using singular value decomposition with a block‐circulant deconvolution matrix , 2003, Magnetic resonance in medicine.

[36]  F. Buonanno,et al.  Predicting Tissue Outcome in Acute Human Cerebral Ischemia Using Combined Diffusion- and Perfusion-Weighted MR Imaging , 2001, Stroke.

[37]  Lawrence D. Jackel,et al.  Handwritten Digit Recognition with a Back-Propagation Network , 1989, NIPS.

[38]  B. Siesjö,et al.  Thresholds in cerebral ischemia - the ischemic penumbra. , 1981, Stroke.