Predicting ischemic stroke tissue fate using a deep convolutional neural network on source magnetic resonance perfusion images

Abstract. Predicting infarct volume from magnetic resonance perfusion-weighted imaging can provide helpful information to clinicians in deciding how aggressively to treat acute stroke patients. Models have been developed to predict tissue fate, yet these models are mostly built using hand-crafted features (e.g., time-to-maximum) derived from perfusion images, which are sensitive to deconvolution methods. We demonstrate the application of deep convolution neural networks (CNNs) on predicting final stroke infarct volume using only the source perfusion images. We propose a deep CNN architecture that improves feature learning and achieves an area under the curve of 0.871  ±  0.024, outperforming existing tissue fate models. We further validate the proposed deep CNN with existing 2-D and 3-D deep CNNs for images/video classification, showing the importance of the proposed architecture. Our work leverages deep learning techniques in stroke tissue outcome prediction, advancing magnetic resonance imaging perfusion analysis one step closer to an operational decision support tool for stroke treatment guidance.

[1]  B. Reiser,et al.  Estimation of the Youden Index and its Associated Cutoff Point , 2005, Biometrical journal. Biometrische Zeitschrift.

[2]  Simon J. Doran,et al.  Stacked Autoencoders for Unsupervised Feature Learning and Multiple Organ Detection in a Pilot Study Using 4D Patient Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[4]  F. Buonanno,et al.  Predicting Tissue Outcome in Acute Human Cerebral Ischemia Using Combined Diffusion- and Perfusion-Weighted MR Imaging , 2001, Stroke.

[5]  V. Lai Application of Diffusion – And Perfusion – Weighted Imaging in Acute Ischemic Stroke , 2014 .

[6]  Clément Farabet,et al.  Torch7: A Matlab-like Environment for Machine Learning , 2011, NIPS 2011.

[7]  Matthew J. McAuliffe,et al.  Medical Image Processing, Analysis and Visualization in clinical research , 2001, Proceedings 14th IEEE Symposium on Computer-Based Medical Systems. CBMS 2001.

[8]  Mark D. Huffman,et al.  Executive Summary: Heart Disease and Stroke Statistics—2015 Update A Report From the American Heart Association , 2011, Circulation.

[9]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[10]  Nassir Navab,et al.  Vascular image registration techniques: A living review , 2017, Medical Image Anal..

[11]  Hamid Soltanian-Zadeh,et al.  Multiparametric Iterative Self-Organizing Data Analysis of Ischemic Lesions Using Pre- or Post-Gd T1 MRI , 2006, Cerebrovascular Diseases.

[12]  Foster Provost,et al.  The effect of class distribution on classifier learning: an empirical study , 2001 .

[13]  Vishwa S. Parekh,et al.  Unsupervised nonlinear dimensionality reduction machine learning methods applied to multiparametric MRI in cerebral ischemia: preliminary results , 2014, Medical Imaging.

[14]  Quoc V. Le,et al.  Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis , 2011, CVPR 2011.

[15]  M. Chopp,et al.  Multiparametric MRI Tissue Characterization in Clinical Stroke With Correlation to Clinical Outcome: Part 2 , 2001, Stroke.

[16]  Peter Oster,et al.  Rehabilitation after stroke. , 2011, Deutsches Arzteblatt international.

[17]  Yann LeCun,et al.  Pedestrian Detection with Unsupervised Multi-stage Feature Learning , 2012, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[18]  Bruce C V Campbell,et al.  Cerebral Blood Flow Is the Optimal CT Perfusion Parameter for Assessing Infarct Core , 2011, Stroke.

[19]  Homer H. Pien,et al.  Stroke Tissue Outcome Prediction Using A Spatially-Correlated Model , 2008 .

[20]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[21]  Klaus-Robert Müller,et al.  Efficient BackProp , 2012, Neural Networks: Tricks of the Trade.

[22]  Arkadiusz Gertych,et al.  An EM-based semi-supervised deep learning approach for semantic segmentation of histopathological images from radical prostatectomies , 2018, Comput. Medical Imaging Graph..

[23]  Wenyuan Li,et al.  Path R-CNN for Prostate Cancer Diagnosis and Gleason Grading of Histological Images , 2019, IEEE Transactions on Medical Imaging.

[24]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[25]  Roland Bammer,et al.  Geography, Structure, and Evolution of Diffusion and Perfusion Lesions in Diffusion and Perfusion Imaging Evaluation For Understanding Stroke Evolution (DEFUSE) , 2009, Stroke.

[26]  A. Furlan,et al.  Endovascular therapy for stroke--it's about time. , 2015, The New England journal of medicine.

[27]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[28]  Xiao Hu,et al.  Regional Prediction of Tissue Fate in Acute Ischemic Stroke , 2012, Annals of Biomedical Engineering.

[29]  Alex A. T. Bui,et al.  Predicting Discharge Mortality after Acute Ischemic Stroke Using Balanced Data , 2014, AMIA.

[30]  Andrzej Materka,et al.  Effects of MRI acquisition parameter variations and protocol heterogeneity on the results of texture analysis and pattern discrimination: an application-oriented study. , 2009, Medical physics.

[31]  Daniel L. Rubin,et al.  Automated Grading of Gliomas using Deep Learning in Digital Pathology Images: A modular approach with ensemble of convolutional neural networks , 2015, AMIA.

[32]  KimMouridsen,et al.  Comparison of 10 Perfusion MRI Parameters in 97 Sub-6-Hour Stroke Patients Using Voxel-Based Receiver Operating Characteristics Analysis , 2009 .

[33]  F. Calamante Arterial input function in perfusion MRI: a comprehensive review. , 2013, Progress in nuclear magnetic resonance spectroscopy.

[34]  Roland L. Dunbrack,et al.  The Role of Balanced Training and Testing Data Sets for Binary Classifiers in Bioinformatics , 2013, PloS one.

[35]  Søren Christensen,et al.  Automatic selection of arterial input function using cluster analysis , 2006, Magnetic resonance in medicine.

[36]  P. Booker,et al.  A model to predict the histopathology of human stroke using diffusion and T2-weighted magnetic resonance imaging. , 1995, Stroke.

[37]  Lorenzo Torresani,et al.  Learning Spatiotemporal Features with 3D Convolutional Networks , 2014, 2015 IEEE International Conference on Computer Vision (ICCV).

[38]  Subhabrata Chakraborti,et al.  Nonparametric Statistical Inference , 2011, International Encyclopedia of Statistical Science.

[39]  B. Rosen,et al.  Infarct Prediction and Treatment Assessment with MRI-based Algorithms in Experimental Stroke Models , 2007, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[40]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Chih-Jen Lin,et al.  LIBLINEAR: A Library for Large Linear Classification , 2008, J. Mach. Learn. Res..

[42]  J. Hanley,et al.  A method of comparing the areas under receiver operating characteristic curves derived from the same cases. , 1983, Radiology.

[43]  Shiliang Huang,et al.  Artificial Neural Network Prediction of Ischemic Tissue Fate in Acute Stroke Imaging , 2010, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[44]  Bilwaj Gaonkar,et al.  Multi-atlas skull-stripping. , 2013, Academic radiology.

[45]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[46]  Prevalence of disabilities and associated health conditions among adults--United States, 1999. , 2001, MMWR. Morbidity and mortality weekly report.

[47]  Tsuhan Chen,et al.  Towards robust deconvolution of low-dose perfusion CT: Sparse perfusion deconvolution using online dictionary learning , 2013, Medical Image Anal..

[48]  Alan L. Yuille,et al.  Articulated Pose Estimation by a Graphical Model with Image Dependent Pairwise Relations , 2014, NIPS.

[49]  Kim Mouridsen,et al.  Comparison of 10 Perfusion MRI Parameters in 97 Sub-6-Hour Stroke Patients Using Voxel-Based Receiver Operating Characteristics Analysis , 2009, Stroke.

[50]  Jiawei Han,et al.  Speed up kernel discriminant analysis , 2011, The VLDB Journal.

[51]  Hamid Soltanian-Zadeh,et al.  Predicting Final Extent of Ischemic Infarction Using Artificial Neural Network Analysis of Multi-Parametric MRI in Patients with Stroke , 2009, 2009 International Joint Conference on Neural Networks.

[52]  Andrew Zisserman,et al.  Two-Stream Convolutional Networks for Action Recognition in Videos , 2014, NIPS.

[53]  Alan Connelly,et al.  The Physiological Significance of the Time-to-Maximum (Tmax) Parameter in Perfusion MRI , 2010, Stroke.

[54]  Bruce C V Campbell,et al.  Role of imaging in current acute ischemic stroke workflow for endovascular therapy. , 2015, Stroke.

[55]  T Tolxdorff,et al.  Histogram‐based characterization of healthy and ischemic brain tissues using multiparametric MR imaging including apparent diffusion coefficient maps and relaxometry , 2000, Magnetic resonance in medicine.

[56]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[57]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[58]  M. Chopp,et al.  Multiparametric iterative self-organizing MR imaging data analysis technique for assessment of tissue viability in acute cerebral ischemia. , 2004, AJNR. American journal of neuroradiology.

[59]  J. Orgogozo,et al.  Final Cerebral Infarct Volume Is Predictable by MR Imaging at 1 Week , 2011, American Journal of Neuroradiology.

[60]  Ronald M. Summers,et al.  Detection of Sclerotic Spine Metastases via Random Aggregation of Deep Convolutional Neural Network Classifications , 2014, ArXiv.

[61]  A Zavaljevski,et al.  Multi-level adaptive segmentation of multi-parameter MR brain images. , 2000, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[62]  C. Derdeyn,et al.  Perfusion imaging in acute ischemic stroke: let us improve the science before changing clinical practice. , 2013, Radiology.

[63]  Fei-Fei Li,et al.  Large-Scale Video Classification with Convolutional Neural Networks , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[64]  Alan Connelly,et al.  The Role of Bolus Delay and Dispersion in Predictor Models for Stroke , 2012, Stroke.

[65]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[66]  J. van Leeuwen,et al.  Neural Networks: Tricks of the Trade , 2002, Lecture Notes in Computer Science.

[67]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[68]  W D Heiss,et al.  Ischemic Penumbra: Evidence From Functional Imaging in Man , 2000, Journal of cerebral blood flow and metabolism : official journal of the International Society of Cerebral Blood Flow and Metabolism.

[69]  Mark W. Woolrich,et al.  Advances in functional and structural MR image analysis and implementation as FSL , 2004, NeuroImage.