Deep convolutional neural network for automatically segmenting acute ischemic stroke lesion in multi-modality MRI

Correct segmentation of stroke lesions from magnetic resonance imaging (MRI) is crucial for neurologists and patients. However, manual segmentation relies on expert experience and is time-consuming. The complicated stroke evolution phase and the limited samples pose challenges for automatic segmentation. In this study, we propose a novel deep convolutional neural network (Res-CNN) to automatically segment acute ischemic stroke lesions from multi-modality MRIs. Our network draws on U-shape structure, and we embed residual unit into network. In Res-CNN, we use residual unit to alleviate the degradation problem and use multi-modality to exploit the complementary information in MRIs. Before training the model, we use data fusion and data augmentation methods to increase the number of training images. Seven neural networks are extensively evaluated on two acute ischemic stroke datasets. Res-CNN shows good performance compared with other six networks both in single modality and multi-modality. Furthermore, compared with the gold standard segmentation manually labeled by two neurologists on a local test dataset, our network achieves the best results in seven neural networks. The average Dice coefficient and Hausdorff distance of our method are 74.20% and 2.33 mm, respectively. Our proposed network may provide a useful tool for segmentation lesion of acute ischemic stroke.

[1]  B R Rosen,et al.  Hyperacute stroke: simultaneous measurement of relative cerebral blood volume, relative cerebral blood flow, and mean tissue transit time. , 1999, Radiology.

[2]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[3]  S. Reingold,et al.  Diagnostic criteria for multiple sclerosis: 2005 revisions to the “McDonald Criteria” , 2005, Annals of neurology.

[4]  Christopher Joseph Pal,et al.  A Convolutional Neural Network Approach to Brain Tumor Segmentation , 2015, Brainles@MICCAI.

[5]  Jian Sun,et al.  Convolutional neural networks at constrained time cost , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Yi Pan,et al.  Classification of autism spectrum disorder by combining brain connectivity and deep neural network classifier , 2019, Neurocomputing.

[7]  Yi Pan,et al.  Classification of Alzheimer's Disease Using Whole Brain Hierarchical Network. , 2016, IEEE/ACM transactions on computational biology and bioinformatics.

[8]  Sobri Muda,et al.  Brain lesion segmentation of Diffusion-weighted MRI using gray level co-occurrence matrix , 2011, 2011 IEEE International Conference on Imaging Systems and Techniques.

[9]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  Manuel Graña,et al.  An active learning approach for stroke lesion segmentation on multimodal MRI data , 2015, Neurocomputing.

[12]  Liang Chen,et al.  Fully automatic acute ischemic lesion segmentation in DWI using convolutional neural networks , 2017, NeuroImage: Clinical.

[13]  Christian Barillot,et al.  Adaptive weighted fusion of multiple MR sequences for brain lesion segmentation , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[14]  Yoav Benjamini,et al.  Opening the Box of a Boxplot , 1988 .

[15]  Judy R. James,et al.  A supervised method for calculating perfusion/diffusion mismatch volume in acute ischemic stroke , 2006, Comput. Biol. Medicine.

[16]  Lawrence D. Jackel,et al.  Backpropagation Applied to Handwritten Zip Code Recognition , 1989, Neural Computation.

[17]  Jyrki Lötjönen,et al.  Robust whole-brain segmentation: Application to traumatic brain injury , 2015, Medical Image Anal..

[18]  Anil F. Ramlackhansingh,et al.  Lesion identification using unified segmentation-normalisation models and fuzzy clustering , 2008, NeuroImage.

[19]  Christopher Joseph Pal,et al.  Learning normalized inputs for iterative estimation in medical image segmentation , 2017, Medical Image Anal..

[20]  Sébastien Ourselin,et al.  Template-Based Multimodal Joint Generative Model of Brain Data , 2015, IPMI.

[21]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .

[22]  Chao You,et al.  Prospective randomized evaluation of therapeutic decompressive craniectomy in severe traumatic brain injury with mass lesions (PRECIS): study protocol for a controlled trial , 2016, BMC Neurology.

[23]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[24]  Jian Sun,et al.  Identity Mappings in Deep Residual Networks , 2016, ECCV.

[25]  Diederik W. J. Dippel,et al.  The effect of age on outcome after intra-arterial treatment in acute ischemic stroke: a MR CLEAN pretrial study , 2016, BMC Neurology.

[26]  Liu Jin,et al.  A survey of MRI-based brain tumor segmentation methods , 2014 .

[27]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[28]  Nick C Fox,et al.  Neuroimaging standards for research into small vessel disease and its contribution to ageing and neurodegeneration , 2013, The Lancet Neurology.

[29]  Ralf Deichmann,et al.  Quantitative T2′-Mapping in Acute Ischemic Stroke , 2014, Stroke.

[30]  Christopher Joseph Pal,et al.  The Importance of Skip Connections in Biomedical Image Segmentation , 2016, LABELS/DLMIA@MICCAI.

[31]  Joseph C. Griffis,et al.  Voxel-based Gaussian naïve Bayes classification of ischemic stroke lesions in individual T1-weighted MRI scans , 2016, Journal of Neuroscience Methods.

[32]  Daniel P. Huttenlocher,et al.  Comparing Images Using the Hausdorff Distance , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[33]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[34]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[35]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[36]  Sheng Liu,et al.  Towards Clinical Diagnosis: Automated Stroke Lesion Segmentation on Multi-Spectral MR Image Using Convolutional Neural Network , 2018, IEEE Access.

[37]  J. Kurhanewicz,et al.  Diffusion-weighted MR imaging of acute stroke: correlation with T2-weighted and magnetic susceptibility-enhanced MR imaging in cats. , 1990, AJNR. American journal of neuroradiology.

[38]  G. Barker,et al.  Quantification of MRI lesion load in multiple sclerosis: a comparison of three computer-assisted techniques. , 1996, Magnetic resonance imaging.

[39]  Xiaofeng Zhu,et al.  Local and Global Structure Preservation for Robust Unsupervised Spectral Feature Selection , 2018, IEEE Transactions on Knowledge and Data Engineering.

[40]  S. Sk A Survey of MRI-Based Brain Tumor Segmentation Methods , 2014 .

[41]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[42]  D. Collins,et al.  Automatic 3D Intersubject Registration of MR Volumetric Data in Standardized Talairach Space , 1994, Journal of computer assisted tomography.

[43]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  L H Schwamm,et al.  Diffusion-weighted MR imaging: diagnostic accuracy in patients imaged within 6 hours of stroke symptom onset. , 1999, Radiology.

[45]  Kim Mouridsen,et al.  Interrater Agreement for Final Infarct MRI Lesion Delineation , 2009, Stroke.

[46]  et al.,et al.  ISLES 2015 ‐ A public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI , 2017, Medical Image Anal..

[47]  H. Handels,et al.  Extra Tree forests for sub-acute ischemic stroke lesion segmentation in MR sequences , 2015, Journal of Neuroscience Methods.

[48]  Yi Pan,et al.  MMM: classification of schizophrenia using multi-modality multi-atlas feature representation and multi-kernel learning , 2017, Multimedia Tools and Applications.

[49]  B. van Ginneken,et al.  Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis , 2016, Scientific Reports.

[50]  Turi O. Dalaker,et al.  Brain atrophy and disability progression in multiple sclerosis patients: a 10-year follow-up study , 2014, Journal of Neurology, Neurosurgery & Psychiatry.

[51]  R. Bhavani,et al.  Computer aided detection of ischemic stroke using segmentation and texture features , 2013 .

[52]  Gholam-Ali Hossein-Zadeh,et al.  Structured and Sparse Canonical Correlation Analysis as a Brain-Wide Multi-Modal Data Fusion Approach , 2017, IEEE Transactions on Medical Imaging.

[53]  Lin Shi,et al.  Automatic Segmentation of Acute Ischemic Stroke From DWI Using 3-D Fully Convolutional DenseNets , 2018, IEEE Transactions on Medical Imaging.

[54]  Xiaofeng Zhu,et al.  Dynamic Hyper-Graph Inference Framework for Computer-Assisted Diagnosis of Neurodegenerative Diseases , 2019, IEEE Transactions on Medical Imaging.

[55]  S. Allassonnière,et al.  Medical image analysis methods in MR/CT-imaged acute-subacute ischemic stroke lesion: Segmentation, prediction and insights into dynamic evolution simulation models. A critical appraisal , 2012, NeuroImage: Clinical.

[56]  Levin Häni,et al.  Segmenting the Ischemic Penumbra: A Decision Forest Approach with Automatic Threshold Finding , 2015, Brainles@MICCAI.

[57]  O. Yanez-Suarez,et al.  Robust Nonparametric Segmentation of Infarct Lesion from Diffusion-Weighted MR Images , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[58]  Thomas Brox,et al.  Discriminative Unsupervised Feature Learning with Exemplar Convolutional Neural Networks , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[59]  J. Kucharczyk,et al.  Early detection of regional cerebral ischemia in cats: Comparison of diffusion‐ and T2‐weighted MRI and spectroscopy , 1990, Magnetic resonance in medicine.

[60]  Stefan Bauer,et al.  Skull-stripping for Tumor-bearing Brain Images , 2012, ArXiv.

[61]  M. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network. , 2016, IEEE transactions on medical imaging.