A deep supervised approach for ischemic lesion segmentation from multimodal MRI using Fully Convolutional Network

Abstract The principle restorative step in the treatment of ischemic stroke depends on how fast the lesion is delineated from the Magnetic Resonance Imaging (MRI) images. This will serve as a vital aid to estimate the extent of damage caused to the brain cells. However, manual delineation of the lesion is time-consuming and it is subjected to intra-observer and inter-observer variability. Most of the existing methods for ischemic lesion segmentation rely on extracting handcrafted features followed by application of a machine learning algorithm. Identifying such features demand multi-domain expertise in Neuro-radiology as well as Image processing. This can be accomplished by learning the features automatically using Convolutional Neural Network (CNN). To perform segmentation, the spatial arrangement of pixel needs to be preserved in addition to learning local features of an image. Hence, a deep supervised Fully Convolutional Network (FCN) is presented in this work to segment the ischemic lesion. The highlight of this research is the application of Leaky Rectified Linear Unit activation in the last two layers of the network for a precise reconstruction of the ischemic lesion. By doing so, the network was able to learn additional features which are not considered in the existing U-Net architecture. Also, an extensive analysis was conducted in this research to select optimal hyper-parameters for training the FCN. A mean segmentation accuracy of 0.70 has been achieved from the experiments conducted on ISLES 2015 dataset. Experimental observations show that our proposed FCN method is 10% better than the existing works in terms of Dice Coefficient.

[1]  Shan Sung Liew,et al.  Bounded activation functions for enhanced training stability of deep neural networks on visual pattern recognition problems , 2016, Neurocomputing.

[2]  Changsheng Li,et al.  Multimodal brain tumor image segmentation using WRN-PPNet , 2019, Comput. Medical Imaging Graph..

[3]  Ludovica Griffanti,et al.  BIANCA (Brain Intensity AbNormality Classification Algorithm): A new tool for automated segmentation of white matter hyperintensities , 2016, NeuroImage.

[4]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[5]  Anup Basu,et al.  Robust segmentation of arterial walls in intravascular ultrasound images using Dual Path U-Net. , 2019, Ultrasonics.

[6]  Wei Shen,et al.  Research on convolutional neural network based on improved Relu piecewise activation function , 2018 .

[7]  Bir Bhanu,et al.  Automated detection of brain abnormalities in neonatal hypoxia ischemic injury from MR images , 2014, Medical Image Anal..

[8]  Douglas K. S. Ng,et al.  An image feature approach for computer-aided detection of ischemic stroke , 2011, Comput. Biol. Medicine.

[9]  Reyer Zwiggelaar,et al.  Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[10]  Ao Li,et al.  A novel end-to-end brain tumor segmentation method using improved fully convolutional networks , 2019, Comput. Biol. Medicine.

[11]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[12]  Marko Wilke,et al.  Fast semi-automated lesion demarcation in stroke , 2015, NeuroImage: Clinical.

[13]  Junmo Kim,et al.  Image Classification Using Convolutional Neural Networks With Multi-stage Feature , 2014, RiTA.

[14]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[15]  Ming Yang,et al.  Classification of Alzheimer’s Disease Based on Eight-Layer Convolutional Neural Network with Leaky Rectified Linear Unit and Max Pooling , 2018, Journal of Medical Systems.

[16]  Chris Rorden,et al.  Automated lesion detection on MRI scans using combined unsupervised and supervised methods , 2015, BMC Medical Imaging.

[17]  Mirza Faisal Beg,et al.  Muscle segmentation in axial computed tomography (CT) images at the lumbar (L3) and thoracic (T4) levels for body composition analysis , 2019, Comput. Medical Imaging Graph..

[18]  R. Menaka,et al.  A multi-scale approach for detection of ischemic stroke from brain MR images using discrete curvelet transformation , 2017 .

[19]  R DineshJacksonSamuel,et al.  Cybernetic microbial detection system using transfer learning , 2020 .

[20]  YiNan Zhang,et al.  Deep Learning- and Transfer Learning-Based Super Resolution Reconstruction from Single Medical Image , 2017, Journal of healthcare engineering.

[21]  H. Aerts,et al.  Deep Learning for Fully-Automated Localization and Segmentation of Rectal Cancer on Multiparametric MR , 2017, Scientific Reports.

[22]  Nils Daniel Forkert,et al.  Classifiers for Ischemic Stroke Lesion Segmentation: A Comparison Study , 2015, PloS one.

[23]  S. Allassonnière,et al.  Medical image analysis methods in MR/CT-imaged acute-subacute ischemic stroke lesion: Segmentation, prediction and insights into dynamic evolution simulation models. A critical appraisal , 2012, NeuroImage: Clinical.

[24]  Hervé Delingette,et al.  3D Convolutional Neural Networks for Tumor Segmentation using Long-range 2D Context , 2018, Comput. Medical Imaging Graph..

[25]  Praveen Gurunath Bharathi,et al.  Combination of hand-crafted and unsupervised learned features for ischemic stroke lesion detection from Magnetic Resonance Images , 2019, Biocybernetics and Biomedical Engineering.

[26]  Changxing Ding,et al.  Dual-force convolutional neural networks for accurate brain tumor segmentation , 2019, Pattern Recognit..

[27]  Sukanta Sabut,et al.  Delineation of the ischemic stroke lesion based on watershed and relative fuzzy connectedness in brain MRI , 2017, Medical & Biological Engineering & Computing.

[28]  Jie Wei,et al.  M3Net: A multi-model, multi-size, and multi-view deep neural network for brain magnetic resonance image segmentation , 2019, Pattern Recognit..

[29]  R. Menaka,et al.  Computer-aided detection and characterization of stroke lesion – a short review on the current state-of-the art methods , 2018 .

[30]  K. Overgaard,et al.  The effects of citicoline on acute ischemic stroke: a review. , 2014, Journal of stroke and cerebrovascular diseases : the official journal of National Stroke Association.

[31]  U. Rajendra Acharya,et al.  Automated approach for detection of ischemic stroke using Delaunay Triangulation in brain MRI images , 2018, Comput. Biol. Medicine.

[32]  Michel Bilello,et al.  Identification, segmentation, and image property study of acute infarcts in diffusion-weighted images by using a probabilistic neural network and adaptive Gaussian mixture model. , 2006, Academic radiology.

[33]  Q. Hu,et al.  Segmentation of Hyper-Acute Ischemic Infarcts from Diffusion Weighted Imaging Based on Support Vector Machine , 2015 .

[34]  et al.,et al.  ISLES 2015 ‐ A public evaluation benchmark for ischemic stroke lesion segmentation from multispectral MRI , 2017, Medical Image Anal..

[35]  Shaoguo Cui,et al.  Brain Tumor Automatic Segmentation Using Fully Convolutional Networks , 2017 .

[36]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[37]  Syed Muhammad Anwar,et al.  Segmentation of Glioma Tumors in Brain Using Deep Convolutional Neural Network , 2017, Neurocomputing.

[38]  Purang Abolmaesumi,et al.  Automatic Quality Assessment of Echocardiograms Using Convolutional Neural Networks: Feasibility on the Apical Four-Chamber View , 2017, IEEE Transactions on Medical Imaging.

[39]  Ronald M. Summers,et al.  Deep convolutional networks for pancreas segmentation in CT imaging , 2015, Medical Imaging.

[40]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[41]  Mazhar Shaikh,et al.  Brain Tumor Segmentation Using Dense Fully Convolutional Neural Network , 2017, BrainLes@MICCAI.

[42]  Hamid Soltanian-Zadeh,et al.  Multiparametric Iterative Self-Organizing Data Analysis of Ischemic Lesions Using Pre- or Post-Gd T1 MRI , 2006, Cerebrovascular Diseases.

[43]  Nima Tajbakhsh,et al.  Convolutional Neural Networks for Medical Image Analysis: Full Training or Fine Tuning? , 2016, IEEE Transactions on Medical Imaging.

[44]  Nooshin Nabizadeh,et al.  Histogram-based gravitational optimization algorithm on single MR modality for automatic brain lesion detection and segmentation , 2014, Expert Syst. Appl..

[45]  Liang Chen,et al.  Fully automatic acute ischemic lesion segmentation in DWI using convolutional neural networks , 2017, NeuroImage: Clinical.

[46]  Wei-Shi Zheng,et al.  Fully convolutional network ensembles for white matter hyperintensities segmentation in MR images , 2018, NeuroImage.

[47]  Simon K. Warfield,et al.  Asymmetric Loss Functions and Deep Densely-Connected Networks for Highly-Imbalanced Medical Image Segmentation: Application to Multiple Sclerosis Lesion Detection , 2018, IEEE Access.

[48]  R. Bhavani,et al.  Computer aided detection of ischemic stroke using segmentation and texture features , 2013 .

[49]  Sterling C. Johnson,et al.  Extracting and summarizing white matter hyperintensities using supervised segmentation methods in Alzheimer's disease risk and aging studies , 2014, Human brain mapping.

[50]  Sen Jia,et al.  Convolutional neural networks for hyperspectral image classification , 2017, Neurocomputing.

[51]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[52]  Seyed-Ahmad Ahmadi,et al.  Hough-CNN: Deep learning for segmentation of deep brain regions in MRI and ultrasound , 2016, Comput. Vis. Image Underst..

[53]  Harald Kittler,et al.  Domain-specific classification-pretrained fully convolutional network encoders for skin lesion segmentation , 2019, Comput. Biol. Medicine.

[54]  Nicholas Ayache,et al.  Fine-tuned convolutional neural nets for cardiac MRI acquisition plane recognition , 2017, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[55]  S. M. Masudur Rahman Al-Arif,et al.  Fully automatic cervical vertebrae segmentation framework for X-ray images , 2018, Comput. Methods Programs Biomed..