Application of Convolutional Neural Network in Segmenting Brain Regions from MRI Data

Extracting knowledge from digital images largely depends on how well the mining algorithms can focus on specific regions of the image. In multimodality image analysis, especially in multi-layer diagnostic images, identification of regions of interest is pivotal and this is mostly done through image segmentation. Reliable medical image analysis for error-free diagnosis requires efficient and accurate image segmentation mechanisms. With the advent of advanced machine learning methods, such as deep learning (DL), in intelligent diagnostics, the requirement of efficient and accurate image segmentation becomes crucial. Targeting the beginners, this paper starts with an overview of Convolutional Neural Network, the most widely used DL technique and its application to segment brain regions from Magnetic Resonance Imaging. It then provides a quantitative analysis of the reviewed techniques as well as a rich discussion on their performance. Towards the end, few open challenges are identified and promising future works related to medical image segmentation using DL are indicated.

[1]  Bilwaj Gaonkar,et al.  Orchestral fully convolutional networks for small lesion segmentation in brain MRI , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[2]  Dacheng Tao,et al.  One-Pass Multi-task Convolutional Neural Networks for Efficient Brain Tumor Segmentation , 2018, MICCAI.

[3]  Iasonas Kokkinos,et al.  Sub-cortical brain structure segmentation using F-CNN'S , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[4]  Kyong Hwan Jin,et al.  Fast and robust segmentation of the striatum using deep convolutional neural networks , 2016, Journal of Neuroscience Methods.

[5]  Hao Chen,et al.  3D multi‐scale FCN with random modality voxel dropout learning for Intervertebral Disc Localization and Segmentation from Multi‐modality MR Images , 2018, Medical Image Anal..

[6]  Giovanni Montana,et al.  Deep neural networks for anatomical brain segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[7]  Ehsan Adeli,et al.  3-D Fully Convolutional Networks for Multimodal Isointense Infant Brain Image Segmentation , 2019, IEEE Transactions on Cybernetics.

[8]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[9]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[10]  Jing Yuan,et al.  Isointense infant brain segmentation with a hyper-dense connected convolutional neural network , 2017, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[11]  Sohrab Effati,et al.  Stochastic Support Vector Machine for Classifying and Regression of Random Variables , 2017, Neural Processing Letters.

[12]  Bruce I. Reiner.  Redefining the Practice of Peer Review Through Intelligent Automation—Part 3: Automated Report Analysis and Data Reconciliation , 2017, Journal of Digital Imaging.

[13]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[14]  Marios Savvides,et al.  Deep Recurrent Level Set for Segmenting Brain Tumors , 2018, MICCAI.

[15]  Zhao Chen,et al.  3-D Convolutional Neural Networks for Glioblastoma Segmentation , 2016, ArXiv.

[16]  Asadollah Shahbahrami,et al.  An Efficient Implementation of Deep Convolutional Neural Networks for MRI Segmentation , 2018, Journal of Digital Imaging.

[17]  Binh T. Nguyen,et al.  3D-Brain Segmentation Using Deep Neural Network and Gaussian Mixture Model , 2017, 2017 IEEE Winter Conference on Applications of Computer Vision (WACV).

[18]  Amir Hussain,et al.  Applications of Deep Learning and Reinforcement Learning to Biological Data , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[19]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[20]  Guoyan Zheng,et al.  Multi-stream 3D FCN with multi-scale deep supervision for multi-modality isointense infant brain MR image segmentation , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[21]  Elena Marchiori,et al.  Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities , 2016, Scientific Reports.

[22]  Hayit Greenspan,et al.  Longitudinal Multiple Sclerosis Lesion Segmentation Using Multi-view Convolutional Neural Networks , 2016, LABELS/DLMIA@MICCAI.

[23]  Max A. Viergever,et al.  Deep Learning for Multi-Task Medical Image Segmentation in Multiple Modalities , 2016, MICCAI.

[24]  Seyed-Ahmad Ahmadi,et al.  Hough-CNN: Deep learning for segmentation of deep brain regions in MRI and ultrasound , 2016, Comput. Vis. Image Underst..

[25]  Taku Komura,et al.  Segmentation of white matter hyperintensities using convolutional neural networks with global spatial information in routine clinical brain MRI with none or mild vascular pathology , 2018, Comput. Medical Imaging Graph..

[26]  Yong Luo,et al.  Automatic Tumor Segmentation with Deep Convolutional Neural Networks for Radiotherapy Applications , 2017, Neural Processing Letters.

[27]  Syed Muhammad Anwar,et al.  Segmentation of Glioma Tumors in Brain Using Deep Convolutional Neural Network , 2017, Neurocomputing.

[28]  Xavier Lladó,et al.  Automated sub‐cortical brain structure segmentation combining spatial and deep convolutional features , 2017, Medical Image Anal..

[29]  J. Pluim,et al.  Evaluation of a deep learning approach for the segmentation of brain tissues and white matter hyperintensities of presumed vascular origin in MRI , 2017, NeuroImage: Clinical.

[30]  Peter A. Calabresi,et al.  Multiple Sclerosis Lesion Segmentation from Brain MRI via Fully Convolutional Neural Networks , 2018, ArXiv.

[31]  Nassir Navab,et al.  InfiNet: Fully convolutional networks for infant brain MRI segmentation , 2018, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[32]  Ying Zhuge,et al.  Brain tumor segmentation using holistically nested neural networks in MRI images , 2017, Medical physics.

[33]  Josien P. W. Pluim,et al.  Isointense infant brain MRI segmentation with a dilated convolutional neural network , 2017, ArXiv.

[34]  Zhou He,et al.  3D Deep Affine-Invariant Shape Learning for Brain MR Image Segmentation , 2018, DLMIA/ML-CDS@MICCAI.

[35]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[36]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[37]  Lawrence H. Schwartz,et al.  Medical Imaging in Clinical Trials , 2014 .

[38]  Christian Wachinger,et al.  DeepNAT: Deep convolutional neural network for segmenting neuroanatomy , 2017, NeuroImage.

[39]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[40]  Jing Yuan,et al.  HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation , 2018, IEEE Transactions on Medical Imaging.

[41]  D. Maintz,et al.  Fully automated detection and segmentation of meningiomas using deep learning on routine multiparametric MRI , 2018, European Radiology.

[42]  Yaozong Gao,et al.  Fully convolutional networks for multi-modality isointense infant brain image segmentation , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[43]  Hao Chen,et al.  Brain Tumor Segmentation Using Concurrent Fully Convolutional Networks and Conditional Random Fields , 2018, ICMIP 2018.

[44]  Alex Rovira,et al.  Improving automated multiple sclerosis lesion segmentation with a cascaded 3D convolutional neural network approach , 2017, NeuroImage.

[45]  Albert C. S. Chung,et al.  Multi-scale structured CNN with label consistency for brain MR image segmentation , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[46]  Mitko Veta,et al.  Adversarial Training and Dilated Convolutions for Brain MRI Segmentation , 2017, DLMIA/ML-CDS@MICCAI.

[47]  Jose Dolz,et al.  3D fully convolutional networks for subcortical segmentation in MRI: A large-scale study , 2016, NeuroImage.

[48]  Nico Karssemeijer,et al.  Non-uniform patch sampling with deep convolutional neural networks for white matter hyperintensity segmentation , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[49]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[50]  D. Rueckert,et al.  White matter hyperintensity and stroke lesion segmentation and differentiation using convolutional neural networks , 2017, NeuroImage: Clinical.