Segmenting Brain Tumors from MRI Using Cascaded Multi-modal U-Nets

Gliomas are the most common primary brain tumors, and their accurate manual delineation is a time- consuming and very user-dependent process. Therefore, developing automated techniques for reproducible detection and segmentation of brain tumors from magnetic resonance imaging is a vital research topic. In this paper, we present a deep learning-powered approach for brain tumor segmentation which exploits multiple magnetic-resonance modalities and processes them in two cascaded stages. In both stages, we use multi-modal fully-convolutional neural nets inspired by U-Nets. The first stage detects regions of interests, whereas the second stage performs the multi-class classification. Our experimental study, performed over the newest release of the BraTS dataset (BraTS 2018) showed that our method delivers accurate brain-tumor delineation and offers very fast processing—the total time required to segment one study using our approach amounts to around 18 s.

[1]  Mehran Yazdi,et al.  An Effective Method for Segmentation of MR Brain Images Using the Ant Colony Optimization Algorithm , 2013, Journal of Digital Imaging.

[2]  Jakub Nalepa,et al.  Towards Detecting High-Uptake Lesions from Lung CT Scans Using Deep Learning , 2017, ICIAP.

[3]  Fabiano Reis,et al.  Analysis of neoplastic lesions in magnetic resonance imaging using self-organizing maps , 2015, Journal of the Neurological Sciences.

[4]  Christopher Joseph Pal,et al.  A Convolutional Neural Network Approach to Brain Tumor Segmentation , 2015, Brainles@MICCAI.

[5]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[6]  Daniel Rueckert,et al.  Multi-atlas based segmentation of brain images: Atlas selection and its effect on accuracy , 2009, NeuroImage.

[7]  Jakub Nalepa,et al.  Memetic evolution of deep neural networks , 2018, GECCO.

[8]  Elena Marchiori,et al.  Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities , 2016, Scientific Reports.

[9]  M. Mallar Chakravarty,et al.  Derivation of high-resolution MRI atlases of the human cerebellum at 3T and segmentation using multiple automatically generated templates , 2014, NeuroImage.

[10]  Sanghamitra Bandyopadhyay,et al.  MRI brain image segmentation by fuzzy symmetry based genetic clustering technique , 2007, 2007 IEEE Congress on Evolutionary Computation.

[11]  Konstantinos Kamnitsas,et al.  Ensembles of Multiple Models and Architectures for Robust Brain Tumour Segmentation , 2017, BrainLes@MICCAI.

[12]  M. Mallar Chakravarty,et al.  Multi-atlas segmentation of the whole hippocampus and subfields using multiple automatically generated templates , 2014, NeuroImage.

[13]  Ying Zhuge,et al.  Brain tumor segmentation using holistically nested neural networks in MRI images , 2017, Medical physics.

[14]  R. Dhanasekaran,et al.  Fuzzy Clustering and Deformable Model for Tumor Segmentation on MRI Brain Image: A Combined Approach , 2012 .

[15]  Gongping Yang,et al.  A New Multistage Medical Segmentation Method Based on Superpixel and Fuzzy Clustering , 2014, Comput. Math. Methods Medicine.

[16]  Yuanjie Zheng,et al.  A Novel Unsupervised Segmentation Method for MR Brain Images Based on Fuzzy Methods , 2005, CVBIA.

[17]  Matthew C. Cowperthwaite,et al.  Superpixels in brain MR image analysis , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[18]  Nico Karssemeijer,et al.  Transfer Learning for Domain Adaptation in MRI: Application in Brain Lesion Segmentation , 2017, MICCAI.

[19]  Ben Glocker,et al.  Decision Forests for Tissue-Specific Segmentation of High-Grade Gliomas in Multi-channel MR , 2012, MICCAI.

[20]  Wei Wu,et al.  Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features , 2013, International Journal of Computer Assisted Radiology and Surgery.

[21]  S. Bauer,et al.  Atlas-based segmentation of brain tumor images using a Markov Random Field-based tumor growth model and non-rigid registration , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[22]  Higino Correia,et al.  Brain Tumour Segmentation based on Extremely Randomized Forest with high-level features , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[23]  Abdellatif Mtibaa,et al.  Modified support vector machines for MR brain images recognition , 2013, 2013 International Conference on Control, Decision and Information Technologies (CoDIT).

[24]  V. R. Simi,et al.  Segmentation of Glioblastoma Multiforme from MR Images – A comprehensive review , 2015 .

[25]  Christoph Meinel,et al.  Conditional Adversarial Network for Semantic Segmentation of Brain Tumor , 2017, ArXiv.

[26]  Guang Yang,et al.  Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI , 2016, International Journal of Computer Assisted Radiology and Surgery.

[27]  Allan Hanbury,et al.  Metrics for evaluating 3D medical image segmentation: analysis, selection, and tool , 2015, BMC Medical Imaging.

[28]  Denis Kouame,et al.  New Estimators and Guidelines for Better Use of Fetal Heart Rate Estimators with Doppler Ultrasound Devices , 2014, Comput. Math. Methods Medicine.

[29]  et al.,et al.  Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge , 2018, ArXiv.

[30]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[31]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[32]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[33]  Ganapathy Krishnamurthi,et al.  Generative adversarial networks for brain lesion detection , 2017, Medical Imaging.

[34]  Christos Davatzikos,et al.  Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features , 2017, Scientific Data.

[35]  Olivier Clatz,et al.  Spatial decision forests for MS lesion segmentation in multi-channel magnetic resonance images , 2011, NeuroImage.

[36]  Bradley J. Erickson,et al.  Automated Segmentation of Hyperintense Regions in FLAIR MRI Using Deep Learning , 2016, Tomography.

[37]  Amitava Chatterjee,et al.  A new social and momentum component adaptive PSO algorithm for image segmentation , 2011, Expert Syst. Appl..

[38]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.