Brain Tumour Image Segmentation Using Deep Networks

Automated segmentation of brain tumour from multimodal MR images is pivotal for the analysis and monitoring of disease progression. As gliomas are malignant and heterogeneous, efficient and accurate segmentation techniques are used for the successful delineation of tumours into intra-tumoural classes. Deep learning algorithms outperform on tasks of semantic segmentation as opposed to the more conventional, context-based computer vision approaches. Extensively used for biomedical image segmentation, Convolutional Neural Networks have significantly improved the state-of-the-art accuracy on the task of brain tumour segmentation. In this paper, we propose an ensemble of two segmentation networks: a 3D CNN and a U-Net, in a significant yet straightforward combinative technique that results in better and accurate predictions. Both models were trained separately on the BraTS-19 challenge dataset and evaluated to yield segmentation maps which considerably differed from each other in terms of segmented tumour sub-regions and were ensembled variably to achieve the final prediction. The suggested ensemble achieved dice scores of 0.750, 0.906 and 0.846 for enhancing tumour, whole tumour, and tumour core, respectively, on the validation set, performing favourably in comparison to the state-of-the-art architectures currently available.

[1]  P. Kleihues,et al.  Topographic anatomy and CT correlations in the untreated glioblastoma multiforme. , 1988, Journal of neurosurgery.

[2]  Klaus H. Maier-Hein,et al.  DALSA: Domain Adaptation for Supervised Learning From Sparsely Annotated MR Images , 2024, IEEE Transactions on Medical Imaging.

[3]  Andriy Myronenko,et al.  3D MRI brain tumor segmentation using autoencoder regularization , 2018, BrainLes@MICCAI.

[4]  Mohammad Hamghalam,et al.  Brain Tumor Synthetic Segmentation in 3D Multimodal MRI Scans , 2019, BrainLes@MICCAI.

[5]  Konstantinos Kamnitsas,et al.  Ensembles of Multiple Models and Architectures for Robust Brain Tumour Segmentation , 2017, BrainLes@MICCAI.

[6]  G. Reifenberger,et al.  The 2016 World Health Organization Classification of Tumors of the Central Nervous System: a summary , 2016, Acta Neuropathologica.

[7]  R. Mirimanoff,et al.  Radiotherapy plus concomitant and adjuvant temozolomide for glioblastoma. , 2005, The New England journal of medicine.

[8]  Konstantinos Kamnitsas,et al.  Autofocus Layer for Semantic Segmentation , 2018, MICCAI.

[9]  Sébastien Ourselin,et al.  Automatic Brain Tumor Segmentation Using Cascaded Anisotropic Convolutional Neural Networks , 2017, BrainLes@MICCAI.

[10]  Marios Savvides,et al.  Deep Recurrent Level Set for Segmenting Brain Tumors , 2018, MICCAI.

[11]  Guang Yang,et al.  Supervised Learning based Multimodal MRI Brain Tumour Segmentation using Texture Features from Supervoxels# , 2018, Comput. Methods Programs Biomed..

[12]  Matthias Nau,et al.  Memory efficient brain tumor segmentation using an autoencoder-regularized U-Net , 2019, BrainLes@MICCAI.

[13]  Yan Shen,et al.  Scribble-Based Hierarchical Weakly Supervised Learning for Brain Tumor Segmentation , 2019, MICCAI.

[14]  Sébastien Ourselin,et al.  Scalable multimodal convolutional networks for brain tumour segmentation , 2017, MICCAI.

[15]  Guang Yang,et al.  Tissue-type mapping of gliomas , 2018, NeuroImage: Clinical.

[16]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[17]  Dacheng Tao,et al.  Learning Contextual and Attentive Information for Brain Tumor Segmentation , 2018, BrainLes@MICCAI.

[18]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[19]  Klaus H. Maier-Hein,et al.  No New-Net , 2018, 1809.10483.

[20]  Klaus H. Maier-Hein,et al.  Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge , 2017, BrainLes@MICCAI.

[21]  Yingna Li,et al.  A Visual Detection Method for Foreign Objects in Power Lines Based on Mask R-CNN , 2020, Int. J. Ambient Comput. Intell..

[22]  Klaus H. Maier-Hein,et al.  Statistical Atlases and Computational Models of the Heart. ACDC and MMWHS Challenges , 2017, Lecture Notes in Computer Science.

[23]  Sébastien Ourselin,et al.  Automatic Brain Tumor Segmentation Based on Cascaded Convolutional Neural Networks With Uncertainty Estimation , 2019, Front. Comput. Neurosci..

[24]  Richard McKinley,et al.  Ensembles of Densely-Connected CNNs with Label-Uncertainty for Brain Tumor Segmentation , 2018, BrainLes@MICCAI.

[25]  Chandan Ganesh,et al.  Multidimensional and Multiresolution Ensemble Networks for Brain Tumor Segmentation , 2019, bioRxiv.

[26]  Victor Alves,et al.  Adaptive feature recombination and recalibration for semantic segmentation: application to brain tumor segmentation in MRI , 2018, MICCAI.

[27]  Dacheng Tao,et al.  One-Pass Multi-task Convolutional Neural Networks for Efficient Brain Tumor Segmentation , 2018, MICCAI.

[28]  Stephen J. McKenna,et al.  Boundary-Aware Fully Convolutional Network for Brain Tumor Segmentation , 2017, MICCAI.

[29]  Honglak Lee,et al.  Sparse deep belief net model for visual area V2 , 2007, NIPS.

[30]  Yan-Ming Zhang,et al.  Bag of Tricks for 3D MRI Brain Tumor Segmentation , 2019, BrainLes@MICCAI.

[31]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[32]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[33]  Jill S Barnholtz-Sloan,et al.  Global incidence of malignant brain and other central nervous system tumors by histology, 2003–2007 , 2017, Neuro-oncology.

[34]  Richard McKinley,et al.  Triplanar Ensemble of 3D-to-2D CNNs with Label-Uncertainty for Brain Tumor Segmentation , 2019, BrainLes@MICCAI.

[35]  S. Bauer,et al.  A survey of MRI-based medical image analysis for brain tumor studies , 2013, Physics in medicine and biology.

[36]  Guang Yang,et al.  Brain Tumour Grading in Different MRI Protocols using SVM on Statistical Features , 2014, MIUA.

[37]  C. Kruchko,et al.  CBTRUS statistical report: primary brain and central nervous system tumors diagnosed in the United States in 2005-2009. , 2012, Neuro-oncology.

[38]  Ali Hatamizadeh,et al.  Robust Semantic Segmentation of Brain Tumor Regions from 3D MRIs , 2019, BrainLes@MICCAI.

[39]  Yoshua Bengio,et al.  Greedy Layer-Wise Training of Deep Networks , 2006, NIPS.

[40]  Mohamed Akil,et al.  Fully Automatic Brain Tumor Segmentation using End-To-End Incremental Deep Neural Networks in MRI images , 2018, Comput. Methods Programs Biomed..

[41]  Guang Yang,et al.  Brain tumor classification using the diffusion tensor image segmentation (D-SEG) technique , 2014, Neuro-oncology.

[42]  Chen Chen,et al.  3D Dilated Multi-Fiber Network for Real-time Brain Tumor Segmentation in MRI , 2019, MICCAI.

[43]  Christos Davatzikos,et al.  Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features , 2017, Scientific Data.

[44]  Serge J. Belongie,et al.  Context based object categorization: A critical survey , 2010, Comput. Vis. Image Underst..

[45]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[46]  Jeffrey R. Binder,et al.  A Multi-path Decoder Network for Brain Tumor Segmentation , 2019, BrainLes@MICCAI.

[47]  Amartya Mukherjee,et al.  Advanced processing techniques and secure architecture for sensor networks in ubiquitous healthcare systems , 2019, Sensors for Health Monitoring.

[48]  Yee Whye Teh,et al.  A Fast Learning Algorithm for Deep Belief Nets , 2006, Neural Computation.

[49]  Guang Yang,et al.  Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI , 2016, International Journal of Computer Assisted Radiology and Surgery.

[50]  Yongdong Zhang,et al.  Deep Cascaded Attention Network for Multi-task Brain Tumor Segmentation , 2019, MICCAI.

[51]  Dacheng Tao,et al.  Two-Stage Cascaded U-Net: 1st Place Solution to BraTS Challenge 2019 Segmentation Task , 2019, BrainLes@MICCAI.

[52]  et al.,et al.  Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge , 2018, ArXiv.

[53]  Nicholas Ayache,et al.  A Generative Model for Brain Tumor Segmentation in Multi-Modal Images , 2010, MICCAI.

[54]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[55]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[56]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.