Smart Approach for Glioma Segmentation in Magnetic Resonance Imaging using Modified Convolutional Network Architecture (U-NET)

Abstract Segmentation of a brain tumor from magnetic resonance multimodal images is a challenging task in the field of medical imaging. The vast diversity in potential target regions, appearance and multifarious intensity threshold levels of various tumor types are few of the major factors that affect segmentation results. An accurate diagnosis and its treatment demand strict delineation of the tumor affected tissues. Herein, we focus on a smart, automated, and robust segmentation approach for brain tumor using a modified 3D U-Net architecture. The pre-operative multimodal 3D-MRI scans of High-Grade Glioma (HGG) and Low-Grade Glioma (LGG) are used as data. Our proposed approach solves the problem of memory and system resource constraints by robustly applying dense network training on image patches of 3D volumes. It improves the border region artifact detection by applying convolutions at an appropriate phase in the proposed neural network. Multi-class imbalance data are handled by using Categorical Cross Entropy (CCE) loss developed by combining the Weighted Cross Entropy (WCE) with Weighted Multi-class Dice Loss (WMDL) functions, which enables the network to perform smart segmentation of the smaller tumorous regions. The proposed approach is tested and evaluated for the challenge datasets of multimodal MRI volumes of tumor patients. Experiments are performed to compute the average dice scores on BraTS-2019 and BraTS-2020 datasets for the whole tumor region.

[1]  Christos Davatzikos,et al.  Longitudinal brain tumor segmentation prediction in MRI using feature and label fusion , 2020, Biomed. Signal Process. Control..

[2]  Millie Pant,et al.  Brain tumor segmentation and classification from magnetic resonance images: Review of selected methods from 2014 to 2019 , 2020, Pattern Recognit. Lett..

[3]  Bin Yan,et al.  Fully Convolutional DenseNet with Multiscale Context for Automated Breast Tumor Segmentation , 2019, Journal of healthcare engineering.

[4]  Jamal Hussain Shah,et al.  AUTOMATED ULCER AND BLEEDING CLASSIFICATION FROM WCE IMAGES USING MULTIPLE FEATURES FUSION AND SELECTION , 2018, Journal of Mechanics in Medicine and Biology.

[5]  S. Bauer,et al.  A survey of MRI-based medical image analysis for brain tumor studies , 2013, Physics in medicine and biology.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Tanzila Saba,et al.  A New Approach for Brain Tumor Segmentation and Classification Based on Score Level Fusion Using Transfer Learning , 2019, Journal of Medical Systems.

[8]  Klaus H. Maier-Hein,et al.  Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge , 2017, BrainLes@MICCAI.

[9]  Richard K. G. Do,et al.  Convolutional neural networks: an overview and application in radiology , 2018, Insights into Imaging.

[10]  et al.,et al.  Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge , 2018, ArXiv.

[11]  Dorit Merhof,et al.  Segmentation of Brain Tumors and Patient Survival Prediction: Methods for the BraTS 2018 Challenge , 2018, BrainLes@MICCAI.

[12]  Paul A. Yushkevich,et al.  Accounting for the Confound of Meninges in Segmenting Entorhinal and Perirhinal Cortices in T1-Weighted MRI , 2016, MICCAI.

[13]  Messaoud Hameurlaine,et al.  Survey of Brain Tumor Segmentation Techniques on Magnetic Resonance Imaging , 2019, Nano Biomedicine and Engineering.

[14]  A. Waldman,et al.  Conventional MRI evaluation of gliomas. , 2011, The British journal of radiology.

[15]  Linda Douw,et al.  MEG Network Differences between Low- and High-Grade Glioma Related to Epilepsy and Cognition , 2012, PloS one.

[16]  Klaus H. Maier-Hein,et al.  nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation , 2018, Bildverarbeitung für die Medizin.

[17]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[18]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[19]  V. Rajinikanth,et al.  A reliable framework for accurate brain image examination and treatment planning based on early diagnosis support for clinicians , 2019, Neural Computing and Applications.

[20]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[21]  Klaus H. Maier-Hein,et al.  Abstract: nnU-Net: Self-adapting Framework for U-Net-Based Medical Image Segmentation , 2019, Bildverarbeitung für die Medizin.

[22]  N. Butowski,et al.  Primary brain tumours in adults , 2018, The Lancet.

[23]  Dacheng Tao,et al.  One-Pass Multi-Task Networks With Cross-Task Guided Attention for Brain Tumor Segmentation , 2019, IEEE Transactions on Image Processing.

[24]  Tony Lindsey,et al.  Automated Cardiovascular Pathology Assessment Using Semantic Segmentation and Ensemble Learning , 2020, Journal of Digital Imaging.

[25]  Mohammed Elmogy,et al.  Brain tumor segmentation based on a hybrid clustering technique , 2015 .

[26]  A. Eklund,et al.  Vox2Vox: 3D-GAN for Brain Tumour Segmentation , 2020, BrainLes@MICCAI.

[27]  Qian Wang,et al.  CoCa-GAN: Common-Feature-Learning-Based Context-Aware Generative Adversarial Network for Glioma Grading , 2019, MICCAI.

[28]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[29]  Andrew L. Maas Rectifier Nonlinearities Improve Neural Network Acoustic Models , 2013 .