RMU-Net: A Novel Residual Mobile U-Net Model for Brain Tumor Segmentation from MR Images

The most aggressive form of brain tumor is gliomas, which leads to concise life when high grade. The early detection of glioma is important to save the life of patients. MRI is a commonly used approach for brain tumors evaluation. However, the massive amount of data provided by MRI prevents manual segmentation in a reasonable time, restricting the use of accurate quantitative measurements in clinical practice. An automatic and reliable method is required that can segment tumors accurately. To achieve end-to-end brain tumor segmentation, a hybrid deep learning model RMU-Net is proposed. The architecture of MobileNetV2 is modified by adding residual blocks to learn in-depth features. This modified Mobile Net V2 is used as an encoder in the proposed network, and upsampling layers of U-Net are used as the decoder part. The proposed model has been validated on BraTS 2020, BraTS 2019, and BraTS 2018 datasets. The RMU-Net achieved the dice coefficient scores for WT, TC, and ET of 91.35%, 88.13%, and 83.26% on the BraTS 2020 dataset, 91.76%, 91.23%, and 83.19% on the BraTS 2019 dataset, and 90.80%, 86.75%, and 79.36% on the BraTS 2018 dataset, respectively. The performance of the proposed method outperforms with less computational cost and time as compared to previous methods.

[1]  V. E. Turlapov,et al.  Glioma Segmentation with Cascaded Unet , 2018, BrainLes@MICCAI.

[2]  Tianfu Wang,et al.  Brain Tumor Synthetic Segmentation in 3D Multimodal MRI Scans , 2019, BrainLes@MICCAI.

[3]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[4]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[5]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[6]  Tarek Khadir,et al.  Deep Convolutional Neural Networks Using U-Net for Automatic Brain Tumor Segmentation in Multimodal MRI Volumes , 2018, BrainLes@MICCAI.

[7]  Klaus H. Maier-Hein,et al.  nnU-Net for Brain Tumor Segmentation , 2020, BrainLes@MICCAI.

[8]  Diogo Almeida,et al.  Resnet in Resnet: Generalizing Residual Architectures , 2016, ArXiv.

[9]  Christos Davatzikos,et al.  Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features , 2017, Scientific Data.

[10]  Sebastian Bock,et al.  A Proof of Local Convergence for the Adam Optimizer , 2019, 2019 International Joint Conference on Neural Networks (IJCNN).

[11]  Ahror Belaid,et al.  Efficient embedding network for 3D brain tumor segmentation , 2020, ArXiv.

[12]  Victor Ayala-Ramirez,et al.  Improving a rough set theory-based segmentation approach using adaptable threshold selection and perceptual color spaces , 2014, J. Electronic Imaging.

[13]  T. Björk-Eriksson,et al.  The Art of Living With Symptoms: A Qualitative Study Among Patients With Primary Brain Tumors Receiving Proton Beam Therapy , 2019, Cancer nursing.

[14]  Carlos A. Silva,et al.  Multi-stage Deep Layer Aggregation for Brain Tumor Segmentation , 2021, BrainLes@MICCAI.

[15]  Forrest N. Iandola,et al.  DenseNet: Implementing Efficient ConvNet Descriptor Pyramids , 2014, ArXiv.

[16]  Linlin Shen,et al.  Context Aware 3D UNet for Brain Tumor Segmentation , 2020, BrainLes@MICCAI.

[17]  Dorit Merhof,et al.  Segmentation of Brain Tumors and Patient Survival Prediction: Methods for the BraTS 2018 Challenge , 2018, BrainLes@MICCAI.

[18]  J. R. Jensen,et al.  An automatic region-based image segmentation algorithm for remote sensing applications , 2010, Environ. Model. Softw..

[19]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[20]  Ali Hatamizadeh,et al.  Robust Semantic Segmentation of Brain Tumor Regions from 3D MRIs , 2019, BrainLes@MICCAI.

[21]  Rishi Sharma,et al.  A Note on the Inception Score , 2018, ArXiv.

[22]  J. Sakuma,et al.  Secondary brain tumors after cranial radiation therapy: A single-institution study. , 2020, Reports of practical oncology and radiotherapy : journal of Greatpoland Cancer Center in Poznan and Polish Society of Radiation Oncology.

[23]  et al.,et al.  Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge , 2018, ArXiv.

[24]  Abhishek Verma,et al.  Compressed residual-VGG16 CNN model for big data places image recognition , 2018, 2018 IEEE 8th Annual Computing and Communication Workshop and Conference (CCWC).

[25]  Andriy Myronenko,et al.  3D MRI brain tumor segmentation using autoencoder regularization , 2018, BrainLes@MICCAI.

[26]  Antonio Di Ieva,et al.  Impact of Spherical Coordinates Transformation Pre-processing in Deep Convolution Neural Networks for Brain Tumor Segmentation and Survival Prediction , 2020, BrainLes@MICCAI.

[27]  Amadeus Suryo Winoto,et al.  Small and Slim Deep Convolutional Neural Network for Mobile Device , 2020, IEEE Access.

[28]  Guang Yang,et al.  ME‐Net: Multi‐encoder net framework for brain tumor segmentation , 2021, Int. J. Imaging Syst. Technol..

[29]  Anuj Bhardwaj,et al.  A review on brain tumor segmentation of MRI images. , 2019, Magnetic resonance imaging.

[30]  Ao Li,et al.  A novel end-to-end brain tumor segmentation method using improved fully convolutional networks , 2019, Comput. Biol. Medicine.

[31]  Sébastien Ourselin,et al.  Automatic Brain Tumor Segmentation Based on Cascaded Convolutional Neural Networks With Uncertainty Estimation , 2019, Front. Comput. Neurosci..

[32]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[33]  Andreas Kamilaris,et al.  Deep learning in agriculture: A survey , 2018, Comput. Electron. Agric..

[34]  Weidong Cai,et al.  H2NF-Net for Brain Tumor Segmentation using Multimodal MR Imaging: 2nd Place Solution to BraTS Challenge 2020 Segmentation Task , 2020, BrainLes@MICCAI.

[35]  Gang Wang,et al.  LEMNA: Explaining Deep Learning based Security Applications , 2018, CCS.

[36]  Mohammadreza Soltaninejad,et al.  Multi-Resolution 3D CNN for MRI Brain Tumor Segmentation and Survival Prediction , 2019, BrainLes@MICCAI.

[37]  Zhiqiang He,et al.  Modality-Pairing Learning for Brain Tumor Segmentation , 2020, ArXiv.

[38]  G. Stoyanov.  The 2016 revision of the World Health Organization classification of tumors of the central nervous system: Evidence-based and morphologically flawed , 2019, Glioma.

[39]  S. Bauer,et al.  A survey of MRI-based medical image analysis for brain tumor studies , 2013, Physics in medicine and biology.

[40]  Irina Voiculescu,et al.  An Overview of Current Evaluation Methods Used in Medical Image Segmentation , 2015 .

[41]  Nikos Paragios,et al.  Brain tumor segmentation with self-ensembled, deeply-supervised 3D U-net neural networks: a BraTS 2020 challenge solution , 2020, BrainLes@MICCAI.

[42]  Gongning Luo,et al.  Multi-step Cascaded Networks for Brain Tumor Segmentation , 2019, BrainLes@MICCAI.

[43]  Muhammad Irfan,et al.  An Adoptive Threshold-Based Multi-Level Deep Convolutional Neural Network for Glaucoma Eye Disease Detection and Classification , 2020, Diagnostics.

[44]  Hilla Peretz,et al.  Ju n 20 03 Schrödinger ’ s Cat : The rules of engagement , 2003 .

[45]  Vijayan K. Asari,et al.  The History Began from AlexNet: A Comprehensive Survey on Deep Learning Approaches , 2018, ArXiv.

[46]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  Adam Glowacz,et al.  IoT Based Smart Parking System Using Deep Long Short Memory Network , 2020, Electronics.