Brain MR Image Enhancement for Tumor Segmentation Using 3D U-Net

MRI images are visually inspected by domain experts for the analysis and quantification of the tumorous tissues. Due to the large volumetric data, manual reporting on the images is subjective, cumbersome, and error prone. To address these problems, automatic image analysis tools are employed for tumor segmentation and other subsequent statistical analysis. However, prior to the tumor analysis and quantification, an important challenge lies in the pre-processing. In the present study, permutations of different pre-processing methods are comprehensively investigated. In particular, the study focused on Gibbs ringing artifact removal, bias field correction, intensity normalization, and adaptive histogram equalization (AHE). The pre-processed MRI data is then passed onto 3D U-Net for automatic segmentation of brain tumors. The segmentation results demonstrated the best performance with the combination of two techniques, i.e., Gibbs ringing artifact removal and bias-field correction. The proposed technique achieved mean dice score metrics of 0.91, 0.86, and 0.70 for the whole tumor, tumor core, and enhancing tumor, respectively. The testing mean dice scores achieved by the system are 0.90, 0.83, and 0.71 for the whole tumor, core tumor, and enhancing tumor, respectively. The novelty of this work concerns a robust pre-processing sequence for improving the segmentation accuracy of MR images. The proposed method overcame the testing dice scores of the state-of-the-art methods. The results are benchmarked with the existing techniques used in the Brain Tumor Segmentation Challenge (BraTS) 2018 challenge.

[1]  B. S. Manjunath,et al.  Brain Tumor Segmentation and Tractographic Feature Extraction from Structural MR Images for Overall Survival Prediction , 2018, BrainLes@MICCAI.

[2]  Alan C. Evans,et al.  A nonparametric method for automatic correction of intensity nonuniformity in MRI data , 1998, IEEE Transactions on Medical Imaging.

[3]  Xavier Lladó,et al.  Deep convolutional neural networks for brain image analysis on magnetic resonance imaging: a review , 2017, Artif. Intell. Medicine.

[4]  Anan Li,et al.  A Robust Image Registration Interface for Large Volume Brain Atlas , 2020, Scientific Reports.

[5]  He Jiang,et al.  High quality impulse noise removal via non-uniform sampling and autoregressive modelling based super-resolution , 2016, IET Image Process..

[6]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[7]  Vibhav Vineet,et al.  Conditional Random Fields as Recurrent Neural Networks , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[8]  Stefan Bauer,et al.  A Skull-Stripping Filter for ITK , 2013, The Insight Journal.

[9]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[10]  Jayaram K. Udupa,et al.  New variants of a method of MRI scale standardization , 2000, IEEE Transactions on Medical Imaging.

[11]  Boqiang Liu,et al.  S3D-UNet: Separable 3D U-Net for Brain Tumor Segmentation , 2018, BrainLes@MICCAI.

[12]  Dinggang Shen,et al.  journal homepage: www.elsevier.com/locate/ynimg , 2022 .

[13]  Lin Shi,et al.  Histogram-based normalization technique on human brain magnetic resonance images from different acquisitions , 2015, Biomedical engineering online.

[14]  C. Jaspin Jeba Sheela,et al.  An efficient denoising of impulse noise from MRI using adaptive switching modified decision based unsymmetric trimmed median filter , 2020, Biomed. Signal Process. Control..

[15]  Stephen M Smith,et al.  Fast robust automated brain extraction , 2002, Human brain mapping.

[16]  Dorit Merhof,et al.  Segmentation of Brain Tumors and Patient Survival Prediction: Methods for the BraTS 2018 Challenge , 2018, BrainLes@MICCAI.

[17]  Emile Schjeldsøe Berg Effect of Free Water Elimination on Diffusion Indices in Healthy Volunteers and Patients with Multiple Sclerosis , 2018 .

[18]  Andriy Myronenko,et al.  3D MRI brain tumor segmentation using autoencoder regularization , 2018, BrainLes@MICCAI.

[19]  Paul M. Thompson,et al.  The role of image registration in brain mapping , 2001, Image Vis. Comput..

[20]  Xiangjian He,et al.  Deep Learning Techniques for Medical Image Segmentation: Achievements and Challenges , 2019, Journal of Digital Imaging.

[21]  Syed Muhammad Anwar,et al.  Brain tumor segmentation using cascaded deep convolutional neural network , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  Klaus H. Maier-Hein,et al.  Brain Tumor Segmentation and Radiomics Survival Prediction: Contribution to the BRATS 2017 Challenge , 2017, BrainLes@MICCAI.

[23]  Soumen Bag,et al.  An Improved Non-local Means Denoising Technique for Brain MRI , 2020 .

[24]  A. Krylov,et al.  Attention-based Convolutional Neural Network for MRI Gibbs-ringing Artifact Suppression , 2020, Proceedings of the 30th International Conference on Computer Graphics and Machine Vision (GraphiCon 2020). Part 2.

[25]  Brian B. Avants,et al.  N4ITK: Improved N3 Bias Correction , 2010, IEEE Transactions on Medical Imaging.

[26]  S. Blessy,et al.  Intensity Inhomogeneity Correction in Brain MR Images Based on Filtering Method , 2020 .

[27]  Guang Yang,et al.  Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI , 2016, International Journal of Computer Assisted Radiology and Surgery.

[28]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[29]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[30]  Guang Yang,et al.  Reduction of Gibbs artifacts in magnetic resonance imaging based on Convolutional Neural Network , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[31]  Paulo Amorim,et al.  3D Adaptive Histogram Equalization Method for Medical Volumes , 2018, VISIGRAPP.

[32]  Daniel L. Rubin,et al.  Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions , 2017, Journal of Digital Imaging.

[33]  José V. Manjón,et al.  MRI denoising using Non-Local Means , 2008, Medical Image Anal..

[34]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[35]  Nicholas J. Tustison,et al.  Brain Tumor Segmentation Using an Ensemble of 3D U-Nets and Overall Survival Prediction Using Radiomic Features , 2018, Frontiers in Computational Neuroscience.

[36]  Hervé Delingette,et al.  3D Convolutional Neural Networks for Tumor Segmentation using Long-range 2D Context , 2018, Comput. Medical Imaging Graph..

[37]  Xin Wang,et al.  Multi-modal medical image segmentation based on vector-valued active contour models , 2020, Inf. Sci..

[38]  Paul M. Thompson,et al.  Robust Brain Extraction Across Datasets and Comparison With Publicly Available Methods , 2011, IEEE Transactions on Medical Imaging.

[39]  Karl Krissian,et al.  Noise-Driven Anisotropic Diffusion Filtering of MRI , 2009, IEEE Transactions on Image Processing.

[40]  Li Sun,et al.  Tumor Segmentation and Survival Prediction in Glioma with Deep Learning , 2018, BrainLes@MICCAI.

[41]  Liu Jin,et al.  A survey of MRI-based brain tumor segmentation methods , 2014 .

[42]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[43]  E. Fieremans,et al.  Removal of partial Fourier‐induced Gibbs (RPG) ringing artifacts in MRI , 2021, Magnetic resonance in medicine.

[44]  E M Haacke,et al.  MR artifacts: a review. , 1986, AJR. American journal of roentgenology.

[45]  Marian Stewart Bartlett,et al.  Face recognition by independent component analysis , 2002, IEEE Trans. Neural Networks.

[46]  Bibek Dhital,et al.  Gibbs‐ringing artifact removal based on local subvoxel‐shifts , 2015, Magnetic resonance in medicine.