Correcting and Reweighting False Label Masks in Brain Tumor Segmentation.

PURPOSE Recently, brain tumor segmentation has made important progress. How-ever, the quality of manual labels plays an important role in the performance, while in practice, it could vary greatly and in turn could substantially mislead the learning process and decrease the accuracy. We need to design a mechanism to combine label correction and sample reweighting to improve the effectiveness of brain tumor segmentation. METHODS We propose a novel sample reweighting and label refinement method, and a novel 3D generative adversarial network (GAN) is introduced to combine these two models into an united framework. RESULTS Extensive experiments on the BraTS19 dataset have demonstrated that our approach obtains competitive results when compared with other state-of-the-art approaches when handling the false labels in brain tumor segmentation. CONCLUSIONS The 3D GAN-based approach is an effective approach to handle false label masks by simultaneously applying label correction and sample reweighting. Our method is robust to variations in tumor shape and background clutter.

[1]  Christian Ledig,et al.  Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[2]  Stephen J. McKenna,et al.  Boundary-Aware Fully Convolutional Network for Brain Tumor Segmentation , 2017, MICCAI.

[3]  Tom Thomas,et al.  Travelers’ Compliance With Social Routing Advice: Impacts on Road Network Performance and Equity , 2020, IEEE Transactions on Intelligent Transportation Systems.

[4]  Yujie Zhang,et al.  Triple attention network for video segmentation , 2020, Neurocomputing.

[5]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[6]  Andriy Myronenko,et al.  3D MRI brain tumor segmentation using autoencoder regularization , 2018, BrainLes@MICCAI.

[7]  Konstantinos Kamnitsas,et al.  Autofocus Layer for Semantic Segmentation , 2018, MICCAI.

[8]  Yizhou Yu,et al.  Traffic Sign Detection Using a Multi-Scale Recurrent Attention Network , 2019, IEEE Transactions on Intelligent Transportation Systems.

[9]  Chao Song,et al.  Joint temporal context exploitation and active learning for video segmentation , 2020, Pattern Recognit..

[10]  Hong Qiao,et al.  Un-supervised and semi-supervised hand segmentation in egocentric images with noisy label learning , 2019, Neurocomputing.

[11]  Xun Wang,et al.  Lane marking detection via deep convolutional neural network , 2017, Neurocomputing.

[12]  Wei Hu,et al.  Densely connected attentional pyramid residual network for human pose estimation , 2019, Neurocomputing.

[13]  Chen Chen,et al.  3D Dilated Multi-Fiber Network for Real-time Brain Tumor Segmentation in MRI , 2019, MICCAI.

[14]  Xiaofeng Liu,et al.  Confidence Regularized Self-Training , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[15]  Tommy Löfstedt,et al.  TuNet: End-to-end Hierarchical Brain Tumor Segmentation using Cascaded Networks , 2019, BrainLes@MICCAI.

[16]  Xun Wang,et al.  Object localization via evaluation multi-task learning , 2017, Neurocomputing.

[17]  Lei Zhang,et al.  CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noise , 2017, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[18]  Takuhiro Kaneko,et al.  Label-Noise Robust Generative Adversarial Networks , 2018, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Kaiming He,et al.  Mask R-CNN , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[20]  Hairong Zheng,et al.  CLCI-Net: Cross-Level fusion and Context Inference Networks for Lesion Segmentation of Chronic Stroke , 2019, MICCAI.

[21]  Yan Tian,et al.  LSTM-based traffic flow prediction with missing data , 2018, Neurocomputing.

[22]  Jonathan Ventura,et al.  Dilated Convolutions for Brain Tumor Segmentation in MRI Scans , 2017, BrainLes@MICCAI.

[23]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.