Localized Perturbations For Weakly-Supervised Segmentation of Glioma Brain Tumours

Deep convolutional neural networks (CNNs) have become an essential tool in the medical imaging-based computer-aided diagnostic pipeline. However, training accurate and reliable CNNs requires large fine-grain annotated datasets. To alleviate this, weakly-supervised methods can be used to obtain local information from global labels. This work proposes the use of localized perturbations as a weakly-supervised solution to extract segmentation masks of brain tumours from a pretrained 3D classification model. Furthermore, we propose a novel optimal perturbation method that exploits 3D superpixels to find the most relevant area for a given classification using a U-net architecture. Our method achieved a Dice similarity coefficient (DSC) of 0.44 when compared with expert annotations. When compared against Grad-CAM, our method outperformed both in visualization and localization ability of the tumour region, with Grad-CAM only achieving 0.11 average DSC.

[1]  Xirong Li,et al.  Hierarchical Attention Networks for Medical Image Segmentation , 2019, ArXiv.

[2]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[3]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[4]  Kate Saenko,et al.  RISE: Randomized Input Sampling for Explanation of Black-box Models , 2018, BMVC.

[5]  Christos Davatzikos,et al.  Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features , 2017, Scientific Data.

[6]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[7]  Tanzila Saba,et al.  Microscopic brain tumor detection and classification using 3D CNN and feature selection architecture , 2020, Microscopy research and technique.

[8]  Xuelong Li,et al.  Segmentation of breast ultrasound image with semantic classification of superpixels , 2020, Medical Image Anal..

[9]  P. Alam,et al.  R , 1823, The Herodotus Encyclopedia.

[10]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[11]  Jun Wang,et al.  Glioma grading based on 3D multimodal convolutional neural network and privileged learning , 2017, 2017 IEEE International Conference on Bioinformatics and Biomedicine (BIBM).

[12]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[13]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[14]  N. Doolittle,et al.  State of the science in brain tumor classification. , 2004, Seminars in oncology nursing.

[15]  W. Hager,et al.  and s , 2019, Shallow Water Hydraulics.

[16]  Muhammad Sharif,et al.  Brain tumor classification based on DWT fusion of MRI sequences using convolutional neural network , 2020, Pattern Recognit. Lett..

[17]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[19]  et al.,et al.  Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge , 2018, ArXiv.

[20]  Kashif Rajpoot,et al.  Brain tumor classification from multi-modality MRI using wavelets and machine learning , 2017, Pattern Analysis and Applications.

[21]  Emmanuelle Gouillart,et al.  scikit-image: image processing in Python , 2014, PeerJ.

[22]  D. Rueckert,et al.  Self-Supervision with Superpixels: Training Few-shot Medical Image Segmentation without Annotation , 2020, ECCV.

[23]  Jitendra Malik,et al.  Learning a classification model for segmentation , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.