Interactive Segmentation of Glioblastoma for Post-surgical Treatment Follow-up

In this paper, we present a novel framework for interactive segmentation of glioblastoma in contrast-enhanced Tl-weighted magnetic resonance images. U-net based-fully convolutional network is combined with an interactive refinement technique. Initial segmentation of brain tumor is performed using U-net, and the result is further improved by including complex foreground regions or removing background regions in an iterative manner. The method is evaluated on a research database containing post-operative glioblastoma of 15 patients. Radiologists can refine initial segmentation results in about 90 seconds, which is well below the time of interactive segmentation from scratch using state-of-the-art interactive segmentation tools. The experiments revealed that the segmentation results (Dice score) before and after the interaction step (performed by expert users) are similar. This is most likely due to the limited information in the contrast-enhanced Tl-weighted magnetic resonance images used for evaluation. The proposed method is computationally fast and efficient, and could be useful for post-surgical treatment follow-up.

[1]  Ben Glocker,et al.  Decision Forests for Tissue-Specific Segmentation of High-Grade Gliomas in Multi-channel MR , 2012, MICCAI.

[2]  Junaed Sattar.  Snakes , Shapes and Gradient Vector Flow , 2022 .

[3]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[4]  Nicholas Ayache,et al.  Spatially Adaptive Random Forests , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[5]  Jill S. Barnholtz-Sloan,et al.  CBTRUS Statistical Report: Primary Brain and Central Nervous System Tumors Diagnosed in the United States in 2008-2012 , 2015, Neuro-oncology.

[6]  Christos Davatzikos,et al.  GLISTR: Glioma Image Segmentation and Registration , 2012, IEEE Transactions on Medical Imaging.

[7]  William A. Barrett,et al.  Interactive segmentation of image volumes with Live Surface , 2007, Comput. Graph..

[8]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[9]  R. Nathan Spreng,et al.  Functional segregation of the human basal forebrain using resting state neuroimaging , 2017, bioRxiv.

[10]  Ross T. Whitaker,et al.  GIST: an interactive, GPU-based level set segmentation tool for 3D medical images , 2004, Medical Image Anal..

[11]  Masoom A. Haider,et al.  Single-click, semi-automatic lung nodule contouring using hierarchical conditional random fields , 2015, 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI).

[12]  Higino Correia,et al.  Brain Tumour Segmentation based on Extremely Randomized Forest with high-level features , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[13]  J. Barnholtz-Sloan,et al.  CBTRUS statistical report: primary brain and central nervous system tumors diagnosed in the United States in 2007-2011. , 2012, Neuro-oncology.

[14]  S Praveen,et al.  Brain Tumor Segmentation with Deep Learning Technique , 2019, 2019 3rd International Conference on Trends in Electronics and Informatics (ICOEI).

[15]  M. Mohammed Thaha,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2019, Journal of Medical Systems.

[16]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[17]  Christos Davatzikos,et al.  Combining Generative Models for Multifocal Glioma Segmentation and Registration , 2014, MICCAI.

[18]  B. Scheithauer,et al.  The New WHO Classification of Brain Tumours , 1993, Brain pathology.

[19]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[20]  Chi-Hoon Lee,et al.  Segmenting Brain Tumors Using Pseudo-Conditional Random Fields , 2008, MICCAI.

[21]  Guido Gerig,et al.  ITK-SNAP: An interactive tool for semi-automatic segmentation of multi-modality biomedical images , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[22]  Pavel Kisilev,et al.  A Cross Saliency Approach to Asymmetry-Based Tumor Detection , 2015, MICCAI.

[23]  Rasmus Larsen,et al.  An Ensemble of 2D Convolutional Neural Networks for Tumor Segmentation , 2015, SCIA.

[24]  Milan Sonka,et al.  3D Slicer as an image computing platform for the Quantitative Imaging Network. , 2012, Magnetic resonance imaging.

[25]  Robert N. Anderson,et al.  Annual Report to the Nation on the Status of Cancer, 1975–2007, Featuring Tumors of the Brain and Other Nervous System , 2011, Journal of the National Cancer Institute.

[26]  Pascal Vincent,et al.  Representation Learning: A Review and New Perspectives , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  R. Meier,et al.  A Hybrid Model for Multimodal Brain Tumor Segmentation , 2013 .

[28]  Antonio Criminisi,et al.  Segmentation of Brain Tumor Tissues with Convolutional Neural Networks , 2014 .

[29]  Guillermo Sapiro,et al.  A Geodesic Framework for Fast Interactive Image and Video Segmentation and Matting , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[30]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[31]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[32]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[33]  Brian B. Avants,et al.  Optimal Symmetric Multimodal Templates and Concatenated Random Forests for Supervised Brain Tumor Segmentation (Simplified) with ANTsR , 2014, Neuroinformatics.

[34]  Ewert Bengtsson,et al.  Smart Paint : A New Interactive Segmentation Method\\ Applied to MR Prostate Segmentation , 2012, MICCAI 2012.

[35]  Fred A. Hamprecht,et al.  Multi-modal Brain Tumor Segmentation using Deep Convolutional Neural Networks , 2014 .

[36]  Stefan Bauer,et al.  Fully Automatic Segmentation of Brain Tumor Images Using Support Vector Machine Classification in Combination with Hierarchical Conditional Random Field Regularization , 2011, MICCAI.

[37]  Bjoern H. Menze,et al.  Local Structure Prediction with Convolutional Neural Networks for Multimodal Brain Tumor Segmentation , 2015, MCV@MICCAI.