Automated 3D segmentation of brain tumor using visual saliency

Abstract There is a growing availability of medical imaging data from large number of patients, involving visual information from images in different modalities along with an associated complexity of the features of interest. It has therefore become essential to develop automated delineations to assist doctors and/or radiologists to analyze and speedup medical image understanding, preferably avoiding any user intervention. We present here a novel approach for the reliable, automated, and accurate 3D segmentation of brain tumors from multi-sequence magnetic resonance images. The tumor volume, detected using visual saliency, is evaluated in three-dimensions for small as well as large ROIs and/or VOIs. The proposed segmentation method is applied on the publicly available standard BRATS data set, and is found to achieve very high accuracy with good reliability (or repeatability) and robustness of results. Its robustness, is also investigated by measuring the impact of tumor size on segmentation accuracy, on the basis of the weak linear correlation. The results demonstrate that the segmentation generated by the proposed algorithm can be used for accurate, stable contouring, for both high- and low-grade tumors, as compared to several related state-of-the-art methods involving semi-automatic and supervised learning.

[1]  James V. Miller,et al.  GBM Volumetry using the 3D Slicer Medical Image Computing Platform , 2013, Scientific Reports.

[2]  E. Holland,et al.  Glioblastoma multiforme: the terminator. , 2000, Proceedings of the National Academy of Sciences of the United States of America.

[3]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[4]  K. Fujii,et al.  Visualization for the analysis of fluid motion , 2005, J. Vis..

[5]  Christof Koch,et al.  Modeling attention to salient proto-objects , 2006, Neural Networks.

[6]  Pietro Perona,et al.  Graph-Based Visual Saliency , 2006, NIPS.

[7]  Subhashis Banerjee,et al.  Single seed delineation of brain tumor using multi-thresholding , 2016, Inf. Sci..

[8]  Liming Zhang,et al.  Biological Plausibility of Spectral Domain Approach for Spatiotemporal Visual Saliency , 2008, ICONIP.

[9]  Heng Li,et al.  A real-time image optimization strategy based on global saliency detection for artificial retinal prostheses , 2017, Inf. Sci..

[10]  Pavel Kisilev,et al.  Unsupervised detection of abnormalities in medical images using salient features , 2014, Medical Imaging.

[11]  Jayanthi Sivaswamy,et al.  Visual saliency based bright lesion detection and discrimination in retinal images , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[12]  Aykut Erdem,et al.  Visual saliency estimation by nonlinearly integrating features using region covariances. , 2013, Journal of vision.

[13]  Xuelong Li,et al.  Automatic segmentation of breast lesions for interaction in ultrasonic computer-aided diagnosis , 2015, Inf. Sci..

[14]  Ali Borji,et al.  State-of-the-Art in Visual Attention Modeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Jun Yu,et al.  Semantic preserving distance metric learning and applications , 2014, Inf. Sci..

[16]  Klaus H. Maier-Hein,et al.  MiMSeg - an algorithm for automated detection of tumor tissue on NMR apparent diffusion coefficient maps , 2017, Inf. Sci..

[17]  Sushmita Mitra,et al.  Medical image analysis for cancer management in natural computing framework , 2015, Inf. Sci..

[18]  R. Meier,et al.  A Hybrid Model for Multimodal Brain Tumor Segmentation , 2013 .

[19]  T. Foulsham,et al.  What can saliency models predict about eye movements? Spatial and sequential aspects of fixations during encoding and recognition. , 2008, Journal of vision.

[20]  Chun Chen,et al.  Low-level and high-level prior learning for visual saliency estimation , 2014, Inf. Sci..

[21]  Yongdong Zhang,et al.  Salient region detection for complex background images using integrated features , 2014, Inf. Sci..

[22]  Bjoern H Menze,et al.  Patch-based Segmentation of Brain Tissues , 2013 .

[23]  Christof Koch,et al.  A Model of Saliency-Based Visual Attention for Rapid Scene Analysis , 2009 .

[24]  Isabelle Bloch,et al.  3D brain tumor segmentation in MRI using fuzzy classification, symmetry analysis and spatially constrained deformable models , 2009, Fuzzy Sets Syst..

[25]  Russell Greiner,et al.  Quick detection of brain tumors and edemas: A bounding box method using symmetry , 2012, Comput. Medical Imaging Graph..

[26]  P. Lambin,et al.  Robust Radiomics Feature Quantification Using Semiautomatic Volumetric Segmentation , 2014, PloS one.

[27]  Michael Kistler,et al.  The Virtual Skeleton Database: An Open Access Repository for Biomedical Research and Collaboration , 2013, Journal of medical Internet research.

[28]  Jun Yu,et al.  Exploiting Click Constraints and Multi-view Features for Image Re-ranking , 2014, IEEE Transactions on Multimedia.

[29]  Chun Chen,et al.  What Is the Chance of Happening: A New Way to Predict Where People Look , 2010, ECCV.

[30]  Jayanthi Sivaswamy,et al.  Assessment of computational visual attention models on medical images , 2012, ICVGIP '12.

[31]  Tim K Marks,et al.  SUN: A Bayesian framework for saliency using natural statistics. , 2008, Journal of vision.

[32]  Meng Wang,et al.  Adaptive Hypergraph Learning and its Application in Image Classification , 2012, IEEE Transactions on Image Processing.

[33]  HongJiang Zhang,et al.  Contrast-based image attention analysis by using fuzzy growing , 2003, MULTIMEDIA '03.

[34]  Sabine Süsstrunk,et al.  Salient Region Detection and Segmentation , 2008, ICVS.

[35]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[36]  Pascal O. Zinn,et al.  A Novel Volume-Age-KPS (VAK) Glioblastoma Classification Identifies a Prognostic Cognate microRNA-Gene Signature , 2012, PloS one.

[37]  Pavel Kisilev,et al.  A Cross Saliency Approach to Asymmetry-Based Tumor Detection , 2015, MICCAI.

[38]  Paul L. Rosin A simple method for detecting salient regions , 2009, Pattern Recognit..

[39]  R. Gillies,et al.  Quantitative imaging in cancer evolution and ecology. , 2013, Radiology.

[40]  Ali Borji,et al.  Salient Object Detection: A Benchmark , 2015, IEEE Transactions on Image Processing.

[41]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[42]  Gwénolé Quellec,et al.  Optimal Filter Framework for Automated, Instantaneous Detection of Lesions in Retinal Images , 2011, IEEE Transactions on Medical Imaging.