Glioma segmentation of optimized 3D U-net and prediction of multi-modal survival time

It is difficult to segment Glioma and its internal structure because the Glioma boundaries have edemas and complex internal structures. This paper proposes a new optimized, integrated 3D U-Net network to achieve accurate segmentation of Glioma and internal subareas. The contribution of this paper is twofold, it studies the clinical path of patients with Glioma and constructs an optimized 3D U-Net deep learning algorithm by combining them with the radiologic feature set. The proposed model was validated in the published Glioma operation data set of multi-modal MRI resonance images and clinicians manual segmentation data. The model can accurately segment the MRI multi-modality images of Glioma and intra-tumour nodes and achieve the multi-modality prediction of the overall survival period of patients. The experimental results further indicated that the segmentation accuracy of the proposed method was higher than other sophisticated methods. The Dice similarity coefficients of the whole tumor (WT) region, the core tumor (CT) region, and the augmentation / enhanced tumor (ET) region, were 0.9632, 0.8763, and 0.8421, respectively, which are better than the clinical experts’ manual segmentation results. Hence, this research can effectively promote the development of deep learning clinical precise diagnosis and medical technology for Glioma.

[1]  Nitish Srivastava,et al.  Improving neural networks by preventing co-adaptation of feature detectors , 2012, ArXiv.

[2]  A. Zisserman,et al.  A three dimensional mid sagittal plane for brain asymmetry measurement , 1996, Schizophrenia Research.

[3]  Ron Kikinis,et al.  Statistical validation of image segmentation quality based on a spatial overlap index. , 2004, Academic radiology.

[4]  Min Li,et al.  An improved fuzzy c-means algorithm for brain MRI image segmentation , 2016, 2016 International Conference on Progress in Informatics and Computing (PIC).

[5]  Yaozong Gao,et al.  Estimating CT Image From MRI Data Using Structured Random Forest and Auto-Context Model , 2016, IEEE Transactions on Medical Imaging.

[6]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[7]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[8]  Nader Pouratian,et al.  Management of Low-Grade Glioma , 2010, Current neurology and neuroscience reports.

[9]  Ewald Moser,et al.  Improved delineation of brain tumors: an automated method for segmentation based on pathologic changes of 1H-MRSI metabolites in gliomas , 2004, NeuroImage.

[10]  Yue Liu,et al.  Efficient kNN Algorithm Based on Graph Sparse Reconstruction , 2014, ADMA.

[11]  Yusong Lin,et al.  Automatic glioma segmentation based on adaptive superpixel , 2019, BMC Medical Imaging.

[12]  M. B. Dissanayake,et al.  MRI based Glioma segmentation using Deep Learning algorithms , 2019, 2019 International Research Conference on Smart Computing and Systems Engineering (SCSE).

[13]  Spyridon Bakas,et al.  Multi-Disease Segmentation of Gliomas and White Matter Hyperintensities in the BraTS Data Using a 3D Convolutional Neural Network , 2019, Front. Comput. Neurosci..

[14]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[15]  Christos Davatzikos,et al.  Advancing The Cancer Genome Atlas glioma MRI collections with expert segmentation labels and radiomic features , 2017, Scientific Data.

[16]  Amin Amiri Tehrani Zade,et al.  Accurate Automatic Glioma Segmentation in Brain MRI images Based on CapsNet , 2021, bioRxiv.

[17]  Mokhtar Che Ismail,et al.  Two steps hybrid calibration algorithm of support vector regression and K-nearest neighbors , 2020 .

[18]  Seyed-Ahmad Ahmadi,et al.  Hough-CNN: Deep learning for segmentation of deep brain regions in MRI and ultrasound , 2016, Comput. Vis. Image Underst..

[19]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[20]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[21]  Stephen M. Smith,et al.  Segmentation of brain MR images through a hidden Markov random field model and the expectation-maximization algorithm , 2001, IEEE Transactions on Medical Imaging.

[22]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[23]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[24]  Antonio Criminisi,et al.  Segmentation of Brain Tumor Tissues with Convolutional Neural Networks , 2014 .

[25]  R. Singh,et al.  Survival analysis in clinical trials: Basics and must know areas , 2011, Perspectives in clinical research.

[26]  Wei Cao,et al.  Deep Learning based Radiomics (DLR) and its usage in noninvasive IDH1 prediction for low grade glioma , 2017, Scientific Reports.

[27]  Emre Dandıl Implementation and comparison of image segmentation methods for detection of brain tumors on MR images , 2017, 2017 International Conference on Computer Science and Engineering (UBMK).

[28]  L. R. Dice Measures of the Amount of Ecologic Association Between Species , 1945 .

[29]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[30]  Yoram Singer,et al.  Adaptive Subgradient Methods for Online Learning and Stochastic Optimization , 2011, J. Mach. Learn. Res..

[31]  et al.,et al.  Identifying the Best Machine Learning Algorithms for Brain Tumor Segmentation, Progression Assessment, and Overall Survival Prediction in the BRATS Challenge , 2018, ArXiv.

[32]  J. Barnholtz-Sloan,et al.  The epidemiology of glioma in adults: a "state of the science" review. , 2014, Neuro-oncology.

[33]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[34]  Wankai Deng,et al.  MRI brain tumor segmentation with region growing method based on the gradients and variances along and inside of the boundary curve , 2010, 2010 3rd International Conference on Biomedical Engineering and Informatics.

[35]  Klaus H. Maier-Hein,et al.  Analyzing magnetic resonance imaging data from glioma patients using deep learning , 2020, Comput. Medical Imaging Graph..

[36]  Léon Bottou,et al.  The Tradeoffs of Large Scale Learning , 2007, NIPS.

[37]  Yoshua Bengio,et al.  Convolutional networks for images, speech, and time series , 1998 .

[38]  Yuanfang Guan,et al.  Three-Plane-assembled Deep Learning Segmentation of Gliomas. , 2020, Radiology. Artificial intelligence.