Investigating the Behaviour of Machine Learning Techniques to Segment Brain Metastases in Radiation Therapy Planning

This work aimed to investigate whether automated classifiers belonging to feature-based and deep learning may approach brain metastases segmentation successfully. Support Vector Machine and V-Net Convolutional Neural Network are selected as representatives of the two approaches. In the experiments, we consider several configurations of the two methods to segment brain metastases on contrast-enhanced T1-weighted magnetic resonance images. Performances were evaluated and compared under critical conditions imposed by the clinical radiotherapy domain, using in-house dataset and public dataset created for the Multimodal Brain Tumour Image Segmentation (BraTS) challenge. Our results showed that the feature-based and the deep network approaches are promising for the segmentation of Magnetic Resonance Imaging (MRI) brain metastases achieving both an acceptable level of performance. Experimental results also highlight different behaviour between the two methods. Support vector machine (SVM) improves performance with a smaller training set, but it is unable to manage a high level of heterogeneity in the data and requires post-processing refinement stages. The V-Net model shows good performances when trained on multiple heterogeneous cases but requires data augmentations and transfer learning procedures to optimise its behaviour. The paper illustrates a software package implementing an integrated set of procedures for active support in segmenting brain metastases within the radiotherapy workflow.

[1]  Ashish Ghosh,et al.  Tumor or abnormality identification from magnetic resonance images using statistical region fusion based segmentation. , 2016, Magnetic resonance imaging.

[2]  Christos Davatzikos,et al.  PROBABILISTIC SEGMENTATION OF BRAIN TUMORS BASED ON MULTI-MODALITY MAGNETIC RESONANCE IMAGES , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[3]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[4]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[5]  Constantin F. Aliferis,et al.  A comprehensive comparison of random forests and support vector machines for microarray-based cancer classification , 2008, BMC Bioinformatics.

[6]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[7]  Martha Elizabeth Shenton,et al.  On evaluating brain tissue classifiers without a ground truth , 2007, NeuroImage.

[8]  Steve B. Jiang,et al.  A deep convolutional neural network-based automatic delineation strategy for multiple brain metastases stereotactic radiosurgery , 2017, PloS one.

[9]  Anil K. Jain,et al.  Texture Analysis , 2018, Handbook of Image Processing and Computer Vision.

[10]  Jun Yu,et al.  Early Cancer Detection from Multianalyte Blood Test Results , 2019, iScience.

[11]  Vinod Kumar,et al.  Segmentation, Feature Extraction, and Multiclass Brain Tumor Classification , 2013, Journal of Digital Imaging.

[12]  Claire Chalopin,et al.  Active contours driven by Cuckoo Search strategy for brain tumour images segmentation , 2016, Expert Syst. Appl..

[13]  Elisabetta Binaghi,et al.  Meningioma and peritumoral edema segmentation of preoperative MRI brain scans , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[14]  Daniel L. Rubin,et al.  Deep learning enables automatic detection and segmentation of brain metastases on multisequence MRI , 2019, Journal of magnetic resonance imaging : JMRI.

[15]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[16]  Elisabetta Binaghi,et al.  Fully Automatic Brain Tumor Segmentation by Using Competitive EM and Graph Cut , 2015, ICIAP.

[17]  E. McVeigh,et al.  Detection of human brain cancer infiltration ex vivo and in vivo using quantitative optical coherence tomography , 2015, Science Translational Medicine.

[18]  Max Losch,et al.  Detection and Segmentation of Brain Metastases with Deep Convolutional Networks , 2015 .

[19]  Nicholas Ayache,et al.  Brain Tumor Cell Density Estimation from Multi-modal MR Images Based on a Synthetic Tumor Growth Model , 2012, MCV.

[20]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[21]  Elisabetta Binaghi,et al.  Semi-automatic Segmentation of MRI Brain Metastases Combining Support Vector Machine and Morphological Operators , 2019, IJCCI.

[22]  J. Popp,et al.  Tumor margin identification and prediction of the primary tumor from brain metastases using FTIR imaging and support vector machines. , 2013, The Analyst.

[23]  Odelin Charron,et al.  Automatic detection and segmentation of brain metastases on multimodal MR images with a deep convolutional neural network , 2018, Comput. Biol. Medicine.

[24]  Nelly Gordillo,et al.  State of the art survey on MRI brain tumor segmentation. , 2013, Magnetic resonance imaging.

[25]  Ben Glocker,et al.  Decision Forests for Tissue-Specific Segmentation of High-Grade Gliomas in Multi-channel MR , 2012, MICCAI.

[26]  Vladimir Vapnik,et al.  The Nature of Statistical Learning , 1995 .

[27]  Christian Wachinger,et al.  Atlas-Based Under-Segmentation , 2014, MICCAI.

[28]  D. Moratal,et al.  Brain Metastases Detection Algorithms in Magnetic Resonance Imaging , 2016, IEEE Latin America Transactions.

[29]  Eudocia Q Lee,et al.  Incidence and prognosis of patients with brain metastases at diagnosis of systemic malignancy: a population-based study , 2017, Neuro-oncology.

[30]  Hongmin Cai,et al.  Multiparametric tissue characterization of brain neoplasms and their recurrence using pattern classification of MR images. , 2008, Academic radiology.

[31]  A. Atiya,et al.  Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond , 2005, IEEE Transactions on Neural Networks.

[32]  S. Bauer,et al.  A survey of MRI-based medical image analysis for brain tumor studies , 2013, Physics in medicine and biology.

[33]  L. Joshua Leon,et al.  Watershed-Based Segmentation and Region Merging , 2000, Comput. Vis. Image Underst..

[34]  Jussi Tohka,et al.  Automated diagnosis of brain tumours astrocytomas using probabilistic neural network clustering and support vector machines , 2005, Int. J. Neural Syst..

[35]  Daniel L. Rubin,et al.  Deep Learning for Brain MRI Segmentation: State of the Art and Future Directions , 2017, Journal of Digital Imaging.

[36]  H. Banerjee,et al.  Intraoperative brain cancer detection with Raman spectroscopy in humans. , 2016, Annals of translational medicine.

[37]  Steve B. Jiang,et al.  Automatic metastatic brain tumor segmentation for stereotactic radiosurgery applications , 2016, Physics in medicine and biology.

[38]  Sébastien Ourselin,et al.  Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentations , 2017, DLMIA/ML-CDS@MICCAI.

[39]  Jean-Marc Constans,et al.  TUMOR SEGMENTATION FROM A MULTISPECTRAL MRI IMAGES BY USING SUPPORT VECTOR MACHINE CLASSIFICATION , 2007, 2007 4th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[40]  Johan A. K. Suykens,et al.  Least Squares Support Vector Machines , 2002 .

[41]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[42]  Stefan Bauer,et al.  Fully Automatic Segmentation of Brain Tumor Images Using Support Vector Machine Classification in Combination with Hierarchical Conditional Random Field Regularization , 2011, MICCAI.