Supervised Learning based Multimodal MRI Brain Tumour Segmentation using Texture Features from Supervoxels#

BACKGROUND Accurate segmentation of brain tumour in magnetic resonance images (MRI) is a difficult task due to various tumour types. Using information and features from multimodal MRI including structural MRI and isotropic (p) and anisotropic (q) components derived from the diffusion tensor imaging (DTI) may result in a more accurate analysis of brain images. METHODS We propose a novel 3D supervoxel based learning method for segmentation of tumour in multimodal MRI brain images (conventional MRI and DTI). Supervoxels are generated using the information across the multimodal MRI dataset. For each supervoxel, a variety of features including histograms of texton descriptor, calculated using a set of Gabor filters with different sizes and orientations, and first order intensity statistical features are extracted. Those features are fed into a random forests (RF) classifier to classify each supervoxel into tumour core, oedema or healthy brain tissue. RESULTS The method is evaluated on two datasets: 1) Our clinical dataset: 11 multimodal images of patients and 2) BRATS 2013 clinical dataset: 30 multimodal images. For our clinical dataset, the average detection sensitivity of tumour (including tumour core and oedema) using multimodal MRI is 86% with balanced error rate (BER) 7%; while the Dice score for automatic tumour segmentation against ground truth is 0.84. The corresponding results of the BRATS 2013 dataset are 96%, 2% and 0.89, respectively. CONCLUSION The method demonstrates promising results in the segmentation of brain tumour. Adding features from multimodal MRI images can largely increase the segmentation accuracy. The method provides a close match to expert delineation across all tumour grades, leading to a faster and more reproducible method of brain tumour detection and delineation to aid patient management.

[1]  Chris A Clark,et al.  Singularities in diffusion tensor fields and their relevance in white matter fiber tractography , 2004, NeuroImage.

[2]  Andy Liaw,et al.  Classification and Regression by randomForest , 2007 .

[3]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Qingmin Liao,et al.  Statistical Structure Analysis in MRI Brain Tumor Segmentation , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[5]  Ahmed Ben Hamida,et al.  3D multimodal MRI brain glioma tumor and edema segmentation: A graph cut distribution matching approach , 2015, Comput. Medical Imaging Graph..

[6]  Michael Kistler,et al.  The Virtual Skeleton Database: An Open Access Repository for Biomedical Research and Collaboration , 2013, Journal of medical Internet research.

[7]  Guang Yang,et al.  Automated brain tumour detection and segmentation using superpixel-based extremely randomized trees in FLAIR MRI , 2016, International Journal of Computer Assisted Radiology and Surgery.

[8]  F. Maes,et al.  Comparison of unsupervised classification methods for brain tumor segmentation using multi-parametric MRI , 2016, NeuroImage: Clinical.

[9]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[10]  Moumen T. El-Melegy,et al.  Tumor segmentation in brain MRI using a fuzzy approach with class center priors , 2014, EURASIP Journal on Image and Video Processing.

[11]  Wei Wu,et al.  Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features , 2013, International Journal of Computer Assisted Radiology and Surgery.

[12]  Ben Glocker,et al.  Decision Forests for Tissue-Specific Segmentation of High-Grade Gliomas in Multi-channel MR , 2012, MICCAI.

[13]  Dieter Klatt,et al.  The International Society for Magnetic Resonance in Medicine (ISMRM) , 2012 .

[14]  T. Carpenter,et al.  Enhanced visualization and quantification of magnetic resonance diffusion tensor imaging using the p:q tensor decomposition. , 2006, The British journal of radiology.

[15]  Nelly Gordillo,et al.  State of the art survey on MRI brain tumor segmentation. , 2013, Magnetic resonance imaging.

[16]  Brian B. Avants,et al.  Optimal Symmetric Multimodal Templates and Concatenated Random Forests for Supervised Brain Tumor Segmentation (Simplified) with ANTsR , 2014, Neuroinformatics.

[17]  Paul Suetens,et al.  An untrained and unsupervised method for MRI brain tumor segmentation , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[18]  R P Velthuizen,et al.  MRI segmentation: methods and applications. , 1995, Magnetic resonance imaging.

[19]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[20]  Hongmin Cai,et al.  Multiparametric tissue characterization of brain neoplasms and their recurrence using pattern classification of MR images. , 2008, Academic radiology.

[21]  Spyridon Bakas,et al.  Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries , 2017, Lecture Notes in Computer Science.

[22]  Nicholas Ayache,et al.  Spatially Adaptive Random Forests , 2013, 2013 IEEE 10th International Symposium on Biomedical Imaging.

[23]  Mark Muzi,et al.  Continuing Education: Multi-modality Brain Tumor Imaging – MRI, PET, and PET/MRI , 2015 .

[24]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[25]  Higino Correia,et al.  Brain Tumour Segmentation based on Extremely Randomized Forest with high-level features , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[26]  S. Bauer,et al.  A survey of MRI-based medical image analysis for brain tumor studies , 2013, Physics in medicine and biology.

[27]  Mark Muzi,et al.  Multimodality Brain Tumor Imaging: MR Imaging, PET, and PET/MR Imaging , 2015, The Journal of Nuclear Medicine.

[28]  N. Kamaraj,et al.  CAD Scheme To Detect Brain Tumour In MR Images using Active Contour Models and Tree Classifiers , 2015 .

[29]  V. Cyrilraj,et al.  Multi-class abnormal breast tissue segmentation using texture features , 2014, 2014 International Conference on Science Engineering and Management Research (ICSEMR).

[30]  László Szilágyi,et al.  Brain Tumor Segmentation with Optimized Random Forest , 2016, BrainLes@MICCAI.

[31]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[32]  Ahmad Chaddad,et al.  Automated Feature Extraction in Brain Tumor by Magnetic Resonance Imaging Using Gaussian Mixture Models , 2015, Int. J. Biomed. Imaging.

[33]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[34]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..

[35]  Tianjun Ma,et al.  Towards Feature Fusion for Human Identification by Gait , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[36]  Klaus H. Maier-Hein,et al.  DALSA: Domain Adaptation for Supervised Learning From Sparsely Annotated MR Images , 2024, IEEE Transactions on Medical Imaging.

[37]  Jayaram K. Udupa,et al.  New variants of a method of MRI scale standardization , 2000, IEEE Transactions on Medical Imaging.

[38]  Hamidreza Saligheh Rad,et al.  Multi-parametric (ADC/PWI/T2-w) image fusion approach for accurate semi-automatic segmentation of tumorous regions in glioblastoma multiforme , 2015, Magnetic Resonance Materials in Physics, Biology and Medicine.