A comprehensive review on brain tumor segmentation and classification of MRI images

In the analysis of medical images, one of the challenging tasks is the recognition of brain tumours via medical resonance images (MRIs). The diagnosis process is still tedious due to its complexity and considerable variety in tissues of tumor perception. Therefore, the necessities of tumor identification techniques are improving nowadays for medical applications. In the past decades, different approaches in the segmentation of various precisions and complexity degree have been accomplished, which depends on the simplicity and the benchmark of the technique. An overview of this analysis is to give out the summary of the semi-automatic techniques for brain tumor segmentation and classification utilizing MRI. An enormous amount of MRI based image data is accomplished using deep learning approaches. There are several works, dealing on the conventional approaches for MRI-based segmentation of brain tumor. Alternatively, in this review, we revealed the latest trends in the methods of deep learning. Initially, we explain the several threads in MRI pre-processing, including registration of image, rectification of bias field, and non-brain tissue dismissal. And terminally, the present state evaluation of algorithm is offered and forecasting the growths to systematise the MRI-based brain tumor into a regular cyclic routine in the clinical field are focussed.

[1]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Akila Thiyagarajan,et al.  Comparative analysis of classifier Performance on MR brain images , 2015, Int. Arab J. Inf. Technol..

[3]  Sébastien Ourselin,et al.  Bayesian Model Selection for Pathological Neuroimaging Data Applied to White Matter Lesion Segmentation , 2015, IEEE Transactions on Medical Imaging.

[4]  A. Smit.  Experiences of gynaecological cancer and treatment of female survivors : a thesis presented in partial fulfilment of the requirements for the degree of Master of Science in Health Psychology with endorsement at Massey University, Palmerston North, New Zealand , 2011 .

[5]  Qianjin Feng,et al.  Brain Tumor Segmentation Based on Local Independent Projection-Based Classification , 2014, IEEE Transactions on Biomedical Engineering.

[6]  Kai-Kuang Ma,et al.  Tumor segmentation from magnetic resonance imaging by learning via one-class support vector machine , 2004 .

[7]  V. Anitha,et al.  Brain tumour classification using two-tier classifier with adaptive segmentation technique , 2016, IET Comput. Vis..

[8]  Stephen M. Smith,et al.  Enhanced brain extraction improves the accuracy of brain atrophy estimation , 2008, NeuroImage.

[9]  Suresh Pabboju,et al.  Brain Image Classification Using Dual-Tree M-Band Wavelet Transform and Naïve Bayes Classifier , 2020 .

[10]  Yaozong Gao,et al.  LINKS: Learning-based multi-source IntegratioN frameworK for Segmentation of infant brain images , 2015, NeuroImage.

[11]  K. S. Ravichandran,et al.  A deep neural network based classifier for brain tumor diagnosis , 2019, Appl. Soft Comput..

[12]  E. Vansteenkiste,et al.  Brain volume segmentation in newborn infants using multi-modal MRI with a low inter-slice resolution , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[13]  D. Shen,et al.  Computer-Aided Diagnosis with Deep Learning Architecture: Applications to Breast Lesions in US Images and Pulmonary Nodules in CT Scans , 2016, Scientific Reports.

[14]  Haifeng Shen,et al.  An adaptive differential evolution algorithm to optimal multi-level thresholding for MRI brain image segmentation , 2019, Expert Syst. Appl..

[15]  M. A. Balafar.  Fuzzy C-mean based brain MRI segmentation algorithms , 2012, Artificial Intelligence Review.

[16]  Moosa Ayati,et al.  Magnetic resonance imaging-based brain tumor grades classification and grading via convolutional neural networks and genetic algorithms , 2019, Biocybernetics and Biomedical Engineering.

[17]  Max A. Viergever,et al.  Automatic segmentation of MR brain images of preterm infants using supervised classification , 2015, NeuroImage.

[18]  Yoshitaka Masutani,et al.  Vascular Shape Segmentation and Structure Extraction Using a Shape-Based Region-Growing Model , 1998, MICCAI.

[19]  Sébastien Ourselin,et al.  On the Compactness, Efficiency, and Representation of 3D Convolutional Networks: Brain Parcellation as a Pretext Task , 2017, IPMI.

[20]  Boqiang Liu,et al.  S3D-UNet: Separable 3D U-Net for Brain Tumor Segmentation , 2018, BrainLes@MICCAI.

[21]  D. Louis Collins,et al.  Temporal Hierarchical Adaptive Texture CRF for Automatic Detection of Gadolinium-Enhancing Multiple Sclerosis Lesions in Brain MRI , 2015, IEEE Transactions on Medical Imaging.

[22]  Mert R. Sabuncu,et al.  Anatomical Priors in Convolutional Networks for Unsupervised Biomedical Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[23]  Omar Irfan Khan,et al.  A Hybrid Unsupervised Classification Technique for Automatic Brain MRI Tumor Recognition , 2020 .

[24]  D. Saraswathi,et al.  Brain Tumor Segmentation and Classification using Self Organizing Map , 2019, 2019 IEEE International Conference on System, Computation, Automation and Networking (ICSCAN).

[25]  Juha Koikkalainen,et al.  Fast and robust multi-atlas segmentation of brain magnetic resonance images , 2010, NeuroImage.

[26]  Andrew McCallum,et al.  Conditional Random Fields: Probabilistic Models for Segmenting and Labeling Sequence Data , 2001, ICML.

[27]  Syed Muhammad Anwar,et al.  Brain tumor segmentation using cascaded deep convolutional neural network , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[28]  Klaus H. Maier-Hein,et al.  Deep MRI brain extraction: A 3D convolutional neural network for skull stripping , 2016, NeuroImage.

[29]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[30]  B. Scheithauer,et al.  The New WHO Classification of Brain Tumours , 1993, Brain pathology.

[31]  M. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network. , 2016, IEEE transactions on medical imaging.

[32]  Madhuri S. Joshi,et al.  Brain Tumor Classification using Principal Component Analysis and Probabilistic Neural Network , 2015 .

[33]  Anthony J. Yezzi,et al.  Gradient flows and geometric active contour models , 1995, Proceedings of IEEE International Conference on Computer Vision.

[34]  Navjot Singh,et al.  A hybrid of active contour model and convex hull for automated brain tumor segmentation in multimodal MRI , 2019, Multimedia Tools and Applications.

[35]  Max A. Viergever,et al.  Automatic Segmentation of MR Brain Images With a Convolutional Neural Network , 2016, IEEE Transactions on Medical Imaging.

[36]  Daniel Rueckert,et al.  Multiple Sclerosis Lesion Segmentation Using Dictionary Learning and Sparse Coding , 2013, MICCAI.

[37]  Lisa Tang,et al.  Deep Convolutional Encoder Networks for Multiple Sclerosis Lesion Segmentation , 2015, MICCAI.

[38]  J. Seetha,et al.  Brain Tumor Classification Using Convolutional Neural Networks , 2018, Biomedical and Pharmacology Journal.

[39]  El-Sayed M. El-Horbaty,et al.  Classification using deep learning neural networks for brain tumors , 2017, Future Computing and Informatics Journal.

[40]  R. Shantha Selva Kumari,et al.  Fuzzy C means integrated with spatial information and contrast enhancement for segmentation of MR brain images , 2016, Int. J. Imaging Syst. Technol..

[41]  Emma B. Lewis,et al.  Correction of differential intensity inhomogeneity in longitudinal MR images , 2004, NeuroImage.

[42]  Zümray Dokur,et al.  A unified framework for image compression and segmentation by using an incremental neural network , 2008, Expert Syst. Appl..

[43]  Hayit Greenspan,et al.  Longitudinal Multiple Sclerosis Lesion Segmentation Using Multi-view Convolutional Neural Networks , 2016, LABELS/DLMIA@MICCAI.

[44]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[45]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[46]  B. van Ginneken,et al.  Deep learning as a tool for increased accuracy and efficiency of histopathological diagnosis , 2016, Scientific Reports.

[47]  Nico Karssemeijer,et al.  Large scale deep learning for computer aided detection of mammographic lesions , 2017, Medical Image Anal..

[48]  Qiang Chen,et al.  Generalized rough fuzzy c-means algorithm for brain MR image segmentation , 2012, Comput. Methods Programs Biomed..

[49]  Wen-Xiong Kang,et al.  The Comparative Research on Image Segmentation Algorithms , 2009, 2009 First International Workshop on Education Technology and Computer Science.

[50]  Mert R. Sabuncu,et al.  A unified framework for cross-modality multi-atlas segmentation of brain MRI , 2013, Medical Image Anal..

[51]  Mert R. Sabuncu,et al.  Unsupervised deep learning for Bayesian brain MRI segmentation , 2019, MICCAI.

[52]  Bostjan Likar,et al.  Stratified mixture modeling for segmentation of white-matter lesions in brain MR images , 2016, NeuroImage.

[53]  Terry M. Peters,et al.  3D statistical neuroanatomical models from 305 MRI volumes , 1993, 1993 IEEE Conference Record Nuclear Science Symposium and Medical Imaging Conference.

[54]  L O Hall,et al.  Review of MR image segmentation techniques using pattern recognition. , 1993, Medical physics.

[55]  Umit Ilhan,et al.  Brain tumor segmentation based on a new threshold approach , 2017 .

[56]  Claire Chalopin,et al.  Automatic selection of localized region-based active contour models using image content analysis applied to brain tumor segmentation , 2017, Comput. Biol. Medicine.

[57]  Nelly Gordillo,et al.  State of the art survey on MRI brain tumor segmentation. , 2013, Magnetic resonance imaging.

[58]  Mahmoud Neji,et al.  Feature selection based on hybrid optimization for magnetic resonance imaging brain tumor classification and segmentation , 2019 .

[59]  Tarik Tihan,et al.  Machine Learning Decision Tree Models for Differentiation of Posterior Fossa Tumors Using Diffusion Histogram Analysis and Structural MRI Findings , 2020, Frontiers in Oncology.

[60]  R. Kikinis,et al.  Automated segmentation of MR images of brain tumors. , 2001, Radiology.

[61]  Hongmin Cai,et al.  Multiparametric tissue characterization of brain neoplasms and their recurrence using pattern classification of MR images. , 2008, Academic radiology.

[62]  Dinggang Shen,et al.  CENTS: Cortical enhanced neonatal tissue segmentation , 2011, Human brain mapping.

[63]  Athanasios V. Vasilakos,et al.  Neural networks for computer-aided diagnosis in medicine: A review , 2016, Neurocomputing.

[64]  Anuj Bhardwaj,et al.  A review on brain tumor segmentation of MRI images. , 2019, Magnetic resonance imaging.

[65]  John D. Kelleher,et al.  A U-Net Deep Learning Framework for High Performance Vessel Segmentation in Patients With Cerebrovascular Disease , 2019, Front. Neurosci..

[66]  Mert R. Sabuncu,et al.  Multi-atlas segmentation of biomedical images: A survey , 2014, Medical Image Anal..

[67]  Hui Liu,et al.  MMAN: Multi-modality aggregation network for brain segmentation from MR images , 2019, Neurocomputing.

[68]  Anthony J. Yezzi,et al.  Brain MRI T1-Map and T1-weighted image segmentation in a variational framework , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[69]  Md. Foisal Hossain,et al.  An Advanced Algorithm Combining SVM and ANN Classifiers to Categorize Tumor with Position from Brain MRI Images , 2018 .

[70]  Arthur W. Toga,et al.  Construction of a 3D probabilistic atlas of human cortical structures , 2008, NeuroImage.

[71]  Sim Heng Ong,et al.  Integrating spatial fuzzy clustering with level set methods for automated medical image segmentation , 2011, Comput. Biol. Medicine.

[72]  Yao Lu,et al.  RIC-Unet: An Improved Neural Network Based on Unet for Nuclei Segmentation in Histology Images , 2019, IEEE Access.

[73]  Rik Van de Walle,et al.  An integrated method of adaptive enhancement for unsupervised segmentation of MRI brain images , 2003, Pattern Recognit. Lett..

[74]  Paul M. Thompson,et al.  Brain Anatomical Structure Segmentation by Hybrid Discriminative/Generative Models , 2008, IEEE Transactions on Medical Imaging.

[75]  Amit Verma,et al.  Deep learning based enhanced tumor segmentation approach for MR brain images , 2019, Appl. Soft Comput..

[76]  Oscar Camara,et al.  Generalized Overlap Measures for Evaluation and Validation in Medical Image Analysis , 2006, IEEE Transactions on Medical Imaging.

[77]  Maria Murgasova,et al.  Segmentation of brain MRI during early childhood , 2008 .

[78]  Giovanni Montana,et al.  Deep neural networks for anatomical brain segmentation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[79]  Daniel Rueckert,et al.  Automatic Whole Brain MRI Segmentation of the Developing Neonatal Brain , 2014, IEEE Transactions on Medical Imaging.

[80]  Jasjit S Suri,et al.  A Review on a Deep Learning Perspective in Brain Cancer Classification , 2019, Cancers.

[81]  V. S. Malemath,et al.  Detection of Brain Tumor using Expectation Maximization (EM) and Watershed , 2018 .

[82]  Isaac N. Bankman,et al.  Handbook of Medical Imaging. Processing and Analysis , 2002 .

[83]  Albert C. S. Chung,et al.  Multi-scale structured CNN with label consistency for brain MR image segmentation , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[84]  S. R. Kannan,et al.  Effective fuzzy c-means based kernel function in segmenting medical images , 2010, Comput. Biol. Medicine.

[85]  K. Perumal,et al.  Brain tumor segmentation using genetic algorithm and ANN techniques , 2017, 2017 IEEE International Conference on Power, Control, Signals and Instrumentation Engineering (ICPCSI).

[86]  Arthur W. Toga,et al.  Segmentation of Brain MR Images Using a Charged Fluid Model , 2007, IEEE Transactions on Biomedical Engineering.

[87]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[88]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[89]  Stefan Bauer,et al.  Fully Automatic Segmentation of Brain Tumor Images Using Support Vector Machine Classification in Combination with Hierarchical Conditional Random Field Regularization , 2011, MICCAI.

[90]  Mohamed Sathik,et al.  Performance analysis of bias correction techniques in brain MR images , 2020 .

[91]  Rasmus Larsen,et al.  An Ensemble of 2D Convolutional Neural Networks for Tumor Segmentation , 2015, SCIA.

[92]  Defeng Wang,et al.  Automatic fetal brain extraction from 2D in utero fetal MRI slices using deep neural network , 2020, Neurocomputing.

[93]  Max A. Viergever,et al.  Automatic segmentation of the preterm neonatal brain with MRI using supervised classification , 2013, Medical Imaging.

[94]  Dalia Mahmoud Adam Mahmoud,et al.  Brain Tumor Detection Using Artificial Neural Networks , 2012 .

[95]  Giancarlo Fortino,et al.  A Hybrid Feature Extraction Method With Regularized Extreme Learning Machine for Brain Tumor Classification , 2019, IEEE Access.

[96]  Kenneth Revett,et al.  Computer-aided diagnosis of human brain tumor through MRI: A survey and a new algorithm , 2014, Expert Syst. Appl..

[97]  Sebastien Ourselin,et al.  A New Deformable Model Using Dynamic Gradient Vector Flow and Adaptive Balloon Forces , 2003 .

[98]  Sung Wook Baik,et al.  Multi-grade brain tumor classification using deep CNN with extensive data augmentation , 2019, J. Comput. Sci..

[99]  Ron Kikinis,et al.  Adaptive, template moderated, spatially varying statistical classification , 2000, Medical Image Anal..

[100]  Abdel-Badeeh M. Salem,et al.  Hybrid intelligent techniques for MRI brain images classification , 2010, Digit. Signal Process..

[101]  Sanjay Saxena,et al.  Review of Brain Tumor Segmentation and Classification , 2018, 2018 International Conference on Current Trends towards Converging Technologies (ICCTCT).

[102]  Ewout Vansteenkiste,et al.  Quantitative Analysis of Ultrasound Images of the Preterm Brain , 2007 .

[103]  Mohamed Akil,et al.  Fully Automatic Brain Tumor Segmentation using End-To-End Incremental Deep Neural Networks in MRI images , 2018, Comput. Methods Programs Biomed..

[104]  Chi-Wing Fu,et al.  H-DenseUNet: Hybrid Densely Connected UNet for Liver and Tumor Segmentation From CT Volumes , 2018, IEEE Transactions on Medical Imaging.

[105]  L. R. Dice.  Measures of the Amount of Ecologic Association Between Species , 1945 .

[106]  Elena De Momi,et al.  Brain-vascular segmentation for SEEG planning via a 3D fully-convolutional neural network , 2019, 2019 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[107]  Lisa Tang,et al.  Deep 3D Convolutional Encoder Networks With Shortcuts for Multiscale Feature Integration Applied to Multiple Sclerosis Lesion Segmentation , 2016, IEEE Transactions on Medical Imaging.

[108]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[109]  Nikos Chrisochoides,et al.  Accurate and fast deformable medical image registration for brain tumor resection using image-guided neurosurgery , 2016, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[110]  M. M. Sufyan Beg,et al.  Improved Edge Detection Algorithm for Brain Tumor Segmentation , 2015, Procedia Computer Science.

[111]  David Dagan Feng,et al.  Hidden Markov random field model based brain MR image segmentation using clonal selection algorithm and Markov chain Monte Carlo method , 2014, Biomed. Signal Process. Control..

[112]  Farida Cheriet,et al.  Joint segmentation and classification of retinal arteries/veins from fundus images , 2019, Artif. Intell. Medicine.

[113]  Daniel Rueckert,et al.  Automatic segmentation and reconstruction of the cortex from neonatal MRI , 2007, NeuroImage.