Brain tumor detection using fusion of hand crafted and deep learning features

Abstract The perilous disease in the worldwide now a days is brain tumor. Tumor affects the brain by damaging healthy tissues or intensifying intra cranial pressure. Hence, rapid growth in tumor cells may lead to death. Therefore, early brain tumor diagnosis is a more momentous task that can save patient from adverse effects. In the proposed work, the Grab cut method is applied for accurate segmentation of actual lesion symptoms while Transfer learning model visual geometry group (VGG-19) is fine-tuned to acquire the features which are then concatenated with hand crafted (shape and texture) features through serial based method. These features are optimized through entropy for accurate and fast classification and fused vector is supplied to classifiers. The presented model is tested on top medical image computing and computer-assisted intervention (MICCAI) challenge databases including multimodal brain tumor segmentation (BRATS) 2015, 2016, and 2017 respectively. The testing results with dice similarity coefficient (DSC) achieve 0.99 on BRATS 2015, 1.00 on BRATS 2015 and 0.99 on BRATS 2017 respectively.

[1]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[2]  Leo Breiman,et al.  Bagging Predictors , 1996, Machine Learning.

[3]  Stefan Bauer,et al.  Fully Automatic Segmentation of Brain Tumor Images Using Support Vector Machine Classification in Combination with Hierarchical Conditional Random Field Regularization , 2011, MICCAI.

[4]  Jamal Hussain Shah,et al.  AUTOMATED ULCER AND BLEEDING CLASSIFICATION FROM WCE IMAGES USING MULTIPLE FEATURES FUSION AND SELECTION , 2018, Journal of Mechanics in Medicine and Biology.

[5]  J P B O'Connor,et al.  Imaging biomarkers of angiogenesis and the microvascular environment in cerebral tumours. , 2011, The British journal of radiology.

[6]  Muhammad Sharif,et al.  Detection of Brain Tumor based on Features Fusion and Machine Learning , 2018, J. Ambient Intell. Humaniz. Comput..

[7]  Amir Hussain,et al.  Applications of Deep Learning and Reinforcement Learning to Biological Data , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[8]  R. Fisher.  THE USE OF MULTIPLE MEASUREMENTS IN TAXONOMIC PROBLEMS , 1936 .

[9]  Christopher Joseph Pal,et al.  A Convolutional Neural Network Approach to Brain Tumor Segmentation , 2015, Brainles@MICCAI.

[10]  Koenraad Van Leemput,et al.  Automated model-based tissue classification of MR images of the brain , 1999, IEEE Transactions on Medical Imaging.

[11]  Victor Alves,et al.  Deep Convolutional Neural Networks for the Segmentation of Gliomas in Multi-sequence MRI , 2015, Brainles@MICCAI.

[12]  Brian B. Avants,et al.  Optimal Symmetric Multimodal Templates and Concatenated Random Forests for Supervised Brain Tumor Segmentation (Simplified) with ANTsR , 2014, Neuroinformatics.

[13]  Muhammad Sharif,et al.  A distinctive approach in brain tumor detection and classification using MRI , 2017, Pattern Recognit. Lett..

[14]  Muhammad Sharif,et al.  Big data analysis for brain tumor detection: Deep convolutional neural networks , 2018, Future Gener. Comput. Syst..

[15]  Muhammad Sharif,et al.  Appearance based pedestrians' gender recognition by employing stacked auto encoders in deep learning , 2018, Future Gener. Comput. Syst..

[16]  Yong Fan,et al.  A deep learning model integrating FCNNs and CRFs for brain tumor segmentation , 2017, Medical Image Anal..

[17]  Bjoern H. Menze,et al.  Local Structure Prediction with Convolutional Neural Networks for Multimodal Brain Tumor Segmentation , 2015, MCV@MICCAI.

[18]  Muhammad Sharif,et al.  A framework for offline signature verification system: Best features selection approach , 2018, Pattern Recognit. Lett..

[19]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[20]  Qianjin Feng,et al.  Brain Tumor Segmentation Based on Local Independent Projection-Based Classification , 2014, IEEE Transactions on Biomedical Engineering.

[21]  Jamal Hussain Shah,et al.  A novel machine learning approach for scene text extraction , 2018, Future Gener. Comput. Syst..

[22]  Guang Yang,et al.  Automatic Brain Tumor Detection and Segmentation Using U-Net Based Fully Convolutional Networks , 2017, MIUA.

[23]  Daniel Rueckert,et al.  Contusion segmentation from subjects with Traumatic Brain Injury: A random forest framework , 2014, 2014 IEEE 11th International Symposium on Biomedical Imaging (ISBI).

[24]  Christos Davatzikos,et al.  Combining Generative Models for Multifocal Glioma Segmentation and Registration , 2014, MICCAI.

[25]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[26]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[27]  Olivier Clatz,et al.  Spatial Decision Forests for MS Lesion Segmentation in Multi-Channel MR Images , 2010, MICCAI.

[28]  Carlos Alberto Silva,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images. , 2016, IEEE transactions on medical imaging.

[29]  Hesham F. A. Hamed,et al.  Two-phase multi-model automatic brain tumour diagnosis system from magnetic resonance images using convolutional neural networks , 2018, EURASIP Journal on Image and Video Processing.

[30]  Muhammad Sharif,et al.  A method for the detection and classification of diabetic retinopathy using structural predictors of bright lesions , 2017, J. Comput. Sci..

[31]  Mussarat Yasmin,et al.  Lung Nodule Detection Using Polygon Approximation and Hybrid Features from CT Images , 2017 .

[32]  Syed Muhammad Anwar,et al.  Segmentation of Glioma Tumors in Brain Using Deep Convolutional Neural Network , 2017, Neurocomputing.

[33]  Michael Kistler,et al.  The Virtual Skeleton Database: An Open Access Repository for Biomedical Research and Collaboration , 2013, Journal of medical Internet research.

[34]  Jamal Hussain Shah,et al.  Facial expressions classification and false label reduction using LDA and threefold SVM , 2017, Pattern Recognit. Lett..

[35]  Khan M. Iftekharuddin,et al.  Multi-fractal detrended texture feature for brain tumor classification , 2015, Medical Imaging.

[36]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[37]  Antonio Criminisi,et al.  Segmentation of Brain Tumor Tissues with Convolutional Neural Networks , 2014 .

[38]  Olivier Salvado,et al.  Lesion segmentation from multimodal MRI using random forest following ischemic stroke , 2014, NeuroImage.

[39]  Mohamed A. Ismail,et al.  Brain Tumor Segmantation Using Random Forest Trained on Iteratively Selected Patients , 2016, BrainLes@MICCAI.

[40]  Wei Wu,et al.  Brain tumor detection and segmentation in a CRF (conditional random fields) framework with pixel-pairwise affinity and superpixel-level features , 2013, International Journal of Computer Assisted Radiology and Surgery.

[41]  G. Urban,et al.  ilastik for Multi-modal Brain Tumor Segmentation , 2014 .

[42]  Changxing Ding,et al.  Dual-force convolutional neural networks for accurate brain tumor segmentation , 2019, Pattern Recognit..

[43]  Konstantinos Kamnitsas,et al.  Efficient multi‐scale 3D CNN with fully connected CRF for accurate brain lesion segmentation , 2016, Medical Image Anal..