A Customized VGG19 Network with Concatenation of Deep and Handcrafted Features for Brain Tumor Detection

Brain tumor (BT) is one of the brain abnormalities which arises due to various reasons. The unrecognized and untreated BT will increase the morbidity and mortality rates. The clinical level assessment of BT is normally performed using the bio-imaging technique, and MRI-assisted brain screening is one of the universal techniques. The proposed work aims to develop a deep learning architecture (DLA) to support the automated detection of BT using two-dimensional MRI slices. This work proposes the following DLAs to detect the BT: (i) implementing the pre-trained DLAs, such as AlexNet, VGG16, VGG19, ResNet50 and ResNet101 with the deep-features-based SoftMax classifier; (ii) pre-trained DLAs with deep-features-based classification using decision tree (DT), k nearest neighbor (KNN), SVM-linear and SVM-RBF; and (iii) a customized VGG19 network with serially-fused deep-features and handcrafted-features to improve the BT detection accuracy. The experimental investigation was separately executed using Flair, T2 and T1C modality MRI slices, and a ten-fold cross validation was implemented to substantiate the performance of proposed DLA. The results of this work confirm that the VGG19 with SVM-RBF helped to attain better classification accuracy with Flair (>99%), T2 (>98%), T1C (>97%) and clinical images (>98%).

[1]  V. Rajinikanth,et al.  Social-Group-Optimization based tumor evaluation tool for clinical brain MRI of Flair/diffusion-weighted modality , 2019, Biocybernetics and Biomedical Engineering.

[2]  Anjan Gudigar,et al.  Application of multiresolution analysis for automated detection of brain abnormality using MR images: A comparative study , 2019, Future Gener. Comput. Syst..

[3]  U. Rajendra Acharya,et al.  Automatic detection of ischemic stroke using higher order spectra features in brain MRI images , 2019, Cognitive Systems Research.

[4]  Gustavo Marrero Callicó,et al.  Deep Learning-Based Framework for In Vivo Identification of Glioblastoma Tumor using Hyperspectral Images of Human Brain , 2019, Sensors.

[5]  Christopher Joseph Pal,et al.  Brain tumor segmentation with Deep Neural Networks , 2015, Medical Image Anal..

[6]  Alex Noel Joseph Raj,et al.  Nipple Segmentation and Localization Using Modified U-Net on Breast Ultrasound Images , 2019, J. Medical Imaging Health Informatics.

[7]  N. Sri Madhava Raja,et al.  Firefly Algorithm Assisted Segmentation of Tumor from Brain MRI using Tsallis Function and Markov Random Field , 2017 .

[8]  Ganesh Naik,et al.  A supervised blood vessel segmentation technique for digital Fundus images using Zernike Moment based features , 2020, PloS one.

[9]  Millie Pant,et al.  Brain tumor segmentation and classification from magnetic resonance images: Review of selected methods from 2014 to 2019 , 2020, Pattern Recognit. Lett..

[10]  V. Rajinikanth,et al.  Evaluation and Classification of the Brain Tumor MRI using Machine Learning Technique , 2019 .

[11]  V. Rajinikanth,et al.  Entropy based segmentation of tumor from brain MR images - a study with teaching learning based optimization , 2017, Pattern Recognit. Lett..

[12]  Dragica Radosav,et al.  Deep Learning and Medical Diagnosis: A Review of Literature , 2018, Multimodal Technol. Interact..

[13]  N. Sri Madhava Raja,et al.  Contrast enhanced medical MRI evaluation using Tsallis entropy and region growing segmentation , 2018, J. Ambient Intell. Humaniz. Comput..

[14]  V. Rajinikanth,et al.  A reliable framework for accurate brain image examination and treatment planning based on early diagnosis support for clinicians , 2019, Neural Computing and Applications.

[15]  Sébastien Ourselin,et al.  Interactive Medical Image Segmentation Using Deep Learning With Image-Specific Fine Tuning , 2017, IEEE Transactions on Medical Imaging.

[16]  Palani Thanaraj,et al.  Multichannel interictal spike activity detection using time–frequency entropy measure , 2017, Australasian Physical & Engineering Sciences in Medicine.

[17]  P. Baldi,et al.  Deep-Learning Convolutional Neural Networks Accurately Classify Genetic Mutations in Gliomas , 2018, American Journal of Neuroradiology.

[18]  Brian B. Avants,et al.  The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) , 2015, IEEE Transactions on Medical Imaging.

[19]  Venkatesan Rajinikanth,et al.  Jaya Algorithm Guided Procedure to Segment Tumor from Brain MRI , 2018, Journal of Optimization.

[20]  Muhammad Sharif,et al.  Big data analysis for brain tumor detection: Deep convolutional neural networks , 2018, Future Gener. Comput. Syst..

[21]  J. Suri,et al.  Cost-Effective and Non-Invasive Automated Benign & Malignant Thyroid Lesion Classification in 3D Contrast-Enhanced Ultrasound Using Combination of Wavelets and Textures: A Class of ThyroScan™ Algorithms , 2011, Technology in cancer research & treatment.

[22]  Jasjit S Suri,et al.  A Review on a Deep Learning Perspective in Brain Cancer Classification , 2019, Cancers.

[23]  Antonello Rizzi,et al.  Cancer Diagnosis Using Deep Learning: A Bibliographic Review , 2019, Cancers.

[24]  Mateusz Buda,et al.  Association of genomic subtypes of lower-grade gliomas with shape features automatically extracted by a deep learning algorithm , 2019, Comput. Biol. Medicine.

[25]  N. Sri Madhava Raja,et al.  Deep-learning framework to detect lung abnormality - A study with chest X-Ray and lung CT scan images , 2020, Pattern Recognit. Lett..

[26]  Ehsan Ullah Munir,et al.  Brain tumor segmentation and classification by improved binomial thresholding and multi-features selection , 2018, J. Ambient Intell. Humaniz. Comput..

[27]  Joel E. W. Koh,et al.  A Novel Depression Diagnosis Index Using Nonlinear Features in EEG Signals , 2015, European Neurology.

[28]  Kenneth Revett,et al.  Computer-aided diagnosis of human brain tumor through MRI: A survey and a new algorithm , 2014, Expert Syst. Appl..

[29]  Alex Noel Joseph Raj,et al.  A Multi-Sensor System for Silkworm Cocoon Gender Classification via Image Processing and Support Vector Machine , 2019, Sensors.

[30]  Anjan Gudigar,et al.  Automated system for the detection of thoracolumbar fractures using a CNN architecture , 2018, Future Gener. Comput. Syst..

[31]  S. Bauer,et al.  A survey of MRI-based medical image analysis for brain tumor studies , 2013, Physics in medicine and biology.

[32]  Hilla Peretz,et al.  The , 1966 .

[33]  Corinna Kofler,et al.  Classifying Image Stacks of Specular Silicon Wafer Back Surface Regions: Performance Comparison of CNNs and SVMs , 2019, Sensors.

[34]  Khalid Masood Khan,et al.  Brain Tumor Analysis Empowered with Deep Learning: A Review, Taxonomy, and Future Challenges , 2020, Brain sciences.

[35]  Seuc Ho Ryu,et al.  Brain MRI Image Classification for Cancer Detection Using Deep Wavelet Autoencoder-Based Deep Neural Network , 2019, IEEE Access.

[36]  P. Marikkannu,et al.  MRI Brain Images Classification: A Multi-Level Threshold Based Region Optimization Technique , 2018, Journal of Medical Systems.

[37]  U. Rajendra Acharya,et al.  Application of deep transfer learning for automated brain abnormality classification using MR images , 2019, Cognitive Systems Research.

[38]  U. Rajendra Acharya,et al.  Application of Non-Linear and Wavelet Based Features for the Automated Identification of Epileptic EEG signals , 2012, Int. J. Neural Syst..

[39]  Snekhalatha Umapathy,et al.  Human Tongue Thermography Could Be a Prognostic Tool for Prescreening the Type II Diabetes Mellitus , 2020, Evidence-based complementary and alternative medicine : eCAM.

[40]  U Rajendra Acharya,et al.  Automated Detection of Alzheimer’s Disease Using Brain MRI Images– A Study with Various Feature Extraction Techniques , 2019, Journal of Medical Systems.

[41]  Tanzila Saba,et al.  Brain tumor detection using statistical and machine learning method , 2019, Comput. Methods Programs Biomed..

[42]  El-Sayed M. El-Horbaty,et al.  Classification using deep learning neural networks for brain tumors , 2017, Future Computing and Informatics Journal.

[43]  James M. Brown,et al.  Automatic assessment of glioma burden: a deep learning algorithm for fully automated volumetric and bidimensional measurement , 2019, Neuro-oncology.

[44]  U. Rajendra Acharya,et al.  Automated detection of coronary artery disease using different durations of ECG segments with convolutional neural network , 2017, Knowl. Based Syst..

[45]  Alex Noel Joseph Raj,et al.  A fuzzy clustering based color-coded diagram for effective illustration of blood perfusion parameters in contrast-enhanced ultrasound videos , 2019, Comput. Methods Programs Biomed..

[46]  Dinggang Shen,et al.  Anatomical Landmark Based Deep Feature Representation for MR Images in Brain Disease Diagnosis , 2018, IEEE Journal of Biomedical and Health Informatics.

[47]  Jian Ping Li,et al.  Active deep neural network features selection for segmentation and recognition of brain tumors using MRI images , 2020, Pattern Recognit. Lett..

[48]  Saddam Hussain,et al.  Brain Tumor Detection and Segmentation in MR Images Using Deep Learning , 2019, Arabian Journal for Science and Engineering.

[49]  Saed Khawaldeh,et al.  Noninvasive Grading of Glioma Tumor Using Magnetic Resonance Imaging with Convolutional Neural Networks , 2017 .

[50]  Parvathavarthini Balasubramanian,et al.  Segmentation of Brain Regions by Integrating Meta Heuristic Multilevel Threshold with Markov Random Field , 2016 .

[51]  Stephen M. Moore,et al.  The Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository , 2013, Journal of Digital Imaging.

[52]  U. Rajendra Acharya,et al.  Convolutional neural networks for multi-class brain disease detection using MRI images , 2019, Comput. Medical Imaging Graph..

[53]  G. Reifenberger,et al.  The 2016 World Health Organization Classification of Tumors of the Central Nervous System: a summary , 2016, Acta Neuropathologica.