Classification of brain MRI using hyper column technique with convolutional neural network and feature selection method

Abstract A proper and certain brain tumor MRI classification has a significant role in current clinical diagnosis, decision making as well as managing the treatment programs. In clinical practice, the examination is performed visually by the specialists, this is a labor-intensive and error-prone process. Therefore, the computer-based systems are in demand so as to carry out objectively this process. In the traditional machine learning approaches, the low-level and high-level handcrafted features used to describe the brain tumor MRI are extracted and classified to overcome the mentioned drawbacks. Considering the recent advances in deep learning, we propose a novel convolutional neural network (CNN) model that is combined with the hypercolumn technique, pretrained AlexNet and VGG-16 networks, recursive feature elimination (RFE), and support vector machine (SVM) in this study. One of the great advantages of the proposed model is that with the help of the hypercolumn technique, it can keep the local discriminative features, which are extracted from the layers located at the different levels of the deep architectures. In addition, the proposed model exploits the generalization abilities of both AlexNet and VGG-16 networks by fusing the deep features achieved from the last fully-connected layers of the networks. Furthermore, the discriminative capacity of the proposed model is enhanced using RFE and thus the most effective deep features are revealed. As a result, the proposed model yielded an accuracy of 96.77% without using any handcrafted feature engine. A fully automated consistent and effective diagnostic model is ensured for the brain tumor MRI classification. Consequently, the proposed model can contribute to realizing a more objective evaluation in the clinics, supporting the decision-making process of the experts, and reducing misdiagnosis rates.

[1]  Graham W. Taylor,et al.  Skin Lesion Segmentation using Deep Hypercolumn Descriptors , 2017 .

[2]  Fazli Wahid,et al.  A simple and intelligent approach for brain MRI classification , 2015, J. Intell. Fuzzy Syst..

[3]  Anjali Kulkarni,et al.  Classification of lung cancer stages on CT scan images using image processing , 2014, 2014 IEEE International Conference on Advanced Communications, Control and Computing Technologies.

[4]  Sargun Shashi B. Rana.  A Review of Medical Image Enhancement Techniques for Image Processing , 2011 .

[5]  Keiron O'Shea,et al.  An Introduction to Convolutional Neural Networks , 2015, ArXiv.

[6]  I. T. Uzbay.  Beyni Anlamak Sadece Nörobilim ile Mümkün Mü? Beyin Yüzyılında Nörolojik Bilimlerden Sosyal Bilimlere Yeni Açılımlar, Yeni Yaklaşımlar , 2015 .

[7]  Zafer Cömert,et al.  Waste classification using AutoEncoder network with integrated feature selection method in convolutional neural network models , 2020 .

[8]  Konstantinos N. Plataniotis,et al.  Brain Tumor Type Classification via Capsule Networks , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[9]  N. Varuna Shree,et al.  Identification and classification of brain tumor MRI images with feature extraction using DWT and probabilistic neural network , 2018, Brain Informatics.

[10]  Navid Ghassemi,et al.  Deep neural network with generative adversarial networks pre-training for brain tumor classification based on MR images , 2020, Biomed. Signal Process. Control..

[11]  Jianfeng Lu,et al.  Content-Based Brain Tumor Retrieval for MR Images Using Transfer Learning , 2019, IEEE Access.

[12]  Kaizhu Huang,et al.  Reducing and Stretching Deep Convolutional Activation Features for Accurate Image Classification , 2018, Cognitive Computation.

[13]  Efstratios N. Pistikopoulos,et al.  A Nonlinear Support Vector Machine-Based Feature Selection Approach for Fault Detection and Diagnosis: Application to the Tennessee Eastman Process. , 2019, AIChE journal. American Institute of Chemical Engineers.

[14]  Jamshid Dehmeshki,et al.  Shape-Based Computer-Aided Detection of Lung Nodules in Thoracic CT Images , 2009, IEEE Transactions on Biomedical Engineering.

[15]  Jitendra Malik,et al.  Hypercolumns for object segmentation and fine-grained localization , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[16]  Soonmee Cha,et al.  Modern Brain Tumor Imaging , 2015, Brain tumor research and treatment.

[17]  Arvid Lundervold,et al.  An overview of deep learning in medical imaging focusing on MRI , 2018, Zeitschrift fur medizinische Physik.

[18]  Lukasz Kaiser,et al.  Attention is All you Need , 2017, NIPS.

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Vinod Kumar,et al.  A package-SFERCB-"Segmentation, feature extraction, reduction and classification analysis by both SVM and ANN for brain tumors" , 2016, Appl. Soft Comput..

[21]  Abdul Salam Shah,et al.  A Robust Technique of Brain MRI Classification using Color Features and K-Nearest Neighbors Algorithm , 2016 .

[22]  Lisa Hellerstein,et al.  Recursive Feature Elimination by Sensitivity Testing , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[23]  Yang Wang,et al.  Applications of Support Vector Machine (SVM) Learning in Cancer Genomics. , 2018, Cancer genomics & proteomics.

[24]  M Hajmeer,et al.  A probabilistic neural network approach for modeling and classification of bacterial growth/no-growth data. , 2002, Journal of microbiological methods.

[25]  Zafer Cömert,et al.  Fetal Hypoxia Detection Based on Deep Convolutional Neural Network with Transfer Learning Approach , 2018, CSOS.

[26]  C.-C. Jay Kuo.  Understanding convolutional neural networks with a mathematical model , 2016, J. Vis. Commun. Image Represent..

[27]  Jayanth Koushik.  Understanding Convolutional Neural Networks , 2016, ArXiv.

[28]  Cheng Wang,et al.  Mini-batch algorithms with online step size , 2019, Knowl. Based Syst..

[29]  Sung Wook Baik,et al.  Multi-grade brain tumor classification using deep CNN with extensive data augmentation , 2019, J. Comput. Sci..

[30]  Waleed Khan,et al.  Texture Feature Selection Using GA for Classification of Human Brain MRI Scans , 2016, ICSI.

[31]  Davut Hanbay,et al.  Deep learning based brain tumor classification and detection system , 2018, Turkish J. Electr. Eng. Comput. Sci..

[32]  Narayan Srinivasa,et al.  Hypercolumn Sparsification for Low-Power Convolutional Neural Networks , 2019, ACM J. Emerg. Technol. Comput. Syst..