Real-time classification of brain tumors in MRI images with a convolutional operator-based hidden Markov model

Classification of brain tumors based on the brain magnetic resonance imaging (MRI) results of patients has become an important problem in medical image processing. A computer program that can efficiently analyze brain MRI images of patients in real time and generate accurate classification results of the tumors in these images can significantly reduce the amount of time needed for diagnosis, which may increase the chances for patients to survive. This paper proposes a new statistical method that can accurately classify three types of brain tumors based on MRI images, the three types of tumors considered include pituitary tumor, glioma, and meningioma. The features for a pixel in an MRI image are obtained by applying a set of convolutional operators to the neighborhood area of the pixel. For training, a hidden Markov model (HMM) is constructed and trained from a training dataset by computing a statistical profile for the feature vectors for pixels in the tumor regions of each type of brain tumors. In addition, a statistical profile is also obtained for pixels that are in the background of a tumor. For classification, the trained HMM is used to assign labels to pixels in an MRI image with a dynamic programming approach and the classification result of the image is obtained from the labels assigned to the tumor region. Both the training and classification processes can be efficiently performed in linear time and does not require the availability of a large amount of computational resources. Experimental results on a large dataset of MRI images show that the proposed method can provide classification results with high accuracy for all three types of brain tumors. A comparison with state-of-the-art methods for brain tumor classification suggests that the proposed method can achieve improved classification accuracy. In addition, real-time analysis also reveals that the proposed approach can probably be used for real-time classification of brain tumors.

[1]  Mohammad Reza Khosravi,et al.  Medical Image Magnification Based on Original and Estimated Pixel Selection Models. , 2018 .

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Long Jin,et al.  Convolutional Neural Network Based on Complex Networks for Brain Tumor Image Classification With a Modified Activation Function , 2020, IEEE Access.

[4]  Hua Hu,et al.  Advances in multimodal data fusion in neuroimaging: Overview, challenges, and novel orientation , 2020, Information Fusion.

[5]  D. Selvathi,et al.  Brain MRI Slices Classification Using Least Squares Support Vector Machine , 2007 .

[6]  Gwanggil Jeon,et al.  VisGraphNet: A complex network interpretation of convolutional neural features , 2021, Inf. Sci..

[7]  Ali Mohammad Alqudah,et al.  Brain Tumor Classification Using Deep Learning Technique - A Comparison between Cropped, Uncropped, and Segmented Lesion Images with Different Sizes , 2019, International Journal of Advanced Trends in Computer Science and Engineering.

[8]  R. Lavanyadevi,et al.  Brain tumor classification and segmentation in MRI images using PNN , 2017, 2017 IEEE International Conference on Electrical, Instrumentation and Communication Engineering (ICEICE).

[9]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[10]  Ali Mohammad Alqudah,et al.  ECG CLASSIFICATION USING HIGHER ORDER SPECTRAL ESTIMATION AND DEEP LEARNING TECHNIQUES , 2019, Neural Network World.

[11]  Nelly Gordillo,et al.  State of the art survey on MRI brain tumor segmentation. , 2013, Magnetic resonance imaging.

[12]  Ayça Çakmak Pehlivanli,et al.  PCA based clustering for brain tumor segmentation of T1w MRI images , 2017, Comput. Methods Programs Biomed..

[13]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Saed Khawaldeh,et al.  Noninvasive Grading of Glioma Tumor Using Magnetic Resonance Imaging with Convolutional Neural Networks , 2017 .

[15]  Abdul Ghafoor,et al.  MRI BRAIN CLASSIFICATION USING TEXTURE FEATURES, FUZZY WEIGHTING AND SUPPORT VECTOR MACHINE , 2013 .

[16]  Juan Manuel Górriz,et al.  Covid-19 classification by FGCNet with deep feature fusion from graph convolutional network and convolutional neural network , 2020, Information Fusion.

[17]  Shihui Ying,et al.  MR Image Super-Resolution via Wide Residual Networks With Fixed Skip Connection , 2019, IEEE Journal of Biomedical and Health Informatics.

[18]  Chunmei Liu,et al.  Segmentation of Images and Medical Images with an Adaptive Hidden Markov Model , 2018 .

[19]  J. Seetha,et al.  Brain Tumor Classification Using Convolutional Neural Networks , 2018, Biomedical and Pharmacology Journal.

[20]  Gwanggil Jeon,et al.  Multifocus image fusion using random forest and hidden Markov model , 2019, Soft Computing.

[21]  Eser Sert,et al.  Brain tumor detection based on Convolutional Neural Network with neutrosophic expert maximum fuzzy sure entropy , 2019 .

[22]  Yuanning Liu,et al.  G-ResNet: Improved ResNet for Brain Tumor Classification , 2019, ICONIP.

[23]  Gwanggil Jeon,et al.  A multifocus image fusion method by using hidden Markov model , 2013 .

[24]  El-Sayed M. El-Horbaty,et al.  Classification using deep learning neural networks for brain tumors , 2017, Future Computing and Informatics Journal.

[25]  N Kumaravel,et al.  A wavelet-based optimal texture feature set for classification of brain tumours , 2008, Journal of medical engineering & technology.

[26]  Mark Sandler,et al.  MobileNetV2: Inverted Residuals and Linear Bottlenecks , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[27]  Qianjin Feng,et al.  Enhanced Performance of Brain Tumor Classification via Tumor Region Augmentation and Partition , 2015, PloS one.

[28]  P. M. Siva Raja,et al.  Brain tumor classification using a hybrid deep autoencoder with Bayesian fuzzy clustering-based segmentation approach , 2020 .

[29]  Yang Gao,et al.  Content-based retrieval of brain tumor in contrast-enhanced MRI images using tumor margin information and learned distance metric. , 2012, Medical physics.

[30]  Sung Wook Baik,et al.  Multi-grade brain tumor classification using deep CNN with extensive data augmentation , 2019, J. Comput. Sci..

[31]  Gwanggil Jeon,et al.  CPS-based fully automatic cardiac left ventricle and left atrium segmentation in 3D MRI , 2019, J. Intell. Fuzzy Syst..

[32]  Qianjin Feng,et al.  D brain tumor segmentation in multimodal MR images based on earning population-and patient-specific feature sets , 2013 .

[33]  N. Zulpe,et al.  GLCM Textural Features for Brain Tumor Classification , 2012 .

[34]  Xiangyu Zhang,et al.  ShuffleNet V2: Practical Guidelines for Efficient CNN Architecture Design , 2018, ECCV.

[35]  Yohannes Yohannes,et al.  Brain Tumor Classification Using Gray Level Co-occurrence Matrix and Convolutional Neural Network , 2018, IJEIS (Indonesian Journal of Electronics and Instrumentation Systems).

[36]  Qianjin Feng,et al.  Semi-automatic Segmentation of Brain Tumors Using Population and Individual Information , 2012, Journal of Digital Imaging.

[37]  Moosa Ayati,et al.  Magnetic resonance imaging-based brain tumor grades classification and grading via convolutional neural networks and genetic algorithms , 2019, Biocybernetics and Biomedical Engineering.

[38]  Quoc V. Le,et al.  EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks , 2019, ICML.

[39]  Sunanda Das,et al.  Brain Tumor Classification Using Convolutional Neural Network , 2019, 2019 1st International Conference on Advances in Science, Engineering and Robotics Technology (ICASERT).