Classification of Brain Tumor Leveraging Goal-Driven Visual Attention with the Support of Transfer Learning

The task of distinguishing types of tumors in brain MRI scans is of paramount importance in the medical field. In the recent years, deep learning methods have produced leaps of advancements, especially in the field of computer vision, which allowed to address important challenges such as image classification in the medical field. The rise of convolutional neural networks brought about the achievement of new heights in many tasks, include medical image analysis. They produced very good results in terms of accuracy and performances, by recognizing repeating patterns and shapes in a image, they still fall short of taking advantage of spatial information. As inspiration was also taken from natural visual system, concepts visual attention have also inspired architectural advancements that yielded higher performance in computer vision tasks. Visual attention allows to differentiate relevant areas of a picture for improved recognition abilities. In this paper, we propose using a pre-trained attention mechanism for the task of brain tumor classification. We counter-intuitively use transfer learning on a specific, restricted dataset for the goal of finding relevant areas of brain tumors. This goal-oriented attention mechanism used in a general convolutional-based architecture allowed us to achieve state of the art classification performance on a brain tumor dataset.

[1]  Sreedhar Kollem,et al.  A Review of Image Denoising and Segmentation Methods Based on Medical Images , 2019, International Journal of Machine Learning and Computing.

[2]  Bolei Zhou,et al.  Learning Deep Features for Discriminative Localization , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Kittisak Kerdprasop,et al.  Dermatological Classification Using Deep Learning of Skin Image and Patient Background Knowledge , 2019 .

[4]  Wei Cao,et al.  Deep Learning based Radiomics (DLR) and its usage in noninvasive IDH1 prediction for low grade glioma , 2017, Scientific Reports.

[5]  Wei Huang,et al.  Medical media analytics via ranking and big learning: A multi-modality image-based disease severity prediction study , 2016, Neurocomputing.

[6]  Qianjin Feng,et al.  Retrieval of Brain Tumors by Adaptive Spatial Pooling and Fisher Vector Representation , 2016, PloS one.

[7]  Kun Zhao,et al.  Attention-based 3D Convolutional Network for Alzheimer’s Disease Diagnosis and Biomarkers Exploration , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[8]  Davut Hanbay,et al.  Deep learning based brain tumor classification and detection system , 2018, Turkish J. Electr. Eng. Comput. Sci..

[9]  Qianjin Feng,et al.  Enhanced Performance of Brain Tumor Classification via Tumor Region Augmentation and Partition , 2015, PloS one.

[10]  Jeremy M Wolfe,et al.  Visual Attention , 2020, Computational Models for Cognitive Vision.

[11]  Andriy Fedorov,et al.  Computational Radiomics System to Decode the Radiographic Phenotype. , 2017, Cancer research.

[12]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[13]  Daniel Fabbri,et al.  Deep learning for brain tumor classification , 2017, Medical Imaging.

[14]  Konstantinos N. Plataniotis,et al.  Capsule Networks for Brain Tumor Classification Based on MRI Images and Coarse Tumor Boundaries , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[15]  Cynthia Rudin,et al.  Stop explaining black box machine learning models for high stakes decisions and use interpretable models instead , 2018, Nature Machine Intelligence.

[16]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[17]  Ron Kikinis,et al.  Statistical validation of image segmentation quality based on a spatial overlap index. , 2004, Academic radiology.

[18]  Julie Ann A. Salido,et al.  Using Deep Learning for Melanoma Detection in Dermoscopy Images , 2018 .

[19]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[20]  Allen Allport,et al.  Visual attention , 1989 .