Deep convolutional neural network based medical image classification for disease diagnosis

Medical image classification plays an essential role in clinical treatment and teaching tasks. However, the traditional method has reached its ceiling on performance. Moreover, by using them, much time and effort need to be spent on extracting and selecting classification features. The deep neural network is an emerging machine learning method that has proven its potential for different classification tasks. Notably, the convolutional neural network dominates with the best results on varying image classification tasks. However, medical image datasets are hard to collect because it needs a lot of professional expertise to label them. Therefore, this paper researches how to apply the convolutional neural network (CNN) based algorithm on a chest X-ray dataset to classify pneumonia. Three techniques are evaluated through experiments. These are linear support vector machine classifier with local rotation and orientation free features, transfer learning on two convolutional neural network models: Visual Geometry Group i.e., VGG16 and InceptionV3, and a capsule network training from scratch. Data augmentation is a data preprocessing method applied to all three methods. The results of the experiments show that data augmentation generally is an effective way for all three algorithms to improve performance. Also, Transfer learning is a more useful classification method on a small dataset compared to a support vector machine with oriented fast and rotated binary (ORB) robust independent elementary features and capsule network. In transfer learning, retraining specific features on a new target dataset is essential to improve performance. And, the second important factor is a proper network complexity that matches the scale of the dataset.

[1]  Hayit Greenspan,et al.  GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification , 2018, Neurocomputing.

[2]  Bin Liang,et al.  Using Convolutional Neural Networks and Transfer Learning for Bone Age Classification , 2017, 2017 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[3]  Tülay Yildirim,et al.  Recognition of sign language using capsule networks , 2018, 2018 26th Signal Processing and Communications Applications Conference (SIU).

[4]  Antje Baer,et al.  Handbook Of Medical Image Processing And Analysis , 2016 .

[5]  Xiaojing Yuan,et al.  SVM-based Texture Classification and Application to Early Melanoma Detection , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[6]  Konstantinos N. Plataniotis,et al.  Brain Tumor Type Classification via Capsule Networks , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).

[7]  Yang Jin,et al.  Capsule Network Performance on Complex Data , 2017, ArXiv.

[8]  Xiaogang Wang,et al.  Medical image classification with convolutional neural network , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[9]  Shadi Albarqouni,et al.  Capsule Networks against Medical Imaging Data Challenges , 2018, CVII-STENT/LABELS@MICCAI.

[10]  N Ravia Shabnam Parveen,et al.  Detection of Pneumonia in chest X-ray images. , 2011, Journal of X-ray science and technology.

[11]  Hongwei Liu,et al.  Convolutional Neural Network With Data Augmentation for SAR Target Recognition , 2016, IEEE Geoscience and Remote Sensing Letters.

[12]  Konstantinos N. Plataniotis,et al.  Capsule Networks for Brain Tumor Classification Based on MRI Images and Coarse Tumor Boundaries , 2018, ICASSP 2019 - 2019 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[13]  A. Mueen M. Sapiyan Baba and R. Zainuddin Multilevel Feature Extraction and X-ray Image Classification , 2007 .

[14]  Fabio A. González,et al.  Histopathology Image Classification Using Bag of Features and Kernel Functions , 2009, AIME.

[15]  Robertas Alzbutas,et al.  Convolutional capsule network for classification of breast cancer histology images , 2018, ICIAR.

[16]  Vinicius Pavanelli Vianna Study and development of a Computer-Aided Diagnosis system for classification of chest x-ray images using convolutional neural networks pre-trained for ImageNet and data augmentation , 2018, ArXiv.

[17]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[18]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[19]  Luis Perez,et al.  The Effectiveness of Data Augmentation in Image Classification using Deep Learning , 2017, ArXiv.

[20]  Michael H. Goldbaum,et al.  Labeled Optical Coherence Tomography (OCT) and Chest X-Ray Images for Classification , 2018 .

[21]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[22]  Konstantinos N. Plataniotis,et al.  Capsule Networks’ Interpretability for Brain Tumor Classification Via Radiomics Analyses , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[23]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[24]  Cristina Nader Vasconcelos,et al.  Increasing Deep Learning Melanoma Classification by Classical And Expert Knowledge Based Image Transforms , 2017, ArXiv.

[25]  J. Carlin,et al.  Standardized interpretation of paediatric chest radiographs for the diagnosis of pneumonia in epidemiological studies. , 2005, Bulletin of the World Health Organization.

[26]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[27]  Gary R. Bradski,et al.  ORB: An efficient alternative to SIFT or SURF , 2011, 2011 International Conference on Computer Vision.

[28]  Hermann Ney,et al.  Classification of Medical Images Using local Representations , 2002, Bildverarbeitung für die Medizin.

[29]  Ronald M. Summers,et al.  TieNet: Text-Image Embedding Network for Common Thorax Disease Classification and Reporting in Chest X-Rays , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[30]  Daniel S. Kermany,et al.  Identifying Medical Diagnoses and Treatable Diseases by Image-Based Deep Learning , 2018, Cell.

[31]  Ronald M. Summers,et al.  ChestX-ray: Hospital-Scale Chest X-ray Database and Benchmarks on Weakly Supervised Classification and Localization of Common Thorax Diseases , 2019, Deep Learning and Convolutional Neural Networks for Medical Imaging and Clinical Informatics.