Robust application of new deep learning tools: an experimental study in medical imaging

Nowadays medical imaging plays a vital role in diagnosing the various types of diseases among patients across the healthcare system. Robust and accurate analysis of medical data is crucial to achieving a successful diagnosis from physicians. Traditional diagnostic methods are highly time-consuming and prone to handmade errors. Cost is reduced and performance is improved by adopting computer-aided diagnosis methods. Usually, the performance of traditional machine learning (ML) classification methods much depends on both feature extraction and selection methods that are sensitive to colors, shapes, and sizes, which conveys a complex solution when facing classification tasks in medical imaging. Currently, deep learning (DL) tools have become an alternative solution to overcome the drawbacks of traditional methods that make use of handmade features. In this paper, a new DL approach based on a hybrid deep convolutional neural network model is proposed for the automatic classification of several different types of medical images. Specifically, gradient vanishing and over-fitting issues have been properly addressed in the proposed model in order to improve its robustness by means of different tested techniques involving residual links, global average pooling layers, dropout layers, and data augmentation. Additionally, we employed the idea of parallel convolutional layers with the aim of achieving better feature representation by adopting different filter sizes on the same input and then concatenated as a result. The proposed model is trained and tested on the ICIAR 2018 dataset to classify hematoxylin and eosin-stained breast biopsy images into four categories: invasive carcinoma, in situ carcinoma, benign tumors, and normal tissue. As the experimental results show, our proposed method outperforms several of the state-of-the-art methods by achieving rate values of 93.2% and 89.8% for both image- and patch-wise image classification tasks, respectively. Moreover, we fine-tuned our model to classify foot images into two classes in order to test its robustness by considering normal and abnormal diabetic foot ulcer (DFU) image datasets. In this case, the model achieved an F1 score value of 94.80% on the public DFU dataset and 97.3% on the private DFU dataset. Lastly, transfer learning (TL) has been adopted to validate the proposed model with multiple classes with the aim of classifying six different wound types. This approach significantly improves the accuracy rate from a rate of 76.92% when trained from scratch to 87.94% when TL was considered. Our proposed model has proven its suitability and robustness by addressing several medical imaging tasks dealing with complex and challenging scenarios.

[1]  Jun Liu,et al.  Breast Cancer Histology Image Classification Based on Deep Neural Networks , 2018, ICIAR.

[2]  Mohammed A. Fadhel,et al.  Optimizing the Performance of Breast Cancer Classification by Employing the Same Domain Transfer Learning from Hybrid Deep Convolutional Neural Network Model , 2020, Electronics.

[3]  Amjad J. Humaidi,et al.  Review of deep learning: concepts, CNN architectures, challenges, applications, future directions , 2021, Journal of Big Data.

[4]  Mohammed A. Fadhel,et al.  Towards a Better Understanding of Transfer Learning for Medical Imaging: A Case Study , 2020, Applied Sciences.

[5]  Marek Kowal,et al.  Computer-aided diagnosis of breast cancer based on fine needle biopsy microscopic images , 2013, Comput. Biol. Medicine.

[6]  Roman Monczak,et al.  Computer-Aided Breast Cancer Diagnosis Based on the Analysis of Cytological Images of Fine Needle Biopsies , 2013, IEEE Transactions on Medical Imaging.

[7]  Xiaogang Wang,et al.  Residual Attention Network for Image Classification , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Andre Esteva,et al.  A guide to deep learning in healthcare , 2019, Nature Medicine.

[9]  Andrea Vedaldi,et al.  MatConvNet: Convolutional Neural Networks for MATLAB , 2014, ACM Multimedia.

[10]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[11]  Fabio A. González,et al.  Automatic detection of invasive ductal carcinoma in whole slide images with convolutional neural networks , 2014, Medical Imaging.

[12]  Jon Kleinberg,et al.  Transfusion: Understanding Transfer Learning for Medical Imaging , 2019, NeurIPS.

[13]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[14]  Xudong Jiang,et al.  Melanoma Recognition in Dermoscopy Images via Aggregated Deep Convolutional Features , 2019, IEEE Transactions on Biomedical Engineering.

[15]  Neil D. Reeves,et al.  DFUNet: Convolutional Neural Networks for Diabetic Foot Ulcer Classification , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[16]  Qiang Yu,et al.  Deep ensemble network based on multi-path fusion , 2019, Artificial Intelligence Review.

[17]  Yassine Ruichek,et al.  Survey on semantic segmentation using deep learning techniques , 2019, Neurocomputing.

[18]  May D. Wang,et al.  Histological image classification using biologically interpretable shape-based features , 2013, BMC Medical Imaging.

[19]  Catarina Eloy,et al.  Classification of breast cancer histology images using Convolutional Neural Networks , 2017, PloS one.

[20]  Catarina Eloy,et al.  BACH: Grand Challenge on Breast Cancer Histology Images , 2018, Medical Image Anal..

[21]  A. Jemal,et al.  Cancer statistics: Breast cancer in situ , 2015, CA: a cancer journal for clinicians.

[22]  Yu Li,et al.  Deep learning in bioinformatics: Introduction, application, and perspective in the big data era. , 2019, Methods.

[23]  Bo Wang,et al.  Weakly supervised mitosis detection in breast histopathology images using concentric loss , 2019, Medical Image Anal..

[24]  Raymond Y Huang,et al.  Artificial intelligence in cancer imaging: Clinical challenges and applications , 2019, CA: a cancer journal for clinicians.

[25]  Neil D. Reeves,et al.  Fully convolutional networks for diabetic foot ulcer segmentation , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[26]  Xiao Liu,et al.  Kernel Pooling for Convolutional Neural Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Luiz Eduardo Soares de Oliveira,et al.  Breast cancer histopathological image classification using Convolutional Neural Networks , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[28]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[29]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[30]  Hala H. Zayed,et al.  Remote Computer-Aided Breast Cancer Detection and Diagnosis System Based on Cytological Images , 2014, IEEE Systems Journal.

[31]  Bailing Zhang,et al.  Breast cancer diagnosis from biopsy images by serial fusion of Random Subspace ensembles , 2011, 2011 4th International Conference on Biomedical Engineering and Informatics (BMEI).

[32]  Anant Madabhushi,et al.  Automated grading of breast cancer histopathology using spectral clustering with textural and architectural image features , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[33]  Tara N. Sainath,et al.  Improving deep neural networks for LVCSR using rectified linear units and dropout , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[34]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[35]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[36]  A. Jemal,et al.  Breast cancer statistics, 2017, racial disparity in mortality by state , 2017, CA: a cancer journal for clinicians.

[37]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[38]  P. Hérent,et al.  Detection and characterization of MRI breast lesions using deep learning. , 2019, Diagnostic and interventional imaging.

[39]  Mita Nasipuri,et al.  Patch-based system for Classification of Breast Histology images using deep learning , 2019, Comput. Medical Imaging Graph..

[40]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  Marcel Salathé,et al.  Using Deep Learning for Image-Based Plant Disease Detection , 2016, Front. Plant Sci..

[42]  Dayong Wang,et al.  Deep Learning for Identifying Metastatic Breast Cancer , 2016, ArXiv.

[43]  C. M. Sujatha,et al.  Deep learning based diagnosis of Parkinson’s disease using convolutional neural network , 2019, Multimedia Tools and Applications.

[44]  Pedro Costa,et al.  Classification of Breast Cancer Histology Images Through Transfer Learning Using a Pre-trained Inception Resnet V2 , 2018, ICIAR.

[45]  A. Belsare,et al.  Classification of breast cancer histopathology images using texture feature analysis , 2015, TENCON 2015 - 2015 IEEE Region 10 Conference.

[46]  Omran Al-Shamma,et al.  DFU_QUTNet: diabetic foot ulcer classification using novel deep convolutional neural network , 2019, Multimedia Tools and Applications.

[47]  Nikos Komodakis,et al.  Wide Residual Networks , 2016, BMVC.

[48]  Nasir M. Rajpoot,et al.  Context-Aware Learning using Transferable Features for Classification of Breast Cancer Histology Images , 2018, ICIAR.

[49]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[50]  Asifullah Khan,et al.  A survey of the recent architectures of deep convolutional neural networks , 2019, Artificial Intelligence Review.

[51]  Mohammed A. Fadhel,et al.  Multi-class Breast Cancer Classification by a Novel Two-Branch Deep Convolutional Neural Network Architecture , 2019, 2019 12th International Conference on Developments in eSystems Engineering (DeSE).

[52]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[53]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[54]  Christian Riess,et al.  A Gentle Introduction to Deep Learning in Medical Image Processing , 2018, Zeitschrift fur medizinische Physik.

[55]  Eric P. Xing,et al.  Classification of Breast Cancer Histopathological Images using Convolutional Neural Networks with Hierarchical Loss and Global Pooling , 2018, ICIAR.

[56]  Adrien Depeursinge,et al.  Automated classification of brain tumor type in whole-slide digital pathology images using local representative tiles , 2016, Medical Image Anal..

[57]  Xiaohui Xie,et al.  Deep Learning Framework for Multi-class Breast Cancer Histology Image Classification , 2018, ICIAR.

[58]  Ali Tahir,et al.  Classification Of Breast Cancer Histology Images Using ALEXNET , 2018, ICIAR.

[59]  Amit Sethi,et al.  Classification of Breast Cancer Histology using Deep Learning , 2018, ICIAR.

[60]  Lipo Wang,et al.  Deep Learning Applications in Medical Image Analysis , 2018, IEEE Access.

[61]  Mohammed A. Fadhel,et al.  Deep Learning Models for Classification of Red Blood Cells in Microscopy Images to Aid in Sickle Cell Anemia Diagnosis , 2020, Electronics.

[62]  Kevin A. Schneider,et al.  Breast Cancer Diagnosis with Transfer Learning and Global Pooling , 2019, 2019 International Conference on Information and Communication Technology Convergence (ICTC).