Assisted deep learning framework for multi-class skin lesion classification considering a binary classification support

Abstract In this paper, we propose a deep convolutional neural network framework to classify dermoscopy images into seven classes. With taking the advantage that these classes can be merged into two (healthy/diseased) ones we can train a part of the network regarding this binary task only. Then, the confidences regarding the binary classification are used to tune the multi-class confidence values provided by the other part of the network, since the binary task can be solved more accurately. For both the classification tasks we used GoogLeNet Inception-v3, however, any CNN architectures could be applied for these purposes. The whole network is trained in the usual way, and as our experimental results on the skin lesion image classification show, the accuracy of the multi-class problem has been remarkably raised (by 7% considering the balanced multi-class accuracy) via embedding the more reliable binary classification outcomes.

[1]  Taghi M. Khoshgoftaar,et al.  A survey on Image Data Augmentation for Deep Learning , 2019, Journal of Big Data.

[2]  Jorge S. Marques,et al.  A Survey of Feature Extraction in Dermoscopy Image Analysis of Skin Cancer , 2019, IEEE Journal of Biomedical and Health Informatics.

[3]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[4]  Jorge S. Marques,et al.  Dermoscopy Image Analysis , 2015 .

[5]  Balázs Harangi,et al.  Skin lesion detection based on an ensemble of deep convolutional neural network , 2017, J. Biomed. Informatics.

[6]  J. Ross Quinlan,et al.  Induction of Decision Trees , 1986, Machine Learning.

[7]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[8]  Harald Kittler,et al.  Descriptor : The HAM 10000 dataset , a large collection of multi-source dermatoscopic images of common pigmented skin lesions , 2018 .

[9]  Wei Zhang,et al.  Emotion recognition by assisted learning with convolutional neural networks , 2018, Neurocomputing.

[10]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  R. Hofmann-Wellenhof,et al.  Comparison of the accuracy of human readers versus machine-learning algorithms for pigmented skin lesion classification: an open, web-based, international, diagnostic study. , 2019, The Lancet. Oncology.

[12]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).