Skin Lesions Classification Using Deep Learning Based on Dilated Convolution

The prediction of skin lesions is a challenging task even for experienced dermatologists due to a little contrast between surrounding skin and lesions, the visual resemblance between skin lesions, fuddled lesion border, etc. An automated computer-aided detection system with given images can help clinicians to prognosis malignant skin lesions at the earliest time. Recent progress in deep learning includes dilated convolution known to have improved accuracy with the same amount of computational complexities compared to traditional CNN. To implement dilated convolution, we choose the transfer learning with four popular architectures: VGG16, VGG19, MobileNet, and InceptionV3. The HAM10000 dataset was utilized for training, validating, and testing, which contains a total of 10015 dermoscopic images of seven skin lesion classes with huge class imbalances. The top-1 accuracy achieved on dilated versions of VGG16, VGG19, MobileNet, and InceptionV3 is 87.42%, 85.02%, 88.22%, and 89.81%, respectively. Dilated InceptionV3 exhibited the highest classification accuracy, recall, precision, and f-1 score and dilated MobileNet also has high classification accuracy while having the lightest computational complexities. Dilated InceptionV3 achieved better overall and per-class accuracy than any known methods on skin lesions classification to the best of our knowledge while experimenting with a complex open-source dataset with class imbalances.

[1]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[2]  Xue-wen Chen,et al.  Big Data Deep Learning: Challenges and Perspectives , 2014, IEEE Access.

[3]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[4]  A. Blum,et al.  Pattern analysis, not simplified algorithms, is the most reliable method for teaching dermoscopy for melanoma diagnosis to residents in dermatology , 2004, The British journal of dermatology.

[5]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[6]  Vladlen Koltun,et al.  Multi-Scale Context Aggregation by Dilated Convolutions , 2015, ICLR.

[7]  Harald Kittler,et al.  Descriptor : The HAM 10000 dataset , a large collection of multi-source dermatoscopic images of common pigmented skin lesions , 2018 .

[8]  Z. She,et al.  Combination of features from skin pattern and ABCD analysis for lesion classification , 2007, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[9]  Balázs Harangi,et al.  Skin lesion detection based on an ensemble of deep convolutional neural network , 2017, J. Biomed. Informatics.

[10]  Lars Kai Hansen,et al.  Detection of skin cancer by classification of Raman spectra , 2004, IEEE Transactions on Biomedical Engineering.

[11]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[12]  Jorge S. Marques,et al.  Two Systems for the Detection of Melanomas in Dermoscopy Images Using Texture and Color Features , 2014, IEEE Systems Journal.

[13]  P. Sparén,et al.  Clinical and histopathologic predictors of survival in patients with malignant melanoma: a population-based study in Sweden. , 1994, Journal of the National Cancer Institute.

[14]  Michael R Hamblin,et al.  CA : A Cancer Journal for Clinicians , 2011 .

[15]  I Zalaudek,et al.  Meta‐analysis of digital dermoscopy follow‐up of melanocytic skin lesions: a study on behalf of the International Dermoscopy Society , 2013, Journal of the European Academy of Dermatology and Venereology : JEADV.

[16]  Gerald Schaefer,et al.  Lesion border detection in dermoscopy images , 2009, Comput. Medical Imaging Graph..

[17]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[18]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[19]  Bo Chen,et al.  MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications , 2017, ArXiv.

[20]  George Papandreou,et al.  Rethinking Atrous Convolution for Semantic Image Segmentation , 2017, ArXiv.

[21]  Michael J. Black,et al.  Optical Flow with Semantic Segmentation and Localized Layers , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  A. Ormerod,et al.  Systematic review of dermoscopy and digital dermoscopy/ artificial intelligence for the diagnosis of melanoma , 2009, The British journal of dermatology.

[23]  Gerald Schaefer,et al.  Lesion Border Detection in Dermoscopy Images Using Ensembles of Thresholding Methods , 2013, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[24]  Yi Li,et al.  Instance-Sensitive Fully Convolutional Networks , 2016, ECCV.

[25]  Sharath Pankanti,et al.  Deep learning ensembles for melanoma recognition in dermoscopy images , 2016, IBM J. Res. Dev..

[26]  Ghassan Hamarneh,et al.  Deep features to classify skin lesions , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[27]  Demetri Terzopoulos,et al.  Image Analysis Using Multigrid Relaxation Methods , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Yading Yuan,et al.  Automatic Skin Lesion Segmentation Using Deep Fully Convolutional Networks With Jaccard Distance , 2017, IEEE Transactions on Medical Imaging.

[29]  Garrison W. Cottrell,et al.  Understanding Convolution for Semantic Segmentation , 2017, 2018 IEEE Winter Conference on Applications of Computer Vision (WACV).

[30]  Richard Kronland-Martinet,et al.  A real-time algorithm for signal analysis with the help of the wavelet transform , 1989 .

[31]  Saket S. Chaturvedi,et al.  Skin Lesion Analyser: An Efficient Seven-Way Multi-Class Skin Cancer Classification Using MobileNet , 2019, Advances in Intelligent Systems and Computing.

[32]  A. Jemal,et al.  Cancer statistics, 2015 , 2015, CA: a cancer journal for clinicians.

[33]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[34]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[35]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[36]  Alan C. Bovik,et al.  Automatic segmentation of dermoscopy images using self-generating neural networks seeded by genetic algorithm , 2013, Pattern Recognit..

[37]  William L. Briggs,et al.  A multigrid tutorial, Second Edition , 2000 .

[38]  Heiga Zen,et al.  WaveNet: A Generative Model for Raw Audio , 2016, SSW.

[39]  M. G. Fleming,et al.  Dermoscopy of pigmented skin lesions: results of a consensus meeting via the Internet. , 2003, Journal of the American Academy of Dermatology.

[40]  Wei Xu,et al.  ABC-CNN: An Attention Based Convolutional Neural Network for Visual Question Answering , 2015, ArXiv.

[41]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[42]  M. Binder,et al.  Epiluminescence microscopy. A useful tool for the diagnosis of pigmented skin lesions for formally trained dermatologists. , 1995, Archives of dermatology.

[43]  Tim Holland-Letz,et al.  Pathologist-level classification of histopathological melanoma images with deep neural networks. , 2019, European journal of cancer.

[44]  A. B. Shamardan,et al.  Multi-level adaptive solutions to initial-value problems , 2000 .

[45]  Pierluigi Carcagnì,et al.  Classification of Skin Lesions by Combining Multilevel Learnings in a DenseNet Architecture , 2019, ICIAP.

[46]  Huiyu Zhou,et al.  A State-of-the-Art Survey on Lesion Border Detection in Dermoscopy Images , 2015 .

[47]  H. Kittler,et al.  Diagnostic accuracy of dermoscopy. , 2002, The Lancet. Oncology.

[48]  Robin Marks,et al.  An overview of skin cancers , 1995, Cancer.

[49]  S. Feldman,et al.  Incidence Estimate of Nonmelanoma Skin Cancer (Keratinocyte Carcinomas) in the U.S. Population, 2012. , 2015, JAMA dermatology.

[50]  Mohammad Aldeen,et al.  Border detection in dermoscopy images using hybrid thresholding on optimized color channels , 2011, Comput. Medical Imaging Graph..

[51]  Junji Maeda,et al.  Comparison of Segmentation Methods for Melanoma Diagnosis in Dermoscopy Images , 2009, IEEE Journal of Selected Topics in Signal Processing.

[52]  Constantine Butakoff,et al.  Independent Histogram Pursuit for Segmentation of Skin Lesions , 2008, IEEE Transactions on Biomedical Engineering.

[53]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[54]  Rafael García,et al.  Computerized analysis of pigmented skin lesions: A review , 2012, Artif. Intell. Medicine.

[55]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[56]  M. Bosenberg,et al.  Melanocytic nevi and melanoma: unraveling a complex relationship , 2017, Oncogene.

[57]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[58]  John R. Smith,et al.  Deep Learning, Sparse Coding, and SVM for Melanoma Recognition in Dermoscopy Images , 2015, MLMI.

[59]  J. Grob,et al.  First prospective study of the recognition process of melanoma in dermatological practice. , 2005, Archives of dermatology.

[60]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[61]  Yi Li,et al.  R-FCN: Object Detection via Region-based Fully Convolutional Networks , 2016, NIPS.

[62]  Sumul Ashok Gandhi,et al.  Skin Cancer Epidemiology, Detection, and Management. , 2015, The Medical clinics of North America.

[63]  Martin A Weinstock,et al.  Non-melanoma skin cancer incidence and impact of skin cancer screening on incidence. , 2014, The Journal of investigative dermatology.

[64]  Petros Maragos,et al.  Multigrid Geometric Active Contour Models , 2007, IEEE Transactions on Image Processing.