Skin Lesion Segmentation in Dermoscopic Images With Ensemble Deep Learning Methods

Early detection of skin cancer, particularly melanoma, is crucial to enable advanced treatment. Due to the rapid growth in the number of skin cancers, there is a growing need of computerised analysis for skin lesions. The state-of-the-art public available datasets for skin lesions are often accompanied with a very limited amount of segmentation ground truth labeling. Also, the available segmentation datasets consist of noisy expert annotations reflecting the fact that precise annotations to represent the boundary of skin lesions are laborious and expensive. The lesion boundary segmentation is vital to locate the lesion accurately in dermoscopic images and lesion diagnosis of different skin lesion types. In this work, we propose the fully automated deep learning ensemble methods to achieve high sensitivity and high specificity in lesion boundary segmentation. We trained the ensemble methods based on Mask R-CNN and DeeplabV3+ methods on ISIC-2017 segmentation training set and evaluate the performance of the ensemble networks on ISIC-2017 testing set and PH2 dataset. Our results showed that the proposed ensemble methods segmented the skin lesions with Sensitivity of 89.93% and Specificity of 97.94% for the ISIC-2017 testing set. The proposed ensemble method Ensemble-A outperformed FrCN, FCNs, U-Net, and SegNet in Sensitivity by 4.4%, 8.8%, 22.7%, and 9.8% respectively. Furthermore, the proposed ensemble method Ensemble-S achieved a specificity score of 97.98% for clinically benign cases, 97.30% for the melanoma cases, and 98.58% for the seborrhoeic keratosis cases on ISIC-2017 testing set, exhibiting better performance than FrCN, FCNs, U-Net, and SegNet.

[1]  Antonio Criminisi,et al.  Segmentation of Brain Tumor Tissues with Convolutional Neural Networks , 2014 .

[2]  Manu Goyal,et al.  The effect of color constancy algorithms on semantic segmentation of skin lesions , 2019, Medical Imaging.

[3]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[4]  Jorge S. Marques,et al.  A Survey of Feature Extraction in Dermoscopy Image Analysis of Skin Cancer , 2019, IEEE Journal of Biomedical and Health Informatics.

[5]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Neil D. Reeves,et al.  DFUNet: Convolutional Neural Networks for Diabetic Foot Ulcer Classification , 2017, IEEE Transactions on Emerging Topics in Computational Intelligence.

[7]  Danail Stoyanov,et al.  OR 2.0 Context-Aware Operating Theaters, Computer Assisted Robotic Endoscopy, Clinical Image-Based Procedures, and Skin Image Analysis , 2018, Lecture Notes in Computer Science.

[8]  David Polsky,et al.  Early diagnosis of cutaneous melanoma: revisiting the ABCD criteria. , 2004, JAMA.

[9]  Giovanni Pellacani,et al.  Comparison between morphological parameters in pigmented skin lesion images acquired by means of epiluminescence surface microscopy and polarized-light videomicroscopy. , 2002, Clinics in dermatology.

[10]  Rafael García,et al.  Computerized analysis of pigmented skin lesions: A review , 2012, Artif. Intell. Medicine.

[11]  Walid Barhoumi,et al.  An image-based segmentation recommender using crowdsourcing and transfer learning for skin lesion extraction , 2019, Expert Syst. Appl..

[12]  Neil D. Reeves,et al.  Fully convolutional networks for diabetic foot ulcer segmentation , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[13]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Robust Semantic Pixel-Wise Labelling , 2015, CVPR 2015.

[14]  Pietro Perona,et al.  Microsoft COCO: Common Objects in Context , 2014, ECCV.

[15]  David M. W. Powers,et al.  Evaluation: from precision, recall and F-measure to ROC, informedness, markedness and correlation , 2011, ArXiv.

[16]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[18]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[19]  Reyer Zwiggelaar,et al.  Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[20]  Yading Yuan,et al.  Automatic Skin Lesion Segmentation Using Deep Fully Convolutional Networks With Jaccard Distance , 2017, IEEE Transactions on Medical Imaging.

[21]  Yanhui Guo,et al.  A novel optimized neutrosophic k-means using genetic algorithm for skin lesion detection in dermoscopy images , 2018, Signal Image Video Process..

[22]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[23]  Manu Goyal,et al.  Multi-class Semantic Segmentation of Skin Lesions via Fully Convolutional Networks , 2017, BIOINFORMATICS.

[24]  Yanhui Guo,et al.  A hybrid dermoscopy images segmentation approach based on neutrosophic clustering and histogram estimation , 2018, Appl. Soft Comput..

[25]  Luc Van Gool,et al.  The Pascal Visual Object Classes (VOC) Challenge , 2010, International Journal of Computer Vision.

[26]  Gerald Schaefer,et al.  Lesion border detection in dermoscopy images , 2009, Comput. Medical Imaging Graph..

[27]  J. Mayer,et al.  Systematic review of the diagnostic accuracy of dermatoscopy in detecting malignant melanoma , 1997, The Medical journal of Australia.

[28]  Dagan Feng,et al.  Dermoscopic Image Segmentation via Multistage Fully Convolutional Networks , 2017, IEEE Transactions on Biomedical Engineering.

[29]  Graham D. Finlayson,et al.  Shades of Gray and Colour Constancy , 2004, CIC.

[30]  M. Emre Celebi,et al.  Dermoscopy Image Analysis: Overview and Future Directions , 2019, IEEE Journal of Biomedical and Health Informatics.

[31]  Andreas K. Maier,et al.  A Multi-task Framework for Skin Lesion Detection and Segmentation , 2018, OR 2.0/CARE/CLIP/ISIC@MICCAI.

[32]  Pedro M. Ferreira,et al.  PH2 - A dermoscopic image database for research and benchmarking , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[33]  P. C. Siddalingaswamy,et al.  Techniques and algorithms for computer aided diagnosis of pigmented skin lesions - A review , 2018, Biomed. Signal Process. Control..

[34]  Shuiwang Ji,et al.  Deep convolutional neural networks for multi-modality isointense infant brain image segmentation , 2015, NeuroImage.

[35]  Paul Nghiem,et al.  Interactive Atlas of Dermoscopy , 2004 .

[36]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Harald Kittler,et al.  Descriptor : The HAM 10000 dataset , a large collection of multi-source dermatoscopic images of common pigmented skin lesions , 2018 .

[38]  Mun-Taek Choi,et al.  Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks , 2018, Comput. Methods Programs Biomed..

[39]  Victor Alves,et al.  Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images , 2016, IEEE Transactions on Medical Imaging.

[40]  Manu Goyal,et al.  Skin lesion boundary segmentation with fully automated deep extreme cut methods , 2019, Medical Imaging.