DSNet: Automatic Dermoscopic Skin Lesion Segmentation

BACKGROUND AND OBJECTIVE Automatic segmentation of skin lesions is considered a crucial step in Computer-aided Diagnosis (CAD) systems for melanoma detection. Despite its significance, skin lesion segmentation remains an unsolved challenge due to their variability in color, texture, and shapes and indistinguishable boundaries. METHODS Through this study, we present a new and automatic semantic segmentation network for robust skin lesion segmentation named Dermoscopic Skin Network (DSNet). In order to reduce the number of parameters to make the network lightweight, we used a depth-wise separable convolution in lieu of standard convolution to project the learned discriminating features onto the pixel space at different stages of the encoder. Additionally, we implemented both a U-Net and a Fully Convolutional Network (FCN8s) to compare against the proposed DSNet. RESULTS We evaluate our proposed model on two publicly available datasets, namely ISIC-20171 and PH22. The obtained mean Intersection over Union (mIoU) is 77.5% and 87.0% respectively for ISIC-2017 and PH2 datasets which outperformed the ISIC-2017 challenge winner by 1.0% with respect to mIoU. Our proposed network also outperformed U-Net and FCN8s respectively by 3.6% and 6.8% with respect to mIoU on the ISIC-2017 dataset. CONCLUSION Our network for skin lesion segmentation outperforms the other methods discussed in the article and is able to provide better-segmented masks on two different test datasets which can lead to better performance in melanoma detection. Our trained model along with the source code and predicted masks are made publicly available3.

[1]  Yang Li,et al.  Automatic segmentation of dermoscopy images using saliency combined with Otsu threshold , 2017, Comput. Biol. Medicine.

[2]  Pedro M. Ferreira,et al.  PH2 - A dermoscopic image database for research and benchmarking , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[3]  Feng Yang,et al.  A Multi-Stage Framework With Context Information Fusion Structure For Skin Lesion Segmentation , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[4]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[5]  Roberto Cipolla,et al.  SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  David Dagan Feng,et al.  Automatic Skin Lesion Analysis using Large-scale Dermoscopy Images and Deep Residual Networks , 2017, ArXiv.

[7]  Xinjian Chen,et al.  ASNet: An adaptive scale network for skin lesion segmentation in dermoscopy images , 2020, Medical Imaging: Biomedical Applications in Molecular, Structural, and Functional Imaging.

[8]  Tapani Raiko,et al.  Semi-supervised Learning with Ladder Networks , 2015, NIPS.

[9]  Saad Rehman,et al.  Convolutional neural network based image segmentation: a review , 2018, Defense + Security.

[10]  Jian Sun,et al.  Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classification , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[11]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[12]  Daniel Rueckert,et al.  Medical Image Computing and Computer-Assisted Intervention − MICCAI 2017: 20th International Conference, Quebec City, QC, Canada, September 11-13, 2017, Proceedings, Part II , 2017, Lecture Notes in Computer Science.

[13]  Dagan Feng,et al.  Improving Skin Lesion Segmentation via Stacked Adversarial Learning , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[14]  Yu Liu,et al.  A review of semantic segmentation using deep neural networks , 2017, International Journal of Multimedia Information Retrieval.

[15]  Rafael García,et al.  Computerized analysis of pigmented skin lesions: A review , 2012, Artif. Intell. Medicine.

[16]  Qiang Chen,et al.  Network In Network , 2013, ICLR.

[17]  Sheila MacNeil,et al.  State of the art in non‐invasive imaging of cutaneous melanoma , 2011, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[18]  Yixuan Yuan,et al.  Complementary Network with Adaptive Receptive Fields for Melanoma Segmentation , 2020, 2020 IEEE 17th International Symposium on Biomedical Imaging (ISBI).

[19]  Lukasz Kaiser,et al.  One Model To Learn Them All , 2017, ArXiv.

[20]  Rahil Garnavi,et al.  Skin Disease Recognition Using Deep Saliency Features and Multimodal Learning of Dermoscopy and Clinical Images , 2017, MICCAI.

[21]  Dagan Feng,et al.  Dermoscopic Image Segmentation via Multistage Fully Convolutional Networks , 2017, IEEE Transactions on Biomedical Engineering.

[22]  Rita Cucchiara,et al.  Comparison of color clustering algorithms for segmentation of dermatological images , 2006, SPIE Medical Imaging.

[23]  Tapani Raiko,et al.  Semi-supervised Learning with Ladder Networks , 2015, NIPS.

[24]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[25]  Qaisar Abbas,et al.  Unsupervised skin lesions border detection via two-dimensional image analysis , 2011, Comput. Methods Programs Biomed..

[26]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[27]  Vincent Dumoulin,et al.  Deconvolution and Checkerboard Artifacts , 2016 .

[28]  A. Jemal,et al.  Cancer statistics, 2020 , 2020, CA: a cancer journal for clinicians.

[29]  Hongdiao Wen,et al.  II-FCN for skin lesion analysis towards melanoma detection , 2017, ArXiv.

[30]  Ming Chao,et al.  Improving Dermoscopic Image Segmentation With Enhanced Convolutional-Deconvolutional Networks , 2017, IEEE Journal of Biomedical and Health Informatics.

[31]  José García Rodríguez,et al.  A survey on deep learning techniques for image and video semantic segmentation , 2018, Appl. Soft Comput..

[32]  Mun-Taek Choi,et al.  Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks , 2018, Comput. Methods Programs Biomed..

[33]  Xuelong Li,et al.  Mean shift based gradient vector flow for image segmentation , 2013, Comput. Vis. Image Underst..

[34]  Chunhua Shen,et al.  A Mutual Bootstrapping Model for Automated Skin Lesion Segmentation and Classification , 2020, IEEE Transactions on Medical Imaging.

[35]  Alauddin Bhuiyan,et al.  Automatic Segmentation of Dermoscopy Images Using Histogram Thresholding on Optimal Color Channels , 2011 .

[36]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[37]  Syamsiah Mashohor,et al.  Foundation and methodologies in computer-aided diagnosis systems for breast cancer detection , 2017, EXCLI journal.

[38]  João Paulo Papa,et al.  Computational methods for the image segmentation of pigmented skin lesions: A review , 2016, Comput. Methods Programs Biomed..

[39]  Matthew D. Zeiler.  ADADELTA: An Adaptive Learning Rate Method , 2012, ArXiv.

[40]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[41]  Yading Yuan,et al.  Improving Dermoscopic Image Segmentation With Enhanced Convolutional-Deconvolutional Networks , 2017, IEEE Journal of Biomedical and Health Informatics.

[42]  Petia Radeva,et al.  SLSDeep: Skin Lesion Segmentation Based on Dilated Residual and Pyramid Pooling Networks , 2018, MICCAI.

[43]  Fei-Fei Li,et al.  ImageNet: A large-scale hierarchical image database , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[44]  Feng Jiang,et al.  Decision-Augmented Generative Adversarial Network for Skin Lesion Segmentation , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[45]  Kemal Polat,et al.  OCE-NGC: A neutrosophic graph cut algorithm using optimized clustering estimation algorithm for dermoscopic skin lesion segmentation , 2020, Appl. Soft Comput..

[46]  H. Haenssle,et al.  Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists , 2018, Annals of oncology : official journal of the European Society for Medical Oncology.

[47]  A. El-Zaart.  Images thresholding using ISODATA technique with gamma distribution , 2010, Pattern Recognition and Image Analysis.

[48]  Pedro Assuncao,et al.  Dermoscopic skin lesion image segmentation based on Local Binary Pattern Clustering: Comparative study , 2020, Biomed. Signal Process. Control..

[49]  LinLin Shen,et al.  Skin Lesion Analysis towards Melanoma Detection Using Deep Learning Network , 2017, Sensors.

[50]  Hazim Kemal Ekenel,et al.  DermoNet: densely linked convolutional neural network for efficient skin lesion segmentation , 2019, EURASIP J. Image Video Process..

[51]  Richard K. G. Do,et al.  Convolutional neural networks: an overview and application in radiology , 2018, Insights into Imaging.

[52]  M. Emre Celebi,et al.  An Overview of Melanoma Detection in Dermoscopy Images Using Image Processing and Machine Learning , 2016, ArXiv.

[53]  Gerald Schaefer,et al.  Lesion border detection in dermoscopy images , 2009, Comput. Medical Imaging Graph..

[54]  Kunio Doi,et al.  Computer-aided diagnosis in medical imaging: Historical review, current status and future potential , 2007, Comput. Medical Imaging Graph..