Generative adversarial networks to segment skin lesions

The accuracy of skin lesion segmentation has increased in recent years, thanks to advances in machine learning techniques and a large influx of dermoscopy images. However, there is still room for improvement as there exist many considerable challenges mainly due to the large variability in the appearance of lesions (i.e., shape, size, texture, and occlusions). In this work, we present a novel approach for skin lesion segmentation through leveraging generative adversarial networks. Our approach consists of two models: a fully convolutional neural network designed to synthesize an accurate skin lesion segmentation mask (the segmenter), and a convolutional neural network that distinguishes between synthetic and real segmentation masks (the critic). Our experimental results on 1300 images from the DermoFit dataset show that incorporating a critic network to complement a fully convolutional segmenter, like UNet, increases segmentation accuracy.

[1]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[2]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[3]  Yading Yuan,et al.  Automatic Skin Lesion Segmentation Using Deep Fully Convolutional Networks With Jaccard Distance , 2017, IEEE Transactions on Medical Imaging.

[4]  A Noble,et al.  Depth Data Improves Skin Lesion Segmentation , 2009 .

[5]  Mohammad H. Jafari,et al.  Skin lesion segmentation in clinical images using deep learning , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[6]  Junting Pan,et al.  SalGAN: visual saliency prediction with adversarial networks , 2017 .

[7]  Camille Couprie,et al.  Semantic Segmentation using Adversarial Networks , 2016, NIPS 2016.

[8]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[9]  Lisa Tang,et al.  Simulation of Ground-Truth Validation Data Via Physically- and Statistically-Based Warps , 2008, MICCAI.

[10]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[11]  Yoshua Bengio,et al.  Generative Adversarial Nets , 2014, NIPS.

[12]  Mitko Veta,et al.  Adversarial Training and Dilated Convolutions for Brain MRI Segmentation , 2017, DLMIA/ML-CDS@MICCAI.

[13]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[14]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Xiang Li,et al.  Depth Data Improves Skin Lesion Segmentation , 2009, MICCAI.

[16]  A. Jemal,et al.  Cancer statistics, 2017 , 2017, CA: a cancer journal for clinicians.

[17]  Colin Raffel,et al.  Lasagne: First release. , 2015 .

[18]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[19]  Klaus H. Maier-Hein,et al.  Adversarial Networks for the Detection of Aggressive Prostate Cancer , 2017, ArXiv.

[20]  Robert B. Fisher,et al.  A Color and Texture Based Hierarchical K-NN Approach to the Classification of Non-melanoma Skin Lesions , 2013 .