Convolutional Neural Network Approach to Classify Skin Lesions Using Reflectance Confocal Microscopy

We propose an approach based on a convolutional neural network to classify skin lesions using the reflectance confocal microscopy (RCM) mosaics. Skin cancers are the most common type of cancers and a correct, early diagnosis significantly lowers both morbidity and mortality. RCM is an in-vivo non-invasive screening tool that produces virtual biopsies of skin lesions but its proficient and safe use requires hard to obtain expertise. Therefore, it may be useful to have an additional tool to aid diagnosis. The proposed network is based on the ResNet architecture. The dataset consists of 429 RCM mosaics and is divided into 3 classes: melanoma, basal cell carcinoma, and benign naevi with the ground-truth confirmed by a histopathological examination. The test set classification accuracy was 87%, higher than the accuracy achieved by medical, confocal users. The results show that the proposed classification system can be a useful tool to aid in early, noninvasive melanoma detection.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Jean-Yves Tourneret,et al.  Statistical modeling and classification of reflectance confocal microscopy images , 2017, 2017 IEEE 7th International Workshop on Computational Advances in Multi-Sensor Adaptive Processing (CAMSAP).

[3]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[4]  K. S. Ravichandran,et al.  Novel Approaches for Diagnosing Melanoma Skin Lesions Through Supervised and Deep Learning Algorithms , 2016, Journal of Medical Systems.

[5]  C. Garbe,et al.  Epidemiology of skin cancer. , 2014, Advances in experimental medicine and biology.

[6]  LinLin Shen,et al.  Skin Lesion Analysis towards Melanoma Detection Using Deep Learning Network , 2017, Sensors.

[7]  Josep Malvehy,et al.  In vivo confocal reflectance microscopy in melanoma , 2012, Dermatologic therapy.

[8]  Jennifer G. Dy,et al.  A Multiresolution Convolutional Neural Network with Partial Label Training for Annotating Reflectance Confocal Microscopy Images of Skin , 2018, MICCAI.

[9]  John R. Smith,et al.  Deep Learning, Sparse Coding, and SVM for Melanoma Recognition in Dermoscopy Images , 2015, MLMI.

[10]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[11]  P. Boyle,et al.  Mortality from cutaneous melanoma: evidence for contrasting trends between populations , 2000, British Journal of Cancer.

[12]  A. Khachemoune,et al.  Squamous cell carcinoma of the skin: epidemiology, classification, management, and novel trends , 2015, International journal of dermatology.

[13]  A. Stratigos,et al.  Emerging trends in the epidemiology of melanoma , 2014, The British journal of dermatology.

[14]  Ronald M. Summers,et al.  Deep Convolutional Neural Networks for Computer-Aided Detection: CNN Architectures, Dataset Characteristics and Transfer Learning , 2016, IEEE Transactions on Medical Imaging.

[15]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[16]  Gabriela Oana Cula,et al.  Automatic Localization of Skin Layers in Reflectance Confocal Microscopy , 2014, ICIAR.

[17]  A. Marghoob,et al.  Skin Cancer Diagnosis With Reflectance Confocal Microscopy: Reproducibility of Feature Recognition and Accuracy of Diagnosis. , 2015, JAMA dermatology.

[18]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[19]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Jennifer G. Dy,et al.  A machine learning method for identifying morphological patterns in reflectance confocal microscopy mosaics of melanocytic skin lesions in-vivo , 2016, SPIE BiOS.

[21]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[23]  Kristin J. Dana,et al.  Hybrid deep learning for Reflectance Confocal Microscopy skin images , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[24]  J. Coebergh,et al.  Cutaneous malignant melanoma in Europe. , 2004, European journal of cancer.

[25]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[26]  R. Hofmann-Wellenhof,et al.  In vivo reflectance confocal microscopy: automated diagnostic image analysis of melanocytic skin tumours , 2011, Journal of the European Academy of Dermatology and Venereology : JEADV.

[27]  A. Jemal,et al.  Cancer surveillance series: changing patterns of cutaneous malignant melanoma mortality rates among whites in the United States. , 2000, Journal of the National Cancer Institute.

[28]  Jennifer G. Dy,et al.  Delineation of Skin Strata in Reflectance Confocal Microscopy Images with Recurrent Convolutional Networks , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[29]  Luca Antiga,et al.  Automatic differentiation in PyTorch , 2017 .