From Deep Learning Towards Finding Skin Lesion Biomarkers

Melanoma is a type of skin cancer with the most rapidly increasing incidence. Early detection of melanoma using dermoscopy images significantly increases patients’ survival rate. However, accurately classifying skin lesions by eye, especially in the early stage of melanoma, is extremely challenging for the dermatologists. Hence, the discovery of reliable biomarkers will be meaningful for melanoma diagnosis. In recent years, the value of deep learning empowered computerassisted diagnose has been shown in biomedical imaging-based decision making. However, much deep learning research focuses on improving disease detection accuracy but not understanding the features deep learning use to determine the evidence of pathology. We aim to make sure the features used by deep learning methods are the reasonable clinical features for skin lesions diagnosis, rather than artifacts. Further, we aim to discover new biomarkers, which may not have been included in clinical criteria but do make sense to the dermatologists. Our proposed pipeline can find biomarkers for identifying different lesions. The patterns are agreed with dermatologists. Surprisingly, we find surround skins also can be used as evidence for skin lesion diagnosis, which has not been included in traditional diagnosis rules. The biomarkers discovered from deep learning classifier can be significant and useful to guide clinical diagnosis.

[1]  Avanti Shrikumar,et al.  Learning Important Features Through Propagating Activation Differences , 2017, ICML.

[2]  M. Binder,et al.  Epiluminescence microscopy. A useful tool for the diagnosis of pigmented skin lesions for formally trained dermatologists. , 1995, Archives of dermatology.

[3]  Michael S. Bernstein,et al.  Scalable multi-label annotation , 2014, CHI.

[4]  Paul L. Rosin,et al.  Clinical Skin Lesion Diagnosis Using Representations Inspired by Dermatologist Criteria , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[5]  J. Emery,et al.  Using the 7-point checklist as a diagnostic aid for pigmented skin lesions in general practice: a diagnostic validation study. , 2013, The British journal of general practice : the journal of the Royal College of General Practitioners.

[6]  Harald Kittler,et al.  Descriptor : The HAM 10000 dataset , a large collection of multi-source dermatoscopic images of common pigmented skin lesions , 2018 .

[7]  David Polsky,et al.  Early diagnosis of cutaneous melanoma: revisiting the ABCD criteria. , 2004, JAMA.

[8]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[9]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Ankur Taly,et al.  Axiomatic Attribution for Deep Networks , 2017, ICML.

[11]  Juntang Zhuang,et al.  Brain Biomarker Interpretation in ASD Using Deep Learning and fMRI , 2018, MICCAI.

[12]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[13]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[14]  Peter Trovitch,et al.  Early detection and treatment of skin cancer , 2002 .

[15]  Carlos Guestrin,et al.  "Why Should I Trust You?": Explaining the Predictions of Any Classifier , 2016, ArXiv.

[16]  Tie-Yan Liu,et al.  LightGBM: A Highly Efficient Gradient Boosting Decision Tree , 2017, NIPS.

[17]  Max Welling,et al.  Visualizing Deep Neural Network Decisions: Prediction Difference Analysis , 2017, ICLR.