Seven-Point Checklist with Convolutional Neural Networks for Melanoma Diagnosis

Reliable skin lesion detection is an important pre-requisite for melanoma and other skin diseases diagnosis. Existing melanoma assessment models consider either pattern analysis methods or seven-point checklist criteria to investigate skin lesion. However, automatic and accurate detection of the skin lesion and subsequently melanoma diagnosis remain an unresolved challenge. Furthermore, there is limitations in both approaches and a trade-off between the two assessment strategies. This paper proposes a pattern analysis method incorporated with seven-point checklist exploiting convolutional neural network for melanoma diagnosis where the lesion features are extracted automatically. The benefit of features learned automatically from the dermoscopic images through the stacked layers of convolution filters have been designed, realised and evaluated. Both clinical and dermoscopic images have been considered as input to the developed multiple-input convolutional neural networks (CNNs) where a separate feature extraction model is implemented for each image type. The features produced from both models are concatenated for interpretation and final lesion type prediction. The sum of the weight for predicated lesions which are calculated according seven-points check list criteria are then passed into a threshold model to decide whether the image normal or abnormal (melanoma or non-melanoma). Performance of the developed algorithm is assessed using a dataset of 2000 dermoscopic images. The initial results obtained from the proposed system show a convincing and promising ability for lesion detection and automated melanoma diagnosis from dermoscopy images.

[1]  G. Argenziano,et al.  Epiluminescence microscopy for the diagnosis of doubtful melanocytic skin lesions. Comparison of the ABCD rule of dermatoscopy and a new 7-point checklist based on pattern analysis. , 1998, Archives of dermatology.

[2]  Antonio Pietrosanto,et al.  Automatic Diagnosis of Melanoma Based on the 7-Point Checklist , 2014 .

[3]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[4]  Ghassan Hamarneh,et al.  Seven-Point Checklist and Skin Lesion Classification Using Multitask Multimodal Neural Nets , 2019, IEEE Journal of Biomedical and Health Informatics.

[5]  Ali Madooei,et al.  Automatic Detection of Blue-White Veil by Discrete Colour Matching in Dermoscopy Images , 2013, MICCAI.

[6]  John R. Smith,et al.  Deep Learning, Sparse Coding, and SVM for Melanoma Recognition in Dermoscopy Images , 2015, MLMI.

[7]  H. Haenssle,et al.  Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists , 2018, Annals of oncology : official journal of the European Society for Medical Oncology.

[8]  P. Hwu,et al.  Prognostic factors for survival in melanoma patients with brain metastases , 2011, Cancer.

[9]  M. G. Fleming,et al.  Dermoscopy of pigmented skin lesions: results of a consensus meeting via the Internet. , 2003, Journal of the American Academy of Dermatology.

[10]  P. Carli,et al.  Pattern analysis, not simplified algorithms, is the most reliable method for teaching dermoscopy for melanoma diagnosis to residents in dermatology , 2003, The British journal of dermatology.

[11]  S. Han,et al.  Classification of the Clinical Images for Benign and Malignant Cutaneous Tumors Using a Deep Learning Algorithm. , 2018, The Journal of investigative dermatology.

[12]  Sharath Pankanti,et al.  Deep learning ensembles for melanoma recognition in dermoscopy images , 2016, IBM J. Res. Dev..

[13]  Ghassan Hamarneh,et al.  Deep features to classify skin lesions , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[14]  Jian Zhi Hu,et al.  Studies of Secondary Melanoma on C57BL/6J Mouse Liver Using 1H NMR Metabolomics , 2013, Metabolites.

[15]  E. Feuer,et al.  SEER Cancer Statistics Review, 1975-2003 , 2006 .

[16]  Rui Hu,et al.  Implementation of the 7-point checklist for melanoma detection on smart handheld devices , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[17]  I. Zalaudek,et al.  Seven‐point checklist of dermoscopy revisited , 2011, The British journal of dermatology.

[18]  Harold S Rabinovitz,et al.  Dermoscopy of pigmented skin lesions. , 2005, Journal of the American Academy of Dermatology.

[19]  W. Stolz,et al.  The ABCD rule of dermatoscopy. High prospective value in the diagnosis of doubtful melanocytic skin lesions. , 1994, Journal of the American Academy of Dermatology.

[20]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[21]  Ghassan Hamarneh,et al.  Learning features for streak detection in dermoscopic color images using localized radial flux of principal intensity curvature , 2012, 2012 IEEE Workshop on Mathematical Methods in Biomedical Image Analysis.

[22]  Malrey Lee,et al.  The skin cancer classification using deep convolutional neural network , 2018, Multimedia Tools and Applications.