Deep Learning, Sparse Coding, and SVM for Melanoma Recognition in Dermoscopy Images

This work presents an approach for melanoma recognition in dermoscopy images that combines deep learning, sparse coding, and support vector machine SVM learning algorithms. One of the beneficial aspects of the proposed approach is that unsupervised learning within the domain, and feature transfer from the domain of natural photographs, eliminates the need of annotated data in the target task to learn good features. The applied feature transfer also allows the system to draw analogies between observations in dermoscopic images and observations in the natural world, mimicking the process clinical experts themselves employ to describe patterns in skin lesions. To evaluate the methodology, performance is measured on a dataset obtained from the International Skin Imaging Collaboration, containing 2624 clinical cases of melanoma 334, atypical nevi 144, and benign lesions 2146. The approach is compared to the prior state-of-art method on this dataset. Two-fold cross-validation is performed 20 times for evaluation 40 total experiments, and two discrimination tasks are examined: 1 melanoma vs. all non-melanoma lesions, and 2 melanoma vs. atypical lesions only. The presented approach achieves an accuracy of 93.1% 94.9% sensitivity, and 92.8% specificity for the first task, and 73.9% accuracy 73.8% sensitivity, and 74.3% specificity for the second task. In comparison, prior state-of-art ensemble modeling approaches alone yield 91.2% accuracy 93.0% sensitivity, and 91.0% specificity first the first task, and 71.5% accuracy 72.7% sensitivity, and 68.9% specificity for the second. Differences in performance were statistically significant p $$<$$ 0.05, suggesting the proposed approach is an effective improvement over prior state-of-art.

[1]  R. Neves,et al.  Dermoscopy: the pattern analysis , 2006 .

[2]  John R. Kender,et al.  Separability and refinement of hierarchical semantic video labels and their ground truth , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[3]  Harald Ganster,et al.  Automated Melanoma Recognition , 2001, IEEE Trans. Medical Imaging.

[4]  P. Carli,et al.  Pattern analysis, not simplified algorithms, is the most reliable method for teaching dermoscopy for melanoma diagnosis to residents in dermatology , 2003, The British journal of dermatology.

[5]  Peter Aubusson,et al.  Metaphor and Analogy in Science Education , 2006 .

[6]  James Bailey,et al.  Computer-Aided Diagnosis of Melanoma Using Border- and Wavelet-Based Texture Analysis , 2012, IEEE Transactions on Information Technology in Biomedicine.

[7]  Pedro M. Ferreira,et al.  PH2 - A dermoscopic image database for research and benchmarking , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[8]  Liming Chen,et al.  Multi-scale Color Local Binary Patterns for Visual Object Classes Recognition , 2010, 2010 20th International Conference on Pattern Recognition.

[9]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[10]  Randy H. Moss,et al.  Automatic detection of blue-white veil and related structures in dermoscopy images , 2008, Comput. Medical Imaging Graph..

[11]  Sharath Pankanti,et al.  A generalized framework for medical image classification and recognition , 2015, IBM J. Res. Dev..

[12]  Darius Mehregan,et al.  Biopsies of nevi in children and adolescents in the United States, 2009 through 2013. , 2015, JAMA dermatology.

[13]  Jorge S. Marques,et al.  Two Systems for the Detection of Melanomas in Dermoscopy Images Using Texture and Color Features , 2014, IEEE Systems Journal.

[14]  Oliver Colot,et al.  A Colour Image Processing Model for Melanoma Detection , 1998, MICCAI.

[15]  Sharath Pankanti,et al.  Automated Medical Image Modality Recognition by Fusion of Visual and Text Information , 2014, MICCAI.

[16]  Ali Madooei,et al.  Automatic Detection of Blue-White Veil by Discrete Colour Matching in Dermoscopy Images , 2013, MICCAI.

[17]  J. Grob,et al.  First prospective study of the recognition process of melanoma in dermatological practice. , 2005, Archives of dermatology.

[18]  H. Kittler,et al.  Diagnostic accuracy of dermoscopy. , 2002, The Lancet. Oncology.

[19]  Jean Ponce,et al.  Sparse Modeling for Image and Vision Processing , 2014, Found. Trends Comput. Graph. Vis..

[20]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[21]  Abder-Rahman Ali,et al.  A systematic review of automated melanoma detection in dermatoscopic images and its ground truth data , 2012, Medical Imaging.

[22]  Harold S Rabinovitz,et al.  Dermoscopy of pigmented skin lesions. , 2005, Journal of the American Academy of Dermatology.