Experiments using deep learning for dermoscopy image analysis

Abstract Skin cancer is a major public health problem, as is the most common type of cancer and represents more than half of cancer diagnosed worldwide. Early detection influences the outcome of the disease and motivates the research presented in this paper. Recent results show that deep learning based approaches learn from data, and can outperform human specialists in a set of tasks when large databases are available for training. This research investigates the scenario where the amount of data available for training is small. It obtains relevant results for the ISBI 2016 melanoma classification challenge (named Skin Lesion Analysis for Melanoma Detection) facing the peculiarities of dealing with such a small and unbalanced biological database. To do this, it explores committees of Deep Convolutional Neural Networks (DCNN), the augmentation of the training data set by image processing classical transforms and by deformations guided by expert knowledge about the lesion axis, and it introduces a third class aiming to improve the classifiers’ distinction of the region of interest of the lesion. The experiments show that the proposed approach improves the final classifier invariance for common melanoma variations, common skin patterns and markers, and dermatoscope capturing conditions.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[4]  Sule Yildirim Yayilgan,et al.  Combining deep learning and hand-crafted features for skin lesion classification , 2016, 2016 Sixth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[5]  Ammara Masood,et al.  Computer Aided Diagnostic Support System for Skin Cancer: A Review of Techniques and Algorithms , 2013, Int. J. Biomed. Imaging.

[6]  Luca Maria Gambardella,et al.  Convolutional Neural Network Committees for Handwritten Character Classification , 2011, 2011 International Conference on Document Analysis and Recognition.

[7]  Hod Lipson,et al.  Convergent Learning: Do different neural networks learn the same representations? , 2015, FE@NIPS.

[8]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[9]  J. Scharcanski,et al.  Computer Vision Techniques for the Diagnosis of Skin Cancer , 2013 .

[10]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[11]  Stefan Carlsson,et al.  CNN Features Off-the-Shelf: An Astounding Baseline for Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[12]  Rajat Raina,et al.  Self-taught learning: transfer learning from unlabeled data , 2007, ICML '07.

[13]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[14]  M. Lens,et al.  Global perspectives of contemporary epidemiological trends of cutaneous malignant melanoma , 2004, The British journal of dermatology.

[15]  Yoshua Bengio,et al.  How transferable are features in deep neural networks? , 2014, NIPS.

[16]  Bryan A. Smith,et al.  Hydraphiles: A Rigorously Studied Class of Synthetic Channel Compounds with In Vivo Activity , 2013, Int. J. Biomed. Imaging.

[17]  Hong Guo,et al.  Neural Learning from Unbalanced Data , 2004, Applied Intelligence.

[18]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[19]  W. Chang,et al.  Computer-Aided Diagnosis of Skin Lesions Using Conventional Digital Photography: A Reliability and Feasibility Study , 2013, PloS one.

[20]  Eduardo Valle,et al.  Knowledge transfer for melanoma screening with deep learning , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[21]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[22]  W V Stoecker,et al.  Skin cancer recognition by computer vision. , 1989, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[23]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[24]  Nathalie Japkowicz,et al.  The class imbalance problem: A systematic study , 2002, Intell. Data Anal..

[25]  David A. Clausi,et al.  Melanoma Decision Support Using Lighting-Corrected Intuitive Feature Models , 2014 .

[26]  Yunqian Ma,et al.  Imbalanced Learning: Foundations, Algorithms, and Applications , 2013 .

[27]  Glenn Stone,et al.  Computation of Thin-Plate Splines , 1991, SIAM J. Sci. Comput..

[28]  Nitesh V. Chawla,et al.  Data Mining for Imbalanced Datasets: An Overview , 2005, The Data Mining and Knowledge Discovery Handbook.

[29]  Alan Bensoussan,et al.  Traditional Chinese Medicine in Cancer Care: A Review of Controlled Clinical Studies Published in Chinese , 2013, PloS one.

[30]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[31]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).