Melanoma Segmentation and Classification in Clinical Images Using Deep Learning

In this paper, a deep learning computer aided diagnosis system (CADs) is proposed for automatic segmentation and classification of melanoma lesions, containing a fully convolutional neural network (FCN) and a specific convolutional neural network (CNN). FCN, which consists of a 28-layer neural structure, is designed for segmentation and with a mask for region of interest (ROI) as its output. Later, the CNN only uses the segmented ROI of raw image to extract features, while the DLCM features, statistical and contrast location features extracted from same ROI are merged into CNN features. Finally, the combined features are utilized by the fully connected layers in CNN to obtain the final classification of melanoma, malignant or benign. The training of FCN and CNN are separated with different loss functions. Publicly available database ISBI 2016 is used for evaluating the effectiveness, efficiency, and generalization capability with evaluating indicator, such as accuracy, precision, and recall. Preprocessing methods, such as data argumentation and balancing are utilized to make further improvements to performance. Experiments on a batch size of 100 images yielded an accuracy of 92%, a specificity of 93% and a sensitivity of 94%, revealing that the proposed system is superior in terms of diagnostic accuracy in comparison with the state-of-the-art methods.

[1]  Seunghoon Hong,et al.  Learning Deconvolution Network for Semantic Segmentation , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[2]  Ezzeddine Zagrouba,et al.  A PRELIMARY APPROACH FOR THE AUTOMATED RECOGNITION OF MALIGNANT MELANOMA , 2011 .

[3]  Shu Liao,et al.  Multi-Instance Deep Learning: Discover Discriminative Local Anatomies for Bodypart Recognition , 2016, IEEE Transactions on Medical Imaging.

[4]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Marcel F. Jonkman,et al.  MED-NODE: A computer-assisted melanoma diagnosis system using non-dermoscopic images , 2015, Expert Syst. Appl..

[6]  A. Jerant,et al.  Early detection and treatment of skin cancer. , 2000, American family physician.

[7]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[8]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[9]  Yading Yuan,et al.  Automatic Skin Lesion Segmentation Using Deep Fully Convolutional Networks With Jaccard Distance , 2017, IEEE Transactions on Medical Imaging.

[10]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[11]  W. Stolz,et al.  The ABCD rule of dermatoscopy. High prospective value in the diagnosis of doubtful melanocytic skin lesions. , 1994, Journal of the American Academy of Dermatology.

[12]  S. Feldman,et al.  Incidence Estimate of Nonmelanoma Skin Cancer (Keratinocyte Carcinomas) in the U.S. Population, 2012. , 2015, JAMA dermatology.

[13]  Mohammad H. Jafari,et al.  Melanoma detection by analysis of clinical images using convolutional neural network , 2016, 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  Geoffrey E. Hinton,et al.  On the importance of initialization and momentum in deep learning , 2013, ICML.

[15]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[16]  Harm de Vries,et al.  RMSProp and equilibrated adaptive learning rates for non-convex optimization. , 2015 .