Melanoma Is Skin Deep: A 3D Reconstruction Technique for Computerized Dermoscopic Skin Lesion Classification

Melanoma mortality rates are the highest amongst skin cancer patients. Melanoma is life threating when it grows beyond the dermis of the skin. Hence, depth is an important factor to diagnose melanoma. This paper introduces a non-invasive computerized dermoscopy system that considers the estimated depth of skin lesions for diagnosis. A 3-D skin lesion reconstruction technique using the estimated depth obtained from regular dermoscopic images is presented. On basis of the 3-D reconstruction, depth and 3-D shape features are extracted. In addition to 3-D features, regular color, texture, and 2-D shape features are also extracted. Feature extraction is critical to achieve accurate results. Apart from melanoma, in-situ melanoma the proposed system is designed to diagnose basal cell carcinoma, blue nevus, dermatofibroma, haemangioma, seborrhoeic keratosis, and normal mole lesions. For experimental evaluations, the PH2, ISIC: Melanoma Project, and ATLAS dermoscopy data sets is considered. Different feature set combinations is considered and performance is evaluated. Significant performance improvement is reported the post inclusion of estimated depth and 3-D features. The good classification scores of sensitivity = 96%, specificity = 97% on PH2 data set and sensitivity = 98%, specificity = 99% on the ATLAS data set is achieved. Experiments conducted to estimate tumor depth from 3-D lesion reconstruction is presented. Experimental results achieved prove that the proposed computerized dermoscopy system is efficient and can be used to diagnose varied skin lesion dermoscopy images.

[1]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[2]  Franck Marzani,et al.  Classification of melanoma lesions using sparse coded features and random forests , 2016, SPIE Medical Imaging.

[3]  Jorge S. Marques,et al.  Melanoma detection algorithm based on feature fusion , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[4]  M. Faezipour,et al.  A comparison of feature sets for an automated skin lesion analysis system for melanoma early detection and prevention , 2015, 2015 Long Island Systems, Applications and Technology.

[5]  Omar Abuzaghleh,et al.  Noninvasive Real-Time Automated Skin Lesion Analysis System for Melanoma Early Detection and Prevention , 2015, IEEE Journal of Translational Engineering in Health and Medicine.

[6]  David A. Clausi,et al.  High-Level Intuitive Features (HLIFs) for Intuitive Skin Lesion Description , 2015, IEEE Transactions on Biomedical Engineering.

[7]  Jorge S. Marques,et al.  Two Systems for the Detection of Melanomas in Dermoscopy Images Using Texture and Color Features , 2014, IEEE Systems Journal.

[8]  M. Emre Celebi,et al.  Automated Quantification of Clinically Significant Colors in Dermoscopy Images and Its Application to Skin Lesion Classification , 2014, IEEE Systems Journal.

[9]  Aurora Sáez,et al.  Model-Based Classification Methods of Global Patterns in Dermoscopic Images , 2014, IEEE Transactions on Medical Imaging.

[10]  Enoch Peserico,et al.  Simpler, Faster, More Accurate Melanocytic Lesion Segmentation Through MEDS , 2014, IEEE Transactions on Biomedical Engineering.

[11]  David A. Clausi,et al.  Segmentation of Skin Lesions From Digital Images Using Joint Statistical Texture Distinctiveness , 2014, IEEE Transactions on Biomedical Engineering.

[12]  Daniel Holthausen Nunes,et al.  Dermoscopic features of thin melanomas: a comparative study of melanoma in situ and invasive melanomas smaller than or equal to 1mm* , 2013, Anais brasileiros de dermatologia.

[13]  Pedro M. Ferreira,et al.  PH2 - A dermoscopic image database for research and benchmarking , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[14]  Jeff Dunn,et al.  Global controversies and advances in skin cancer. , 2013, Asian Pacific journal of cancer prevention : APJCP.

[15]  C. Miyasaka,et al.  Fine mapping of tissue properties on excised samples of melanoma and skin without the need for histological staining , 2013, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[16]  David I. McLean,et al.  Detection and Analysis of Irregular Streaks in Dermoscopic Images of Skin Lesions , 2013, IEEE Transactions on Medical Imaging.

[17]  James Bailey,et al.  Computer-Aided Diagnosis of Melanoma Using Border- and Wavelet-Based Texture Analysis , 2012, IEEE Transactions on Information Technology in Biomedicine.

[18]  Atam P. Dhawan,et al.  3-D Volume Reconstruction of Skin Lesions for Melanin and Blood Volume Estimation and Lesion Severity Analysis , 2012, IEEE Transactions on Medical Imaging.

[19]  Jean-Yves Tourneret,et al.  Segmentation of Skin Lesions in 2-D and 3-D Ultrasound Images Using a Spatially Coherent Generalized Rayleigh Mixture Model , 2012, IEEE Transactions on Medical Imaging.

[20]  Terence Sim,et al.  Defocus map estimation from a single image , 2011, Pattern Recognit..

[21]  David I. McLean,et al.  Generalizing Common Tasks in Automated Skin Lesion Diagnosis , 2011, IEEE Transactions on Information Technology in Biomedicine.

[22]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[23]  Ilias Maglogiannis,et al.  Overview of Advanced Computer Vision Systems for Skin Lesions Characterization , 2009, IEEE Transactions on Information Technology in Biomedicine.

[24]  A. Marghoob,et al.  Dermoscopy research--an update. , 2009, Seminars in cutaneous medicine and surgery.

[25]  M. Emin Yüksel,et al.  Accurate Segmentation of Dermoscopic Images by Image Thresholding Based on Type-2 Fuzzy Logic , 2009, IEEE Transactions on Fuzzy Systems.

[26]  Junji Maeda,et al.  Comparison of Segmentation Methods for Melanoma Diagnosis in Dermoscopy Images , 2009, IEEE Journal of Selected Topics in Signal Processing.

[27]  Gerard de Haan,et al.  Automatic imaging sysem with decision support for inspection of pigmented skin lesions and melanoma diagnosis. , 2009 .

[28]  H. Ermert,et al.  In Vivo Ultrasound Biomicroscopy of Skin: Spectral System Characteristics and Inverse Filtering Optimization , 2007, IEEE Transactions on Ultrasonics, Ferroelectrics and Frequency Control.

[29]  Dani Lischinski,et al.  A Closed-Form Solution to Natural Image Matting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[30]  Jorge S. Marques,et al.  Adaptive snakes using the EM algorithm , 2005, IEEE Transactions on Image Processing.

[31]  H. Kittler,et al.  Follow-up of melanocytic skin lesions with digital dermoscopy: risks and benefits. , 2004, Archives of dermatology.

[32]  Paul Nghiem,et al.  Interactive Atlas of Dermoscopy , 2004 .

[33]  Pietro Perona,et al.  Object class recognition by unsupervised scale-invariant learning , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[34]  Gernot Rassner,et al.  Modified ABC-point list of dermoscopy: A simplified and highly accurate dermoscopic algorithm for the diagnosis of cutaneous melanocytic lesions. , 2003, Journal of the American Academy of Dermatology.

[35]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[36]  Jitendra Malik,et al.  Representing and Recognizing the Visual Appearance of Materials using Three-dimensional Textons , 2001, International Journal of Computer Vision.

[37]  G. Argenziano,et al.  Epiluminescence microscopy for the diagnosis of doubtful melanocytic skin lesions. Comparison of the ABCD rule of dermatoscopy and a new 7-point checklist based on pattern analysis. , 1998, Archives of dermatology.

[38]  J. Mayer,et al.  Systematic review of the diagnostic accuracy of dermatoscopy in detecting malignant melanoma , 1997, The Medical journal of Australia.

[39]  K Wolff,et al.  Epiluminescence microscopy of small pigmented skin lesions: short-term formal training improves the diagnostic performance of dermatologists. , 1997, Journal of the American Academy of Dermatology.

[40]  G. McLachlan,et al.  The EM algorithm and extensions , 1996 .

[41]  S. Menzies,et al.  Frequency and morphologic characteristics of invasive melanomas lacking specific surface microscopic features. , 1996, Archives of dermatology.

[42]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[43]  R. H. Moss,et al.  Neural network diagnosis of malignant melanoma from color images , 1994, IEEE Transactions on Biomedical Engineering.

[44]  Jitendra Malik,et al.  Scale-Space and Edge Detection Using Anisotropic Diffusion , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[45]  K Wolff,et al.  In vivo epiluminescence microscopy of pigmented skin lesions. I. Pattern analysis of pigmented skin lesions. , 1987, Journal of the American Academy of Dermatology.

[46]  J. Jones The Cancer Institute. , 1978, The Australian nurses' journal. Royal Australian Nursing Federation.

[47]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[48]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[49]  Nadia Smaoui,et al.  A developed system for melanoma diagnosis , 2013 .

[50]  Kashyap Dhruve,et al.  DETECTING IN-SITU MELANOMA USING MULTI PARAMETER EXTRACTION AND NEURAL CLASSIFICATION MECHANISMS , 2013 .

[51]  A. Govardhan,et al.  Computer Aided Multi-Parameter Extraction System to Aid Early Detection of Skin Cancer Melanoma , 2012 .

[52]  Chih-Jen Lin,et al.  A Practical Guide to Support Vector Classication , 2008 .

[53]  Dustin Boswell,et al.  Introduction to Support Vector Machines , 2002 .

[54]  Jan Flusser,et al.  Pattern recognition by affine moment invariants , 1993, Pattern Recognit..

[55]  R. Rangayyan,et al.  Nevoscopy: Three-Dimensional Computed Tomography of Nevi and Melanomas in Situ by Transillumination , 1984, IEEE Transactions on Medical Imaging.