A systematic review of automated melanoma detection in dermatoscopic images and its ground truth data

Malignant melanoma is the third most frequent type of skin cancer and one of the most malignant tumors, accounting for 79% of skin cancer deaths. Melanoma is highly curable if diagnosed early and treated properly as survival rate varies between 15% and 65% from early to terminal stages, respectively. So far, melanoma diagnosis is depending subjectively on the dermatologist's expertise. Computer-aided diagnosis (CAD) systems based on epiluminescense light microscopy can provide an objective second opinion on pigmented skin lesions (PSL). This work systematically analyzes the evidence of the effectiveness of automated melanoma detection in images from a dermatoscopic device. Automated CAD applications were analyzed to estimate their diagnostic outcome. Searching online databases for publication dates between 1985 and 2011, a total of 182 studies on dermatoscopic CAD were found. With respect to the systematic selection criterions, 9 studies were included, published between 2002 and 2011. Those studies formed databases of 14,421 dermatoscopic images including both malignant "melanoma" and benign "nevus", with 8,110 images being available ranging in resolution from 150 x 150 to 1568 x 1045 pixels. Maximum and minimum of sensitivity and specificity are 100.0% and 80.0% as well as 98.14% and 61.6%, respectively. Area under the receiver operator characteristics (AUC) and pooled sensitivity, specificity and diagnostics odds ratio are respectively 0.87, 0.90, 0.81, and 15.89. So, although that automated melanoma detection showed good accuracy in terms of sensitivity, specificity, and AUC, but diagnostic performance in terms of DOR was found to be poor. This might be due to the lack of dermatoscopic image resources (ground truth) that are needed for comprehensive assessment of diagnostic performance. In future work, we aim at testing this hypothesis by joining dermatoscopic images into a unified database that serves as a standard reference for dermatology related research in PSL classification.

[1]  Masafumi Hagiwara,et al.  An improved Internet-based melanoma screening system with dermatologist-like tumor area extraction algorithm , 2008, Comput. Medical Imaging Graph..

[2]  Lars Kai Hansen,et al.  A probabilistic framework for classification of dermatoscopic images , 1999 .

[3]  Harold S Rabinovitz,et al.  Dermoscopy of pigmented skin lesions. , 2005, Journal of the American Academy of Dermatology.

[4]  Susan M Swetter,et al.  Evaluation of digital dermoscopy in a pigmented lesion clinic: clinician versus computer assessment of malignancy risk. , 2007, Journal of the American Academy of Dermatology.

[5]  A. Šimundić.  Measures of Diagnostic Accuracy: Basic Definitions , 2009, EJIFCC.

[6]  H. Koga,et al.  Computer-based classification of dermoscopy images of melanocytic lesions on acral volar skin. , 2008, The Journal of investigative dermatology.

[7]  Ezzeddine Zagrouba,et al.  A PRELIMARY APPROACH FOR THE AUTOMATED RECOGNITION OF MALIGNANT MELANOMA , 2011 .

[8]  Anne Whitehead,et al.  Meta-Analysis of Controlled Clinical Trials , 2002 .

[9]  D. Altman,et al.  Measuring inconsistency in meta-analyses , 2003, BMJ : British Medical Journal.

[10]  P. Bossuyt,et al.  The diagnostic odds ratio: a single indicator of test performance. , 2003, Journal of clinical epidemiology.

[11]  Harald Ganster,et al.  Automated Melanoma Recognition , 2001, IEEE Trans. Medical Imaging.

[12]  D. J. Eedy.  Colour Atlas of Dermoscopy, 2nd enlarged and completely revised Edition (2002) , 2003 .

[13]  Thomas M. Deserno,et al.  Content-based image retrieval applied to bone age assessment , 2010, Medical Imaging.

[14]  C D Naylor,et al.  Meta-analysis of controlled clinical trials. , 1989, The Journal of rheumatology.

[15]  E. R. Farmer,et al.  NIH Consensus conference. Diagnosis and treatment of early melanoma. , 1992, JAMA.

[16]  Victor M Montori,et al.  Conducting systematic reviews of diagnostic studies: didactic guidelines , 2002, BMC medical research methodology.

[17]  Philippe Schmid-Saugeona,et al.  Towards a computer-aided diagnosis system for pigmented skin lesions. , 2003, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[18]  M. G. Fleming,et al.  Dermoscopy of pigmented skin lesions: results of a consensus meeting via the Internet. , 2003, Journal of the American Academy of Dermatology.

[19]  Josef Smolle,et al.  EARLY DIAGNOSIS OF MALIGNANT MELANOMA BY SURFACE MICROSCOPY , 1987, The Lancet.

[20]  Zbigniew W. Ras,et al.  Advances in Intelligent Information Systems , 2010, Advances in Intelligent Information Systems.

[21]  Sio-Iong Ao,et al.  Electrical Engineering and Applied Computing , 2013 .

[22]  Christoph Palm,et al.  Selektion von Farbtexturmerkmalen zur Tumorklassifikation dermatoskopischer Fotografien , 2002, Bildverarbeitung für die Medizin.

[23]  S. Walter,et al.  Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data , 2002, Statistics in medicine.

[24]  Arnaldo de Albuquerque Araújo,et al.  Toward a standard reference database for computer-aided mammography , 2008, SPIE Medical Imaging.

[25]  M. Ferri,et al.  Computer-aided diagnosis of melanocytic lesions. , 2005, Anticancer research.

[26]  A. Ormerod,et al.  Systematic review of dermoscopy and digital dermoscopy/ artificial intelligence for the diagnosis of melanoma , 2009, The British journal of dermatology.

[27]  R. Johr.  Dermoscopy: alternative melanocytic algorithms-the ABCD rule of dermatoscopy, Menzies scoring method, and 7-point checklist. , 2002, Clinics in dermatology.

[28]  Tom Fawcett,et al.  An introduction to ROC analysis , 2006, Pattern Recognit. Lett..

[29]  Masafumi Hagiwara,et al.  Quantitative assessment of tumour extraction from dermoscopy images and evaluation of computer-based extraction methods for an automatic melanoma diagnostic system , 2006, Melanoma research.

[30]  Qaisar Abbas,et al.  Skin tumor area extraction using an improved dynamic programming approach , 2012, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[31]  G. Argenziano,et al.  Epiluminescence microscopy for the diagnosis of doubtful melanocytic skin lesions. Comparison of the ABCD rule of dermatoscopy and a new 7-point checklist based on pattern analysis. , 1998, Archives of dermatology.

[32]  D. Piccolo,et al.  Clinical and Laboratory Investigations Dermoscopic diagnosis by a trained clinician vs. a clinician with minimal dermoscopy training vs. computer-aided diagnosis of 341 pigmented skin lesions: a comparative study , 2002 .

[33]  M. Schiller,et al.  Das Melanom , 2014, Der Radiologe.

[34]  Steven McGee,et al.  Simplifying likelihood ratios , 2002, Journal of General Internal Medicine.

[35]  H P Soyer,et al.  Dermoscopy of pigmented skin lesions (Part II). , 2001, European journal of dermatology : EJD.

[36]  G Rassner,et al.  Clinical and Laboratory Investigations Digital image analysis for diagnosis of cutaneous melanoma. Development of a highly effective computer algorithm based on analysis of 837 melanocytic lesions , 2004 .

[37]  P. Taylor,et al.  A systematic review of computer-assisted diagnosis in diagnostic cancer imaging. , 2012, European journal of radiology.

[38]  Ara Darzi,et al.  Key topics in surgical research and methodology , 2010 .

[39]  Ezzeddine Zagrouba,et al.  An Accelerated System for Melanoma Diagnosis Based on Subset Feature Selection , 2005, J. Comput. Inf. Technol..

[40]  Masaru Tanaka,et al.  Classification of melanocytic skin lesions from non-melanocytic lesions , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[41]  Riccardo Bono,et al.  Melanoma Computer-Aided Diagnosis , 2004, Clinical Cancer Research.

[42]  Ralph Braun,et al.  The performance of SolarScan: an automated dermoscopy image analysis instrument for the diagnosis of primary melanoma. , 2005, Archives of dermatology.

[43]  D. Gavaghan,et al.  An evaluation of homogeneity tests in meta-analyses in pain using simulations of individual patient data , 2000, Pain.

[44]  Jiali Han,et al.  Risk factors for skin cancers: a nested case-control study within the Nurses' Health Study. , 2006, International journal of epidemiology.