Assessment of Accuracy of an Artificial Intelligence Algorithm to Detect Melanoma in Images of Skin Lesions

Key Points Question How accurate is an artificial intelligence–based melanoma detection algorithm, which analyzes dermoscopic images taken by smartphone and digital single-lens reflex cameras, compared with clinical assessment and histopathological diagnosis? Findings In this diagnostic study, 1550 images of suspicious and benign skin lesions were analyzed by an artificial intelligence algorithm. When compared with histopathological diagnosis, the algorithm achieved an area under the receiver operator characteristic curve of 91.8%. At 100% sensitivity, the algorithm achieved a specificity of 64.8%, while clinicians achieved a specificity of 69.9%. Meaning As the burden of skin cancer increases, artificial intelligence technology could play a role in identifying lesions with a high likelihood of melanoma.

[1]  Z. Obermeyer,et al.  Predicting the Future - Big Data, Machine Learning, and Clinical Medicine. , 2016, The New England journal of medicine.

[2]  A. Halpern,et al.  Cost-effective Melanoma Screening. , 2016, JAMA dermatology.

[3]  G. Diamond The wizard of odds: Bayes theorem and diagnostic testing. , 1999, Mayo Clinic proceedings.

[4]  Evelyn P Whitlock,et al.  Screening for Skin Cancer in Adults: An Updated Systematic Evidence Review for the U.S. Preventive Services Task Force , 2016 .

[5]  J. Wolf,et al.  Diagnostic inaccuracy of smartphone applications for melanoma detection. , 2013, JAMA dermatology.

[6]  H. Haenssle,et al.  Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists , 2018, Annals of oncology : official journal of the European Society for Medical Oncology.

[7]  H. Williams,et al.  Teledermatology for diagnosing skin cancer in adults. , 2018, The Cochrane database of systematic reviews.

[8]  Paula R. Blasi,et al.  Screening for Skin Cancer in Adults: Updated Evidence Report and Systematic Review for the US Preventive Services Task Force. , 2016, JAMA.

[9]  H. Williams,et al.  Reflectance confocal microscopy for diagnosing cutaneous melanoma in adults. , 2018, The Cochrane database of systematic reviews.

[10]  Jonathan J Deeks,et al.  Smartphone applications for triaging adults with skin lesions that are suspicious for melanoma. , 2018, The Cochrane database of systematic reviews.

[11]  J. Emery,et al.  Smartphone applications for melanoma detection by community, patient and generalist clinician users: a review , 2015, British Journal of Dermatology.

[12]  R. Little A Test of Missing Completely at Random for Multivariate Data with Missing Values , 1988 .

[13]  M. Gore,et al.  Revised UK guidelines for the management of cutaneous melanoma 2010. , 2010, Journal of plastic, reconstructive & aesthetic surgery : JPRAS.

[14]  R. B. Aldridge,et al.  Dermoscopy, with and without visual inspection, for diagnosing melanoma in adults. , 2018, The Cochrane database of systematic reviews.

[15]  R. Dellavalle,et al.  Mobile applications in dermatology. , 2013, JAMA dermatology.

[16]  M. Pepe The Statistical Evaluation of Medical Tests for Classification and Prediction , 2003 .

[17]  Laura K Ferris,et al.  Diagnostic inaccuracy of smartphone applications for melanoma detection--reply. , 2013, JAMA dermatology.

[18]  H. Williams,et al.  Computer-assisted diagnosis techniques (dermoscopy and spectroscopy-based) for diagnosing skin cancer in adults. , 2018, The Cochrane database of systematic reviews.

[19]  E. Warshaw,et al.  Diagnosing and managing cutaneous pigmented lesions: Primary care physicians versus dermatologists , 2006, Journal of General Internal Medicine.

[20]  Shannon C. Trotter,et al.  Skin cancer screening: recommendations for data-driven screening guidelines and a review of the US Preventive Services Task Force controversy , 2017, Melanoma management.

[21]  Allan Halpern,et al.  Diagnostic inaccuracy of smartphone applications for melanoma detection: representative lesion sets and the role for adjunctive technologies. , 2013, JAMA dermatology.

[22]  D. Morrell,et al.  Skin scan: a demonstration of the need for FDA regulation of medical apps on iPhone. , 2013, Journal of the American Academy of Dermatology.

[23]  Lisa M. Schwartz,et al.  Skin biopsy rates and incidence of melanoma: population based ecological study , 2005, BMJ : British Medical Journal.

[24]  I. Palamaras,et al.  Detection of Malignant Melanoma Using Artificial Intelligence: An Observational Study of Diagnostic Accuracy. , 2019, Dermatology practical & conceptual.

[25]  H. Kittler,et al.  Diagnostic accuracy of dermoscopy. , 2002, The Lancet. Oncology.

[26]  A. Rajbhandari,et al.  Heckroccurve: ROC Curves for Selected Samples , 2018 .

[27]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[28]  Sunlight vitamin D and skin cancer. , 2012 .