The Possibility of Deep Learning-Based, Computer-Aided Skin Tumor Classifiers

The incidence of skin tumors has steadily increased. Although most are benign and do not affect survival, some of the more malignant skin tumors present a lethal threat if a delay in diagnosis permits them to become advanced. Ideally, an inspection by an expert dermatologist would accurately detect malignant skin tumors in the early stage; however, it is not practical for every single patient to receive intensive screening by dermatologists. To overcome this issue, many studies are ongoing to develop dermatologist-level, computer-aided diagnostics. Whereas, many systems that can classify dermoscopic images at this dermatologist-equivalent level have been reported, a much fewer number of systems that can classify conventional clinical images have been reported thus far. Recently, the introduction of deep-learning technology, a method that automatically extracts a set of representative features for further classification has dramatically improved classification efficacy. This new technology has the potential to improve the computer classification accuracy of conventional clinical images to the level of skilled dermatologists. In this review, this new technology and present development of computer-aided skin tumor classifiers will be summarized.

[1]  John R. Smith,et al.  Collaborative Human-AI (CHAI): Evidence-Based Interpretable Melanoma Classification in Dermoscopic Images , 2018, MLCN/DLF/iMIMIC@MICCAI.

[2]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  H. Kittler,et al.  Diagnostic accuracy of dermoscopy. , 2002, The Lancet. Oncology.

[4]  Adam Huang,et al.  The feasibility of using manual segmentation in a multifeature computer-aided diagnosis system for classification of skin lesions: a retrospective comparative study , 2015, BMJ Open.

[5]  Woohyung Lim,et al.  Interpretation of the Outputs of a Deep Learning Model Trained with a Skin Cancer Dataset. , 2018, The Journal of investigative dermatology.

[6]  S. Feldman,et al.  Incidence Estimate of Nonmelanoma Skin Cancer (Keratinocyte Carcinomas) in the U.S. Population, 2012. , 2015, JAMA dermatology.

[7]  Tin-Yu Wu,et al.  Ensemble Convolutional Neural Networks for Face Recognition , 2018 .

[8]  H. Haenssle,et al.  Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists , 2018, Annals of oncology : official journal of the European Society for Medical Oncology.

[9]  H Asadi,et al.  eDoctor: machine learning and the future of medicine , 2018, Journal of internal medicine.

[10]  Mahadev Satyanarayanan,et al.  Computer-aided classification of melanocytic lesions using dermoscopic images. , 2015, Journal of the American Academy of Dermatology.

[11]  C. van Weel,et al.  Skin diseases in family medicine: prevalence and health care use. , 2008, Annals of family medicine.

[12]  Jordan Yap,et al.  Multimodal skin lesion classification using deep learning , 2018, Experimental dermatology.

[13]  R. Hofmann-Wellenhof,et al.  Comparison of the accuracy of human readers versus machine-learning algorithms for pigmented skin lesion classification: an open, web-based, international, diagnostic study. , 2019, The Lancet. Oncology.

[14]  C Fink,et al.  Reply to the letter to the Editor "Reply to 'Man against machine: diagnostic performance of a deep learning convolutional neural network for dermoscopic melanoma recognition in comparison to 58 dermatologists' by H. A. Haenssle et al. " by L. Oakden-Rayner. , 2019, Annals of oncology : official journal of the European Society for Medical Oncology.

[15]  S. Han,et al.  Classification of the Clinical Images for Benign and Malignant Cutaneous Tumors Using a Deep Learning Algorithm. , 2018, The Journal of investigative dermatology.

[16]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[17]  Robert N. Anderson,et al.  Annual Report to the Nation on the Status of Cancer, 1975–2009, Featuring the Burden and Trends in Human Papillomavirus (HPV)–Associated Cancers and HPV Vaccination Coverage Levels , 2013, Journal of the National Cancer Institute.

[18]  H P Soyer,et al.  Dermoscopy of pigmented skin lesions--a valuable tool for early diagnosis of melanoma. , 2001, The Lancet. Oncology.

[19]  W. Stolz,et al.  The ABCD rule of dermatoscopy. High prospective value in the diagnosis of doubtful melanocytic skin lesions. , 1994, Journal of the American Academy of Dermatology.

[20]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[21]  K Wolff,et al.  In vivo epiluminescence microscopy of pigmented skin lesions. II. Diagnosis of small pigmented skin lesions and early detection of malignant melanoma. , 1987, Journal of the American Academy of Dermatology.

[22]  S. Gruber,et al.  Cutaneous and Ocular Melanoma , 2006 .

[23]  A. Wayne Whitney,et al.  A Direct Method of Nonparametric Measurement Selection , 1971, IEEE Transactions on Computers.

[24]  Pragna Patel,et al.  Recent trends in cutaneous melanoma incidence and death rates in the United States, 1992-2006. , 2011, Journal of the American Academy of Dermatology.

[25]  Ghassan Hamarneh,et al.  Hair Enhancement in Dermoscopic Images Using Dual-Channel Quaternion Tubularness Filters and MRF-Based Multilabel Optimization , 2014, IEEE Transactions on Image Processing.

[26]  Wei-Yin Loh,et al.  Classification and regression trees , 2011, WIREs Data Mining Knowl. Discov..

[27]  Qiang Yang,et al.  A Survey on Transfer Learning , 2010, IEEE Transactions on Knowledge and Data Engineering.

[28]  D. Piccolo,et al.  Clinical and Laboratory Investigations Dermoscopic diagnosis by a trained clinician vs. a clinician with minimal dermoscopy training vs. computer-aided diagnosis of 341 pigmented skin lesions: a comparative study , 2002 .

[29]  Jesús Cid-Sueiro,et al.  A model selection algorithm for a posteriori probability estimation with neural networks , 2005, IEEE Transactions on Neural Networks.

[30]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[31]  Ammara Masood,et al.  Computer Aided Diagnostic Support System for Skin Cancer: A Review of Techniques and Algorithms , 2013, Int. J. Biomed. Imaging.

[32]  R. Johr Dermoscopy: alternative melanocytic algorithms-the ABCD rule of dermatoscopy, Menzies scoring method, and 7-point checklist. , 2002, Clinics in dermatology.

[33]  Achim Hekler,et al.  A convolutional neural network trained with dermoscopic images performed on par with 145 dermatologists in a clinical melanoma image classification task. , 2019, European journal of cancer.

[34]  Kari Nielsen,et al.  Validity of ABCD Rule of Dermoscopy in Clinical Practice. , 2016, Acta dermato-venereologica.

[35]  Gisbert Schneider,et al.  Support vector machine applications in bioinformatics. , 2003, Applied bioinformatics.

[36]  J F Aitken,et al.  Reliability of computer image analysis of pigmented skin lesions of Australian adolescents , 1996, Cancer.

[37]  Maria L. Wei,et al.  Precision Diagnosis Of Melanoma And Other Skin Lesions From Digital Images , 2017, AMIA Joint Summits on Translational Science proceedings. AMIA Joint Summits on Translational Science.

[38]  Cristian Navarrete-Dechent,et al.  Automated Dermatological Diagnosis: Hype or Reality? , 2018, The Journal of investigative dermatology.

[39]  Reyer Zwiggelaar,et al.  Automated Breast Ultrasound Lesions Detection Using Convolutional Neural Networks , 2018, IEEE Journal of Biomedical and Health Informatics.

[40]  Michael S. Bernstein,et al.  ImageNet Large Scale Visual Recognition Challenge , 2014, International Journal of Computer Vision.

[41]  Michael Grass,et al.  Comparison of Deep Learning Approaches for Multi-Label Chest X-Ray Classification , 2018, Scientific Reports.

[42]  M. Walt Dermatology in General Practice. , 1957, Research newsletter. College of General Practitioners.

[43]  A. Ormerod,et al.  Systematic review of dermoscopy and digital dermoscopy/ artificial intelligence for the diagnosis of melanoma , 2009, The British journal of dermatology.

[44]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[45]  Eduardo Valle,et al.  Solo or Ensemble? Choosing a CNN Architecture for Melanoma Classification , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[46]  E. Benton,et al.  The profile of dermatological problems in primary care , 2010, Clinical and experimental dermatology.

[47]  R. Hofmann-Wellenhof,et al.  The use of dermatoscopy in diagnosis and therapy of nonmelanocytic skin cancer , 2016, Journal der Deutschen Dermatologischen Gesellschaft = Journal of the German Society of Dermatology : JDDG.

[48]  Thomas Marill,et al.  On the effectiveness of receptors in recognition systems , 1963, IEEE Trans. Inf. Theory.

[49]  Phillip M. Cheng,et al.  Transfer Learning with Convolutional Neural Networks for Classification of Abdominal Ultrasound Images , 2017, Journal of Digital Imaging.

[50]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[51]  Josef Kittler,et al.  Floating search methods in feature selection , 1994, Pattern Recognit. Lett..

[52]  David Dagan Feng,et al.  Automated saliency-based lesion segmentation in dermoscopic images , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[53]  C Bartoli,et al.  Results obtained by using a computerized image analysis system designed as an aid to diagnosis of cutaneous melanoma , 1992, Melanoma research.

[54]  M. Weinstock,et al.  Keratinocyte Carcinomas (Basal and Squamous Cell Carcinomas of the Skin) , 2009 .

[55]  W. Chang,et al.  Computer-Aided Diagnosis of Skin Lesions Using Conventional Digital Photography: A Reliability and Feasibility Study , 2013, PloS one.

[56]  Y. Fujisawa,et al.  Deep‐learning‐based, computer‐aided classifier developed with a small dataset of clinical images surpasses board‐certified dermatologists in skin tumour diagnosis , 2018, The British journal of dermatology.

[57]  F. Harrell,et al.  Regression modelling strategies for improved prognostic prediction. , 1984, Statistics in medicine.

[58]  R Kasmi,et al.  Biologically inspired skin lesion segmentation using a geodesic active contour technique , 2016, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[59]  Ralph Braun,et al.  The performance of SolarScan: an automated dermoscopy image analysis instrument for the diagnosis of primary melanoma. , 2005, Archives of dermatology.

[60]  Brett Kuprel,et al.  Automated Classification of Skin Lesions: From Pixels to Practice. , 2018, The Journal of investigative dermatology.

[61]  Qaisar Abbas,et al.  Unified approach for lesion border detection based on mixture modeling and local entropy thresholding , 2013, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[62]  Yoshua Bengio,et al.  Pattern Recognition and Neural Networks , 1995 .

[63]  C. Ahn,et al.  Dermatoscopy for melanoma and pigmented lesions. , 2012, Dermatologic clinics.