A multidimensional scaling and sample clustering to obtain a representative subset of training data for transfer learning-based rosacea lesion identification

Rosacea is a common cutaneous disorder characterized by facial redness, swelling, and flushing, and it is usually diagnosed by a dermatologist after a visual examination. Qualitative human assessment often results in relatively high intra- and interobserver variability, which can negatively affect patient outcomes. Computer-assisted image analysis may improve visual assessment by human observers because it enables quantitative, consistent, and accurate analysis. Here, we combine classical multidimensional scaling (MDS) with deep convolutional neural networks (CNNs) to create an efficient framework to identify rosacea lesions. MDS is utilized to determine an appropriate amount of training data, which are used to train Inception-ResNet-v2 to classify facial images into rosacea and non-rosacea regions. Using a leave-one-patient-out cross-validation scheme with 128 × 128 non-overlapping image patches, the method resulted in a class weighted average Dice coefficient (DC) of 82.1% ± 2.4% and accuracy of 85.0% ± 0.6%. While this average performance is almost identical to our previous results (81.7% ± 2.7% and 84.9% ± 0.6% for DC and accuracy, respectively), with the new scheme, we use approximately 90% less data to train the system. We also report the results of quantitative experiments with overlapping patches with a stride of 50 pixels. With the same experimental setup, speedups of 25.6 times (128 × 128), 23.4 times (192 × 192), and 23.2 times (256 × 256) have been observed when the network is trained with the entire training data as the baseline. The class weighted average DC for this experiment with the proposed method is 83.9% ± 2.1% as in the case of 192 × 192 pixels overlapping patches, while it is 84.4% ± 2.2% when the entire set is trained at each fold. We conclude that the proposed method can be an efficient way to train deep neural networks using only a small subset of the training data.

[1]  Hamidullah Binol,et al.  Classification of molecular structure images by using ANN, RF, LBP, HOG, and size reduction methods for early stomach cancer detection , 2018 .

[2]  Byunghan Lee,et al.  Deep learning in bioinformatics , 2016, Briefings Bioinform..

[3]  Tie-Yan Liu,et al.  On the Depth of Deep Neural Networks: A Theoretical View , 2015, AAAI.

[4]  D. Rigel,et al.  Analysis of Trends in Geographic Distribution of US Dermatology Workforce Density , 2017, JAMA dermatology.

[5]  B. Everitt,et al.  Statistical methods for rates and proportions , 1973 .

[6]  Jürgen Schmidhuber,et al.  Deep learning in neural networks: An overview , 2014, Neural Networks.

[7]  M. Gurcan,et al.  Digital pathology and artificial intelligence. , 2019, The Lancet. Oncology.

[8]  Hamidullah Binol,et al.  A expert system for stomach cancer images with artificial neural network by using HOG features and linear discriminant analysis: HOG_LDA_ANN , 2017, 2017 IEEE 15th International Symposium on Intelligent Systems and Informatics (SISY).

[9]  R. Gallo,et al.  Rosacea: part I. Introduction, categorization, histology, pathogenesis, and risk factors. , 2015, Journal of the American Academy of Dermatology.

[10]  Steven R Feldman,et al.  Assessment of rosacea severity: A review of evaluation methods used in clinical trials. , 2015, Journal of the American Academy of Dermatology.

[11]  Markus Eickmann,et al.  Human Cell Tropism and Innate Immune System Interactions of Human Respiratory Coronavirus EMC Compared to Those of Severe Acute Respiratory Syndrome Coronavirus , 2013, Journal of Virology.

[12]  Mohammad S. Alam,et al.  Target oriented dimensionality reduction of hyperspectral data by Kernel Fukunaga–Koontz Transform , 2017 .

[13]  P. Rakic Evolution of the neocortex: Perspective from developmental biology , 2010 .

[14]  M. Khalid Khan,et al.  An application of transfer learning to neutrophil cluster detection for tuberculosis: efficient implementation with nonmetric multidimensional scaling and sampling , 2018, Medical Imaging.

[15]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[16]  Gerard Lozanski,et al.  DeepFocus: Detection of out-of-focus regions in whole slide digital images using deep learning , 2018, PloS one.

[17]  J. Douglas Carroll,et al.  Two-Way Multidimensional Scaling: A Review , 2011, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[18]  Abdullah Bal,et al.  UNSUPERVISED NONLINEAR FEATURE EXTRACTION METHOD AND ITS EFFECTS ON TARGET DETECTION IN HIGH-DIMENSIONAL DATA , 2015 .

[19]  Erik Cambria,et al.  Recent Trends in Deep Learning Based Natural Language Processing , 2017, IEEE Comput. Intell. Mag..

[20]  Metin Nafi Gürcan,et al.  Generalization of tumor identification algorithms , 2019, Medical Imaging.

[21]  Liron Pantanowitz,et al.  Identifying tumor in pancreatic neuroendocrine neoplasms from Ki67 images using transfer learning , 2018, PloS one.

[22]  Zhenjun Tang,et al.  Robust image hashing with multidimensional scaling , 2017, Signal Process..

[23]  Anil K. Jain Data clustering: 50 years beyond K-means , 2008, Pattern Recognit. Lett..

[24]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Hamidullah Binol,et al.  Ros‐NET: A deep convolutional neural network for automatic identification of rosacea lesions , 2019, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[27]  Diane Thiboutot,et al.  Standard classification and pathophysiology of rosacea: The 2017 update by the National Rosacea Society Expert Committee , 2018, Journal of the American Academy of Dermatology.

[28]  F M Forton,et al.  Demodicosis: descriptive classification and status of Rosacea, in response to prior classification proposed , 2015, Journal of the European Academy of Dermatology and Venereology : JEADV.

[29]  Metin Nafi Gürcan,et al.  Evolving strategies for the development and evaluation of a computerised melanoma image analysis system , 2018, Comput. methods Biomech. Biomed. Eng. Imaging Vis..

[30]  Qiang Sun,et al.  An analysis of classical multidimensional scaling with applications to clustering. , 2018, Information and inference : a journal of the IMA.