Studies on Different CNN Algorithms for Face Skin Disease Classification Based on Clinical Images

Skin problems not only injure physical health but also induce psychological problems, especially for patients whose faces have been damaged or even disfigured. Using smart devices, most of the people are able to obtain convenient clinical images of their face skin condition. On the other hand, the convolutional neural networks (CNNs) have achieved near or even better performance than human beings in the imaging field. Therefore, this paper studied different CNN algorithms for face skin disease classification based on the clinical images. First, from Xiangya–Derm, which is, to the best of our knowledge, China’s largest clinical image dataset of skin diseases, we established a dataset that contains 2656 face images belonging to six common skin diseases [seborrheic keratosis (SK), actinic keratosis (AK), rosacea (ROS), lupus erythematosus (LE), basal cell carcinoma (BCC), and squamous cell carcinoma (SCC)]. We performed studies using five mainstream network algorithms to classify these diseases in the dataset and compared the results. Then, we performed studies using an independent dataset of the same disease types, but from other body parts, to perform transfer learning on our models. Comparing the performances, the models that used transfer learning achieved a higher average precision and recall for almost all structures. In the test dataset, which included 388 facial images, the best model achieved 92.9%, 89.2%, and 84.3% recalls for the LE, BCC, and SK, respectively, and the mean recall and precision reached 77.0% and 70.8%.

[1]  Abhishek Das,et al.  Grad-CAM: Visual Explanations from Deep Networks via Gradient-Based Localization , 2016, 2017 IEEE International Conference on Computer Vision (ICCV).

[2]  Xingyu Zhang,et al.  Daily Intake of Soft Drinks and Moderate‐to‐Severe Acne Vulgaris in Chinese Adolescents , 2019, The Journal of pediatrics.

[3]  A. Bewley,et al.  The neglected psychological aspects of skin disease , 2017, British Medical Journal.

[4]  Thomas Brox,et al.  Striving for Simplicity: The All Convolutional Net , 2014, ICLR.

[5]  Chen Chen,et al.  Possible Involvement of F1F0-ATP synthase and Intracellular ATP in Keratinocyte Differentiation in normal skin and skin lesions , 2017, Scientific Reports.

[6]  Cui Tao,et al.  Towards improving diagnosis of skin diseases by combining deep neural network and human knowledge , 2018, BMC Medical Informatics and Decision Making.

[7]  Peter M. Krawitz,et al.  Identifying facial phenotypes of genetic disorders using deep learning , 2019, Nature Medicine.

[8]  Ammara Masood,et al.  Computer Aided Diagnostic Support System for Skin Cancer: A Review of Techniques and Algorithms , 2013, Int. J. Biomed. Imaging.

[9]  François Chollet,et al.  Xception: Deep Learning with Depthwise Separable Convolutions , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[10]  Francesco Amato,et al.  Artificial Intelligence for the Objective Evaluation of Acne Investigator Global Assessment. , 2018, Journal of drugs in dermatology : JDD.

[11]  R. Hay,et al.  The global burden of skin disease in 2010: an analysis of the prevalence and impact of skin conditions. , 2014, The Journal of investigative dermatology.

[12]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[13]  Sergey Ioffe,et al.  Rethinking the Inception Architecture for Computer Vision , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[16]  Weirong Pan,et al.  Symptoms of systemic lupus erythematosus are diagnosed in leptin transgenic pigs , 2018, PLoS biology.

[17]  Sai Yang,et al.  The Rosacea-specific Quality-of-Life instrument (RosQol): Revision and validation among Chinese patients , 2018, PloS one.

[18]  Shuang Zhao,et al.  Frizzled-related proteins 4 (SFRP4) rs1802073G allele predicts the elevated serum lipid levels during acitretin treatment in psoriatic patients from Hunan, China , 2018, PeerJ.

[19]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[20]  Wu Zhu,et al.  Polymorphisms of SLCO1B1 rs4149056 and SLC22A1 rs2282143 are associated with responsiveness to acitretin in psoriasis patients , 2018, Scientific Reports.

[21]  Kilian Q. Weinberger,et al.  Densely Connected Convolutional Networks , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[22]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.