ScalpEye: A Deep Learning-Based Scalp Hair Inspection and Diagnosis System for Scalp Health

Many people suffer from scalp hair problems such as dandruff, folliculitis, hair loss, and oily hair due to poor daily habits, imbalanced nutritional intake, high stress, and toxic substances in their environment. To treat these scalp problems, dedicated services such as scalp hair physiotherapy have emerged in recent years. This article proposes a deep learning-based intelligent scalp inspection and diagnosis system, named ScalpEye, as an efficient inspection and diagnosis system for scalp hair physiotherapy as part of scalp healthcare. The proposed ScalpEye system consists of a portable scalp hair imaging microscope, a mobile device app, a cloud-based artificial intelligence (AI) training server, and a cloud-based management platform. The ScalpEye system can detect and diagnose four common scalp hair symptoms (dandruff, folliculitis, hair loss, and oily hair). In this study, we tested several popular object detection models and adopted a Faster R-CNN with the Inception ResNet_v2_Atrous model in the ScalpEye system for image recognition when inspecting and diagnosing scalp hair symptoms. The experimental results show that the ScalpEye system can diagnose four common scalp hair symptoms with an average precision (AP) ranging from 97.41% to 99.09%.

[1]  Andrew Zisserman,et al.  Very Deep Convolutional Networks for Large-Scale Image Recognition , 2014, ICLR.

[2]  L. Misery,et al.  Evaluation of sensitive scalp severity and symptomatology by using a new score , 2011, Journal of the European Academy of Dermatology and Venereology : JEADV.

[3]  Liang-Bi Chen,et al.  Development and Experimental Evaluation of Machine-Learning Techniques for an Intelligent Hairy Scalp Detection System , 2018 .

[4]  Lidia Rudnicka,et al.  Hair shafts in trichoscopy: clues for diagnosis of hair and scalp diseases. , 2013, Dermatologic clinics.

[5]  Liang-Bi Chen,et al.  DeepCrash: A Deep Learning-Based Internet of Vehicles System for Head-On and Single-Vehicle Accident Detection With Emergency Notification , 2019, IEEE Access.

[6]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Wen-Huang Cheng,et al.  A Cloud-based Intelligent Skin and Scalp Analysis System , 2018, 2018 IEEE Visual Communications and Image Processing (VCIP).

[8]  Jing Zhao,et al.  An Optical Fiber-Based Data-Driven Method for Human Skin Temperature 3-D Mapping , 2019, IEEE Journal of Biomedical and Health Informatics.

[9]  Uwe Wollina,et al.  Folliculitis decalvans of the scalp: response to triple therapy with isotretinoin, clindamycin, and prednisolone. , 2006, Acta dermatovenerologica Alpina, Pannonica, et Adriatica.

[10]  Chu-Sing Yang,et al.  An intelligent hair and scalp analysis system using camera sensors and Norwood-Hamilton model , 2018 .

[11]  Liang-Bi Chen,et al.  A Deep Learning-Based Intelligent Medicine Recognition System for Chronic Patients , 2019, IEEE Access.

[12]  H. Allen,et al.  Scaling Scalp Diseases in Children , 1983, Clinical pediatrics.

[13]  Liang-Bi Chen,et al.  An Intelligent Scalp Inspection and Diagnosis System for Caring Hairy Scalp Health , 2018, 2018 IEEE 7th Global Conference on Consumer Electronics (GCCE).

[14]  Takashi Kitahara,et al.  The Scalp Has a Lower Stratum Corneum Function with a Lower Sensory Input than Other Areas of the Skin Evaluated by the Electrical Current Perception Threshold , 2015 .

[15]  Huang-Chia Shih.  An Unsupervised Hair Segmentation and Counting System in Microscopy Images , 2015, IEEE Sensors Journal.

[16]  Andrew Zisserman,et al.  Return of the Devil in the Details: Delving Deep into Convolutional Nets , 2014, BMVC.

[17]  Rob Fergus,et al.  Visualizing and Understanding Convolutional Networks , 2013, ECCV.

[18]  R. Rajput,et al.  Understanding Hair Loss due to Air Pollution and the Approach to Management , 2015 .

[19]  Liang-Bi Chen,et al.  MedGlasses: A Wearable Smart-Glasses-Based Drug Pill Recognition System Using Deep Learning for Visually Impaired Chronic Patients , 2020, IEEE Access.

[20]  Reza Zoughi,et al.  Millimeter Wave Reflectometry and Imaging for Noninvasive Diagnosis of Skin Burn Injuries , 2017, IEEE Transactions on Instrumentation and Measurement.

[21]  Eenjun Hwang,et al.  Evaluation of Hair and Scalp Condition Based on Microscopy Image Analysis , 2017, 2017 International Conference on Platform Technology and Service (PlatCon).

[22]  Ayyaz Hussain,et al.  Classification of Melanoma and Nevus in Digital Images for Diagnosis of Skin Cancer , 2019, IEEE Access.

[23]  Iván González-Díaz,et al.  DermaKNet: Incorporating the Knowledge of Dermatologists to Convolutional Neural Networks for Skin Lesion Diagnosis , 2019, IEEE Journal of Biomedical and Health Informatics.

[24]  Wei Liu,et al.  SSD: Single Shot MultiBox Detector , 2015, ECCV.

[25]  Giuseppe Micali,et al.  Scalp dermoscopy or trichoscopy. , 2015, Current problems in dermatology.

[26]  Joachim Oberhammer,et al.  Long-Term Monitoring of Skin Recovery by Micromachined Microwave Near-Field Probe , 2017, IEEE Microwave and Wireless Components Letters.

[27]  Sergey Ioffe,et al.  Inception-v4, Inception-ResNet and the Impact of Residual Connections on Learning , 2016, AAAI.

[28]  Jesús Bescós,et al.  Accurate Segmentation and Registration of Skin Lesion Images to Evaluate Lesion Change , 2019, IEEE Journal of Biomedical and Health Informatics.

[29]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[30]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Fadi Dornaika,et al.  Deep Learning based Detection of Hair Loss Levels from Facial Images , 2019, 2019 Ninth International Conference on Image Processing Theory, Tools and Applications (IPTA).

[32]  Laurent Misery,et al.  Epidemiology of dandruff, scalp pruritus and associated symptoms. , 2013, Acta dermato-venereologica.

[33]  Liang-Bi Chen,et al.  A Mobile Device-Based Hairy Scalp Diagnosis System Using Deep Learning Techniques , 2020, 2020 IEEE 2nd Global Conference on Life Sciences and Technologies (LifeTech).

[34]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[35]  Huang-Chia Shih,et al.  Hair segmentation and counting algorithms in microscopy image , 2015, 2015 IEEE International Conference on Consumer Electronics (ICCE).

[36]  Jun Zhou,et al.  Progressive Transfer Learning and Adversarial Domain Adaptation for Cross-Domain Skin Disease Classification , 2020, IEEE Journal of Biomedical and Health Informatics.

[37]  Z. Jane Wang,et al.  Automated Detection and Segmentation of Vascular Structures of Skin Lesions Seen in Dermoscopy, With an Application to Basal Cell Carcinoma Classification , 2017, IEEE Journal of Biomedical and Health Informatics.