An Encoder-Decoder CNN for Hair Removal in Dermoscopic Images

The process of removing occluding hair has a relevant role in the early and accurate diagnosis of skin cancer. It consists of detecting hairs and restore the texture below them, which is sporadically occluded. In this work, we present a model based on convolutional neural networks for hair removal in dermoscopic images. During the network's training, we use a combined loss function to improve the restoration ability of the proposed model. In order to train the CNN and to quantitatively validate their performance, we simulate the presence of skin hair in hairless images extracted from publicly known datasets such as the PH2, dermquest, dermis, EDRA2002, and the ISIC Data Archive. As far as we know, there is no other hair removal method based on deep learning. Thus, we compare our results with six state-of-the-art algorithms based on traditional computer vision techniques by means of similarity measures that compare the reference hairless image and the one with hair simulated. Finally, a statistical test is used to compare the methods. Both qualitative and quantitative results demonstrate the effectiveness of our network.

[1]  Ghassan Hamarneh,et al.  Hair Enhancement in Dermoscopic Images Using Dual-Channel Quaternion Tubularness Filters and MRF-Based Multilabel Optimization , 2014, IEEE Transactions on Image Processing.

[2]  Giuseppe Argenziano,et al.  Interactive Atlas of Dermoscopy (Book and CD-ROM) , 2000 .

[3]  A. Bovik,et al.  A universal image quality index , 2002, IEEE Signal Processing Letters.

[4]  A. Barnston Correspondence among the correlation, RMSE, and Heidke forecast verification measures; refinement of the Heidke score , 1992 .

[5]  Saeid Nahavandi,et al.  Realistic hair simulator for skin lesion images: A novel benchemarking tool , 2020, Artif. Intell. Medicine.

[6]  Alan C. Bovik,et al.  Mean squared error: Love it or leave it? A new look at Signal Fidelity Measures , 2009, IEEE Signal Processing Magazine.

[7]  Shiguang Shan,et al.  Deep Network Cascade for Image Super-resolution , 2014, ECCV.

[8]  Wangmeng Zuo,et al.  Deep Learning on Image Denoising: An overview , 2019, Neural Networks.

[9]  Hamid Reza Pourreza,et al.  An effective hair removal algorithm for dermoscopy images , 2013, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[10]  L. Rudin,et al.  Nonlinear total variation based noise removal algorithms , 1992 .

[11]  Ibtissam Bakkouri,et al.  Correction to: Computer-aided diagnosis (CAD) system based on multi-layer feature fusion network for skin lesion recognition in dermoscopy images , 2020, Multimedia Tools and Applications.

[12]  Shi-Yin Qin,et al.  PDE-based unsupervised repair of hair-occluded information in dermoscopy images of melanoma , 2009, Comput. Medical Imaging Graph..

[13]  Nikolay N. Ponomarenko,et al.  A NEW FULL-REFERENCE QUALITY METRICS BASED ON HVS , 2006 .

[14]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[15]  Manuel González-Hidalgo,et al.  Comparative Study of Dermoscopic Hair Removal Methods , 2019 .

[16]  Eero P. Simoncelli,et al.  Image quality assessment: from error visibility to structural similarity , 2004, IEEE Transactions on Image Processing.

[17]  M. G. Fleming,et al.  Dermoscopy of pigmented skin lesions: results of a consensus meeting via the Internet. , 2003, Journal of the American Academy of Dermatology.

[18]  Yoshua Bengio,et al.  Extracting and composing robust features with denoising autoencoders , 2008, ICML '08.

[19]  Jan Kautz,et al.  Loss Functions for Image Restoration With Neural Networks , 2017, IEEE Transactions on Computational Imaging.

[20]  G. Argenziano,et al.  Epiluminescence microscopy for the diagnosis of doubtful melanocytic skin lesions. Comparison of the ABCD rule of dermatoscopy and a new 7-point checklist based on pattern analysis. , 1998, Archives of dermatology.

[21]  Qaisar Abbas,et al.  Hair removal methods: A comparative study for dermoscopy images , 2011, Biomed. Signal Process. Control..

[22]  S. Menzies,et al.  Frequency and morphologic characteristics of invasive melanomas lacking specific surface microscopic features. , 1996, Archives of dermatology.

[23]  J. Mayer,et al.  Systematic review of the diagnostic accuracy of dermatoscopy in detecting malignant melanoma , 1997, The Medical journal of Australia.

[24]  Manuel González Hidalgo,et al.  Skin Hair Removal in Dermoscopic Images Using Soft Color Morphology , 2017, AIME.

[25]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[26]  Adam Huang,et al.  A robust hair segmentation and removal approach for clinical images of skin lesions , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).