Realistic Hair Simulation Using Image Blending

In this presented work, we propose a realistic hair simulator using image blending for dermoscopic images. This hair simulator can be used for benchmarking and validation of the hair removal methods and in data augmentation for improving computer aided diagnostic tools. We adopted one of the popular implementation of image blending to superimpose realistic hair masks to hair lesion. This method was able to produce realistic hair masks according to a predefined mask for hair. Thus, the produced hair images and masks can be used as ground truth for hair segmentation and removal methods by inpainting hair according to a pre-defined hair masks on hairfree areas. Also, we achieved a realism score equals to 1.65 in comparison to 1.59 for the state-of-the-art hair simulator.

[1]  Zhishun She,et al.  Simulation and analysis of optical skin lesion images , 2006, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[2]  Saeid Nahavandi,et al.  Body joints regression using deep convolutional neural networks , 2016, 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[3]  Alan C. Bovik,et al.  Automatic segmentation of dermoscopy images using self-generating neural networks seeded by genetic algorithm , 2013, Pattern Recognit..

[4]  Thomas Brox,et al.  Lucid Data Dreaming for Object Tracking , 2017, ArXiv.

[5]  Ahmad R. Sharafat,et al.  E-shaver: An improved DullRazor® for digitally removing dark and light-colored hairs in dermoscopic images , 2011, Comput. Biol. Medicine.

[6]  Yading Yuan,et al.  Automatic Skin Lesion Segmentation Using Deep Fully Convolutional Networks With Jaccard Distance , 2017, IEEE Transactions on Medical Imaging.

[7]  Matt Berseth,et al.  ISIC 2017 - Skin Lesion Analysis Towards Melanoma Detection , 2017, ArXiv.

[8]  Alexei A. Efros,et al.  Learning a Discriminative Model for the Perception of Realism in Composite Images , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[9]  James M. Rehg,et al.  Feature-preserving artifact removal from dermoscopy images , 2008, SPIE Medical Imaging.

[10]  Xuelong Li,et al.  Mean shift based gradient vector flow for image segmentation , 2013, Comput. Vis. Image Underst..

[11]  Philippe Schmid-Saugeona,et al.  Towards a computer-aided diagnosis system for pigmented skin lesions. , 2003, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[12]  Zhe Zhu,et al.  Avoiding bleeding in image blending , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[13]  Bekir Dizdaroglu,et al.  An improved method for color image editing , 2011, EURASIP J. Adv. Signal Process..

[14]  Kostas Delibasis,et al.  Hair removal on dermoscopy images , 2015, 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[15]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[16]  Saeid Nahavandi,et al.  Inpainting images with curvilinear structures propagation , 2014, Machine Vision and Applications.

[17]  Bernt Schiele,et al.  Learning People Detectors for Tracking in Crowded Scenes , 2013, 2013 IEEE International Conference on Computer Vision.

[18]  Nicholas Ayache,et al.  Model-Based Generation of Large Databases of Cardiac Images: Synthesis of Pathological Cine MR Sequences From Real Healthy Cases , 2018, IEEE Transactions on Medical Imaging.

[19]  Adam Huang,et al.  A robust hair segmentation and removal approach for clinical images of skin lesions , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[20]  Saeid Nahavandi,et al.  Skin melanoma segmentation using recurrent and convolutional neural networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[21]  Deva Ramanan,et al.  Articulated pose estimation with tiny synthetic videos , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[22]  Ghassan Hamarneh,et al.  Hair Enhancement in Dermoscopic Images Using Dual-Channel Quaternion Tubularness Filters and MRF-Based Multilabel Optimization , 2014, IEEE Transactions on Image Processing.

[23]  Yang Li,et al.  No-reference hair occlusion assessment for dermoscopy images based on distribution feature , 2015, Comput. Biol. Medicine.

[24]  Jana Kosecka,et al.  Synthesizing Training Data for Object Detection in Indoor Scenes , 2017, Robotics: Science and Systems.

[25]  Alexandru Telea,et al.  Effcient and Effective Automated Digital Hair Removal from Dermoscopy Images , 2016 .

[26]  Patrick Pérez,et al.  Poisson image editing , 2003, ACM Trans. Graph..

[27]  Qaisar Abbas,et al.  Unsupervised skin lesions border detection via two-dimensional image analysis , 2011, Comput. Methods Programs Biomed..

[28]  Xian Du,et al.  Hair segmentation using adaptive threshold from edge and branch length measures , 2017, Comput. Biol. Medicine.

[29]  Saeid Nahavandi,et al.  RGB-D human posture analysis for ergonomie studies using deep convolutional neural network , 2017, 2017 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[30]  Zhishun She,et al.  Simulation of optical skin lesion images , 2001, 2001 Conference Proceedings of the 23rd Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[31]  Shi-Yin Qin,et al.  PDE-based unsupervised repair of hair-occluded information in dermoscopy images of melanoma , 2009, Comput. Medical Imaging Graph..

[32]  Enoch Peserico,et al.  VirtualShave: Automated hair removal from digital dermatoscopic images , 2011, 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[33]  T Lee,et al.  Dullrazor®: A software approach to hair removal from images , 1997, Comput. Biol. Medicine.

[34]  Saeid Nahavandi,et al.  A kinect-based workplace postural analysis system using deep residual networks , 2017, 2017 IEEE International Systems Engineering Symposium (ISSE).

[35]  Qaisar Abbas,et al.  Hair removal methods: A comparative study for dermoscopy images , 2011, Biomed. Signal Process. Control..

[36]  Ralph R. Martin,et al.  A Comparative Study of Algorithms for Realtime Panoramic Video Blending , 2016, IEEE Transactions on Image Processing.

[37]  Chao Yang,et al.  Normalized face image generation with perceptron generative adversarial networks , 2018, 2018 IEEE 4th International Conference on Identity, Security, and Behavior Analysis (ISBA).

[38]  Alexandru Telea,et al.  Automated Digital Hair Removal by Threshold Decomposition and Morphological Analysis , 2015, ISMM.

[39]  Hassan Mohamed,et al.  Skin lesion segmentation using Gray Level Co-occurance Matrix , 2016 .

[40]  Saeid Nahavandi,et al.  Kangaroo Vehicle Collision Detection Using Deep Semantic Segmentation Convolutional Neural Network , 2016, 2016 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[41]  Thomas Brox,et al.  Lucid Data Dreaming for Video Object Segmentation , 2017, International Journal of Computer Vision.