The Effects of Image Pre- and Post-Processing, Wavelet Decomposition, and Local Binary Patterns on U-Nets for Skin Lesion Segmentation

Skin cancer is a widespread, global, and potentially deadly disease, which over the last three decades has afflicted more lives in the USA than all other forms of cancer combined. There have been a lot of promising recent works utilizing deep network architectures, such as FCNs, U-Nets, and ResNets, for developing automated skin lesion segmentation. This paper investigates various pre- and post-processing techniques for improving the performance of U-Nets as measured by the Jaccard Index. The dataset provided as part of the “2017 ISBI Challenges on Skin Lesion Analysis Towards Melanoma Detection” was used for this evaluation and the performance of the finalist competitors was the standard for comparison. The pre-processing techniques employed in the proposed system included contrast enhancement, artifact removal, and vignette correction. More advanced image transformations, such as local binary patterns and wavelet decomposition, were also employed to augment the raw grayscale images used as network input features. While the performance of the proposed system fell short of the winners of the challenge, it was determined that using wavelet decomposition as an early transformation step improved the overall performance of the system over pre- and post-processing steps alone.

[1]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[2]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[3]  J. Akhtar,et al.  Image Compression with Different Types of Wavelets , 2006, 2006 International Conference on Emerging Technologies.

[4]  Zhu Xizhi,et al.  The Application of Wavelet Transform in Digital Image Processing , 2008, 2008 International Conference on MultiMedia and Information Technology.

[5]  Xiaohe Chen,et al.  Watershed segmentation of dermoscopy images using a watershed technique , 2010, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[6]  Saeid Nahavandi,et al.  Skin melanoma segmentation using recurrent and convolutional neural networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[7]  Matt Berseth,et al.  ISIC 2017 - Skin Lesion Analysis Towards Melanoma Detection , 2017, ArXiv.

[8]  T Lee,et al.  Dullrazor®: A software approach to hair removal from images , 1997, Comput. Biol. Medicine.

[9]  David Dagan Feng,et al.  Semi-automatic skin lesion segmentation via fully convolutional networks , 2017, 2017 IEEE 14th International Symposium on Biomedical Imaging (ISBI 2017).

[10]  Olaf Ronneberger,et al.  Invited Talk: U-Net Convolutional Networks for Biomedical Image Segmentation , 2017, Bildverarbeitung für die Medizin.

[11]  Eduardo Valle,et al.  RECOD Titans at ISIC Challenge 2017 , 2017, ArXiv.

[12]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Huiyu Zhou,et al.  A State-of-the-Art Survey on Lesion Border Detection in Dermoscopy Images , 2015 .

[15]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[17]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[18]  Hamid R. Tizhoosh,et al.  Skin lesion segmentation: U-Nets versus clustering , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[19]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[20]  Yoshua Bengio,et al.  Gradient-based learning applied to document recognition , 1998, Proc. IEEE.

[21]  S. Feldman,et al.  Incidence Estimate of Nonmelanoma Skin Cancer (Keratinocyte Carcinomas) in the U.S. Population, 2012. , 2015, JAMA dermatology.

[22]  Saeid Nahavandi,et al.  Spatially Aware Melanoma Segmentation Using Hybrid Deep Learning Techniques , 2017, ArXiv.

[23]  June K Robinson,et al.  Sun exposure, sun protection, and vitamin D. , 2005, JAMA.

[24]  Ming Chao,et al.  Improving Dermoscopic Image Segmentation With Enhanced Convolutional-Deconvolutional Networks , 2017, IEEE Journal of Biomedical and Health Informatics.

[25]  Hamid R. Tizhoosh,et al.  Barcode annotations for medical image retrieval: A preliminary investigation , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[26]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[27]  David Dagan Feng,et al.  Automatic Skin Lesion Analysis using Large-scale Dermoscopy Images and Deep Residual Networks , 2017, ArXiv.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  L. Cleaver.  Prevalence of a History of Skin Cancer in 2007: Results of an Incidence-Based Model , 2011 .

[30]  Chihway Chang,et al.  Radio frequency interference mitigation using deep convolutional neural networks , 2016, Astron. Comput..