Transform domain representation-driven convolutional neural networks for skin lesion segmentation

Abstract Automated diagnosis systems provide a huge improvement in early detection of skin cancer, and consequently, contribute to successful treatment. Recent research on convolutional neural network has achieved enormous success in segmentation and object detection tasks. However, these networks require large amount of data that is a big challenge in medical domain where often have insufficient data and even a pretrained model on medical images can be hardly found. Lesion segmentation as the initial step of skin cancer analysis remains a challenging issue since datasets are small and include a variety of images in terms of light, color, scale, and marks which have led researchers to use extensive augmentation and preprocessing techniques or fine tuning the network with a pretrained model on irrelevant images. A segmentation model based on convolutional neural networks is proposed in this study for the tasks of skin lesion segmentation and dermoscopic feature segmentation. The network is trained from scratch and despite the small size of datasets neither excessive data augmentation nor any preprocessing to remove artifacts or enhance the images are applied. Alternatively, we investigated incorporating image representations of the transform domain to the convolutional neural network and compared to a model with more convolutional layers that resulted in 6% higher Jaccard index and has shorter training time. The model improved by applying CIELAB color space and the performance of the final proposed architecture is evaluated on publicly available datasets from ISBI challenges in 2016 and 2017. The proposed model has resulted in an improvement of as much as 7% for the segmentation metrics and 17% for the feature segmentation, which demonstrates the robustness of this unique hybrid framework and its future applications as well as further improvement.

[1]  Max Mignotte,et al.  Superpixel and multi‐atlas based fusion entropic model for the segmentation of X‐ray images , 2018, Medical Image Anal..

[2]  Hayit Greenspan,et al.  GAN-based Synthetic Medical Image Augmentation for increased CNN Performance in Liver Lesion Classification , 2018, Neurocomputing.

[3]  Alireza Behrad,et al.  Automatic liver segmentation in MRI images using an iterative watershed algorithm and artificial neural network , 2012, Biomed. Signal Process. Control..

[4]  Li Fei-Fei,et al.  ImageNet: A large-scale hierarchical image database , 2009, CVPR.

[5]  Stephen W Dusza,et al.  The CASH (color, architecture, symmetry, and homogeneity) algorithm for dermoscopy. , 2007, Journal of the American Academy of Dermatology.

[6]  Dagan Feng,et al.  Dermoscopic Image Segmentation via Multistage Fully Convolutional Networks , 2017, IEEE Transactions on Biomedical Engineering.

[7]  Balázs Harangi,et al.  Skin lesion detection based on an ensemble of deep convolutional neural network , 2017, J. Biomed. Informatics.

[8]  W. Stolz,et al.  The ABCD rule of dermatoscopy. High prospective value in the diagnosis of doubtful melanocytic skin lesions. , 1994, Journal of the American Academy of Dermatology.

[9]  João Paulo Papa,et al.  Computational methods for the image segmentation of pigmented skin lesions: A review , 2016, Comput. Methods Programs Biomed..

[10]  Hayit Greenspan,et al.  Deep learning with non-medical training used for chest pathology identification , 2015, Medical Imaging.

[11]  Yoshua Bengio,et al.  Understanding the difficulty of training deep feedforward neural networks , 2010, AISTATS.

[12]  Ian D. Reid,et al.  RefineNet: Multi-path Refinement Networks for High-Resolution Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[13]  Marcin Ciecholewski,et al.  An edge-based active contour model using an inflation/deflation force with a damping coefficient , 2016, Expert Syst. Appl..

[14]  Ling Shao,et al.  Automated lesion segmentation and dermoscopic feature segmentation for skin cancer analysis , 2017, 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[15]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[16]  Nitish Srivastava,et al.  Dropout: a simple way to prevent neural networks from overfitting , 2014, J. Mach. Learn. Res..

[17]  Paul W. Fieguth,et al.  Automatic Skin Lesion Segmentation via Iterative Stochastic Region Merging , 2011, IEEE Transactions on Information Technology in Biomedicine.

[18]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Arkadiusz Kwasigroch,et al.  Deep neural networks approach to skin lesions classification — A comparative analysis , 2017, 2017 22nd International Conference on Methods and Models in Automation and Robotics (MMAR).

[20]  Kouhyar Tavakolian,et al.  Effect of Lesion Segmentation in Melanoma Diagnosis for a Mobile Health Application , 2017 .

[21]  Raheel Nawaz,et al.  Active Contours Based Segmentation and Lesion Periphery Analysis for Characterization of Skin Lesions in Dermoscopy Images , 2019, IEEE Journal of Biomedical and Health Informatics.

[22]  Tian Zhang,et al.  Understanding Mixup Training Methods , 2018, IEEE Access.

[23]  James Bailey,et al.  Computer-Aided Diagnosis of Melanoma Using Border- and Wavelet-Based Texture Analysis , 2012, IEEE Transactions on Information Technology in Biomedicine.

[24]  Mun-Taek Choi,et al.  Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks , 2018, Comput. Methods Programs Biomed..

[25]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[26]  Palaniappan Mirunalini,et al.  Automated skin lesion segmentation of dermoscopic images using GrabCut and k-means algorithms , 2018, IET Comput. Vis..

[27]  A. Jemal,et al.  Cancer statistics, 2018 , 2018, CA: a cancer journal for clinicians.

[28]  Camille Couprie,et al.  Learning Hierarchical Features for Scene Labeling , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  Minh N. Do,et al.  Ieee Transactions on Image Processing the Contourlet Transform: an Efficient Directional Multiresolution Image Representation , 2022 .

[30]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[31]  Yoshua Bengio,et al.  The One Hundred Layers Tiramisu: Fully Convolutional DenseNets for Semantic Segmentation , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[32]  Luca Maria Gambardella,et al.  Mitosis Detection in Breast Cancer Histology Images with Deep Neural Networks , 2013, MICCAI.

[33]  Ali Gooya,et al.  Supervised Saliency Map Driven Segmentation of Lesions in Dermoscopic Images , 2017, IEEE Journal of Biomedical and Health Informatics.

[34]  Luca Maria Gambardella,et al.  Deep Neural Networks Segment Neuronal Membranes in Electron Microscopy Images , 2012, NIPS.

[35]  Norhayati Daut,et al.  Exploring Edge-Based Segmentation Towards Automated Skin Lesion Diagnosis , 2018 .

[36]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[37]  Babak Mohammadzadeh Asl,et al.  Melanoma recognition in dermoscopy images using lesion's peripheral region information , 2018, Comput. Methods Programs Biomed..

[38]  Daniel L. Rubin,et al.  Differential Data Augmentation Techniques for Medical Imaging Classification Tasks , 2017, AMIA.

[39]  Jacob Scharcanski,et al.  A simple weighted thresholding method for the segmentation of pigmented skin lesions in macroscopic images , 2017, Pattern Recognit..

[40]  Jesús Bescós,et al.  Accurate Segmentation and Registration of Skin Lesion Images to Evaluate Lesion Change , 2019, IEEE Journal of Biomedical and Health Informatics.