iMSCGnet: Iterative Multi-Scale Context-Guided Segmentation of Skin Lesion in Dermoscopic Images

Despite much effort has been devoted to skin lesion segmentation, the performance of existing methods is still not satisfactory enough for practical applications. The challenges may include fuzzy lesion boundary, uneven and low contrast, and variation of colors across space, which often lead to fragmentary segmentation and inaccurate boundary. To alleviate this problem, we propose a multi-scale context-guided network named as MSCGnet to segment the skin lesions accurately. In MSCGnet, the context information is utilized to guide the feature encoding procedure. Moreover, because of the information loss in spatial down-sampling, a context-based attention structure (CAs) is designed to select effective context features in the decoding path. Furthermore, we boost the performance of MSCGnet with iterations and term this upgraded version as iterative MSCGnet, denoted as iMSCGnet. To supervise the training of iMSCGnet in an end-to-end fashion, a novel objective function of deep supervision, which consists of the terms of each encoding layers and the terms from each MSCGnet output of iMSCGnet, is employed. Our method is evaluated extensively on the four publicly available datasets, including ISBI2016 <xref ref-type="bibr" rid="ref1">[1]</xref>, ISBI2017 <xref ref-type="bibr" rid="ref2">[2]</xref>, ISIC2018 <xref ref-type="bibr" rid="ref3">[3]</xref> and PH2 <xref ref-type="bibr" rid="ref4">[4]</xref> datasets. The experimental results prove the effectiveness of proposed components and show that our method generally outperforms the state-of-the-art methods.

[1]  Zhiguo Jiang,et al.  Skin lesion segmentation using high-resolution convolutional neural network , 2019, Comput. Methods Programs Biomed..

[2]  Alauddin Bhuiyan,et al.  Automatic Segmentation of Dermoscopy Images Using Histogram Thresholding on Optimal Color Channels , 2011 .

[3]  João Manuel R. S. Tavares,et al.  A computational approach for detecting pigmented skin lesions in macroscopic images , 2016, Expert Syst. Appl..

[4]  David Dagan Feng,et al.  Step-wise integration of deep class-specific learning for dermoscopic image segmentation , 2019, Pattern Recognit..

[5]  Hao Chen,et al.  Automated Melanoma Recognition in Dermoscopy Images via Very Deep Residual Networks , 2017, IEEE Transactions on Medical Imaging.

[6]  Randy H. Moss,et al.  Automatic detection of blue-white veil and related structures in dermoscopy images , 2008, Comput. Medical Imaging Graph..

[7]  Petia Radeva,et al.  MobileGAN: Skin Lesion Segmentation Using a Lightweight Generative Adversarial Network , 2019, Expert Syst. Appl..

[8]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[9]  David Dagan Feng,et al.  Automatic Skin Lesion Analysis using Large-scale Dermoscopy Images and Deep Residual Networks , 2017, ArXiv.

[10]  Lei Chen,et al.  Attention-Based DenseUnet Network With Adversarial Training for Skin Lesion Segmentation , 2019, IEEE Access.

[11]  Manu Goyal,et al.  Skin Lesion Segmentation in Dermoscopic Images With Ensemble Deep Learning Methods , 2020, IEEE Access.

[12]  Randy H. Moss,et al.  A methodological approach to the classification of dermoscopy images , 2007, Comput. Medical Imaging Graph..

[13]  Kun Yu,et al.  DenseASPP for Semantic Segmentation in Street Scenes , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[14]  Xiaogang Wang,et al.  Pyramid Scene Parsing Network , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[16]  Andreas K. Maier,et al.  SkinNet: A Deep Learning Framework for Skin Lesion Segmentation , 2018, 2018 IEEE Nuclear Science Symposium and Medical Imaging Conference Proceedings (NSS/MIC).

[17]  Ming-Hsuan Yang,et al.  Scene Parsing with Global Context Embedding , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[18]  Jitendra Malik,et al.  Human Pose Estimation with Iterative Error Feedback , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[19]  Mun-Taek Choi,et al.  Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks , 2018, Comput. Methods Programs Biomed..

[20]  Enhua Wu,et al.  Squeeze-and-Excitation Networks , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  João Paulo Papa,et al.  Computational methods for the image segmentation of pigmented skin lesions: A review , 2016, Comput. Methods Programs Biomed..

[22]  Dani Lischinski,et al.  Multi-scale Context Intertwining for Semantic Segmentation , 2018, ECCV.

[23]  S. Menzies,et al.  Dermoscopy compared with naked eye examination for the diagnosis of primary melanoma: a meta‐analysis of studies performed in a clinical setting , 2008, The British journal of dermatology.

[24]  Zhuowen Tu,et al.  Auto-Context and Its Application to High-Level Vision Tasks and 3D Brain Image Segmentation , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[25]  Geoffrey E. Hinton,et al.  Dynamic Routing Between Capsules , 2017, NIPS.

[26]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[27]  Thomas Brox,et al.  3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation , 2016, MICCAI.

[28]  Suresh Manandhar,et al.  Focusnet: An Attention-Based Fully Convolutional Network for Medical Image Segmentation , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[29]  Ning Wang,et al.  Segmentation of dermoscopy image using adversarial networks , 2018, Multimedia Tools and Applications.

[30]  Jie Yu,et al.  DSM: A Deep Supervised Multi-Scale Network Learning for Skin Cancer Segmentation , 2019, IEEE Access.

[31]  Iasonas Kokkinos,et al.  DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs , 2016, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Yang Li,et al.  Automatic segmentation of dermoscopy images using saliency combined with Otsu threshold , 2017, Comput. Biol. Medicine.

[33]  Nima Tajbakhsh,et al.  UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentation , 2020, IEEE Transactions on Medical Imaging.

[34]  Yading Yuan,et al.  Improving Dermoscopic Image Segmentation With Enhanced Convolutional-Deconvolutional Networks , 2017, IEEE Journal of Biomedical and Health Informatics.

[35]  Petia Radeva,et al.  SLSDeep: Skin Lesion Segmentation Based on Dilated Residual and Pyramid Pooling Networks , 2018, MICCAI.

[36]  Pedro M. Ferreira,et al.  PH2 - A dermoscopic image database for research and benchmarking , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[37]  P. C. Siddalingaswamy,et al.  Techniques and algorithms for computer aided diagnosis of pigmented skin lesions - A review , 2018, Biomed. Signal Process. Control..

[38]  Hang Li,et al.  Dense Deconvolutional Network for Skin Lesion Segmentation , 2019, IEEE Journal of Biomedical and Health Informatics.

[39]  Vivek Kumar Singh,et al.  FCA-Net: Adversarial Learning for Skin Lesion Segmentation Based on Multi-Scale Features and Factorized Channel Attention , 2019, IEEE Access.

[40]  Harald Kittler,et al.  Domain-specific classification-pretrained fully convolutional network encoders for skin lesion segmentation , 2019, Comput. Biol. Medicine.

[41]  Matt Berseth,et al.  ISIC 2017 - Skin Lesion Analysis Towards Melanoma Detection , 2017, ArXiv.

[42]  J. Mayer,et al.  Systematic review of the diagnostic accuracy of dermatoscopy in detecting malignant melanoma , 1997, The Medical journal of Australia.

[43]  Noel C. F. Codella,et al.  Skin Lesion Analysis Toward Melanoma Detection 2018: A Challenge Hosted by the International Skin Imaging Collaboration (ISIC) , 2019, ArXiv.

[44]  Xiaoyan Sun,et al.  Context-Reinforced Semantic Segmentation , 2019, 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).

[45]  Hang Li,et al.  Segmentation of breast anatomy for automated whole breast ultrasound images with boundary regularized convolutional encoder-decoder network , 2018, Neurocomputing.

[46]  Feng Yang,et al.  A Multi-Stage Framework With Context Information Fusion Structure For Skin Lesion Segmentation , 2018, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[47]  A. Jemal,et al.  Cancer statistics, 2019 , 2019, CA: a cancer journal for clinicians.

[48]  Hao Chen,et al.  3D deeply supervised network for automated segmentation of volumetric medical images , 2017, Medical Image Anal..

[49]  Shaoting Zhang,et al.  Automated Segmentation of Skin Lesion Based on Pyramid Attention Network , 2019, MLMI@MICCAI.

[50]  Dagan Feng,et al.  Dermoscopic Image Segmentation via Multistage Fully Convolutional Networks , 2017, IEEE Transactions on Biomedical Engineering.

[51]  Xiaogang Wang,et al.  Context Encoding for Semantic Segmentation , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[52]  Seyed-Ahmad Ahmadi,et al.  V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation , 2016, 2016 Fourth International Conference on 3D Vision (3DV).

[53]  Jeffrey E Gershenwald,et al.  Final version of 2009 AJCC melanoma staging and classification. , 2009, Journal of clinical oncology : official journal of the American Society of Clinical Oncology.

[54]  Hazim Kemal Ekenel,et al.  DermoNet: densely linked convolutional neural network for efficient skin lesion segmentation , 2019, EURASIP J. Image Video Process..

[55]  Yading Yuan,et al.  Automatic Skin Lesion Segmentation Using Deep Fully Convolutional Networks With Jaccard Distance , 2017, IEEE Transactions on Medical Imaging.

[56]  Jie Liu,et al.  Segmentation of dermoscopy images based on fully convolutional neural network , 2017, 2017 IEEE International Conference on Image Processing (ICIP).

[57]  Paul W. Fieguth,et al.  Automatic Skin Lesion Segmentation via Iterative Stochastic Region Merging , 2011, IEEE Transactions on Information Technology in Biomedicine.

[58]  R Kasmi,et al.  Biologically inspired skin lesion segmentation using a geodesic active contour technique , 2016, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[59]  Trevor Darrell,et al.  Fully Convolutional Networks for Semantic Segmentation , 2017, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[60]  Ebrahim Nasr-Esfahani,et al.  Dense Pooling layers in Fully Convolutional Network for Skin Lesion Segmentation , 2017 .

[61]  Xiaoming Liu,et al.  Dense-Residual Network With Adversarial Learning for Skin Lesion Segmentation , 2019, IEEE Access.

[62]  Thomas Brox,et al.  U-Net: Convolutional Networks for Biomedical Image Segmentation , 2015, MICCAI.

[63]  Ghassan Hamarneh,et al.  CONVOLUTIONAL NEURAL NETWORK FOR SKIN LESION SEGMENTATION , 2018 .

[64]  Prabir Bhattacharya,et al.  Developing a retrieval based diagnostic aid for automated melanoma recognition of dermoscopic images , 2016, 2016 IEEE Applied Imagery Pattern Recognition Workshop (AIPR).

[65]  Zhuowen Tu,et al.  Deeply-Supervised Nets , 2014, AISTATS.

[66]  Martial Hebert,et al.  Learning message-passing inference machines for structured prediction , 2011, CVPR 2011.

[67]  Josiane Zerubia,et al.  Skin image illumination modeling and chromophore identification for melanoma diagnosis , 2015, Physics in medicine and biology.