Deep Semantic Segmentation and Multi-Class Skin Lesion Classification Based on Convolutional Neural Network

Skin cancer is developed due to abnormal cell growth. These cells are grown rapidly and destroy the normal skin cells. However, it’s curable at an initial stage to reduce the patient’s mortality rate. In this article, the method is proposed for localization, segmentation and classification of the skin lesion at an early stage. The proposed method contains three phases. In phase I, different types of the skin lesion are localized using tinyYOLOv2 model in which open neural network (ONNX) and squeeze Net model are used as a backbone. The features are extracted from depthconcat7 layer of squeeze Net and passed as an input to the tinyYOLOv2. The propose model accurately localize the affected part of the skin. In Phase II, 13-layer 3D-semantic segmentation model (01 input, 04 convolutional, 03 batch-normalization, 03 ReLU, softmax and pixel classification) is used for segmentation. In the proposed segmentation model, pixel classification layer is used for computing the overlap region between the segmented and ground truth images. Later in Phase III, extract deep features using ResNet-18 model and optimized features are selected using ant colony optimization (ACO) method. The optimized features vector is passed to the classifiers such as optimized (O)-SVM and O-NB. The proposed method is evaluated on the top MICCAI ISIC challenging 2017, 2018 and 2019 datasets. The proposed method accurately localized, segmented and classified the skin lesion at an early stage.

[1]  Jasjit S Suri,et al.  State-of-the-art review on deep learning in medical imaging. , 2019, Frontiers in bioscience.

[2]  Randy H. Moss,et al.  Automatic lesion boundary detection in dermoscopy images using gradient vector flow snakes , 2005, Skin research and technology : official journal of International Society for Bioengineering and the Skin (ISBS) [and] International Society for Digital Imaging of Skin (ISDIS) [and] International Society for Skin Imaging.

[3]  Rafael García,et al.  Computerized analysis of pigmented skin lesions: A review , 2012, Artif. Intell. Medicine.

[4]  Q Abbas,et al.  Automatic skin tumour border detection for digital dermoscopy using a new digital image analysis scheme , 2010, British journal of biomedical science.

[5]  Reda Kasmi,et al.  Classification of malignant melanoma and benign skin lesions: implementation of automatic ABCD rule , 2016, IET Image Process..

[6]  Forrest N. Iandola,et al.  SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <1MB model size , 2016, ArXiv.

[7]  Ghassan Hamarneh,et al.  Star Shape Prior in Fully Convolutional Networks for Skin Lesion Segmentation , 2018, MICCAI.

[8]  Md. Kamrul Hasan,et al.  DSNet: Automatic Dermoscopic Skin Lesion Segmentation , 2019, Comput. Biol. Medicine.

[9]  D M Parkin,et al.  Estimating the global cancer incidence and mortality in 2018: GLOBOCAN sources and methods , 2018, International journal of cancer.

[10]  Tim K. Lee,et al.  MEASURING BORDER IRREGULARITY AND SHAPE OF CUTANEOUS MELANOCYTIC LESIONS , 2001 .

[11]  Xiaojing Yuan,et al.  SVM-based Texture Classification and Application to Early Melanoma Detection , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[12]  Yudong Zhang,et al.  Cerebral micro‐bleeding identification based on a nine‐layer convolutional neural network with stochastic pooling , 2019, Concurr. Comput. Pract. Exp..

[13]  Palak Mehta,et al.  Review on Techniques and Steps of Computer Aided Skin Cancer Diagnosis , 2016 .

[14]  Sebastian Thrun,et al.  Dermatologist-level classification of skin cancer with deep neural networks , 2017, Nature.

[15]  R. Marks,et al.  Epidemiology of melanoma , 2000, Clinical and experimental dermatology.

[16]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[17]  Ying Fang,et al.  Automatic Detection of Diabetic Retinopathy with Statistical Method and Bayesian Classifier , 2020, J. Medical Imaging Health Informatics.

[18]  Gerald Schaefer,et al.  Colour and contrast enhancement for improved skin lesion segmentation , 2011, Comput. Medical Imaging Graph..

[19]  Mun-Taek Choi,et al.  Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks , 2018, Comput. Methods Programs Biomed..

[20]  Li Zhang,et al.  Intelligent skin cancer detection using enhanced particle swarm optimization , 2018, Knowl. Based Syst..

[21]  Noel C. F. Codella,et al.  Skin lesion analysis toward melanoma detection: A challenge at the 2017 International symposium on biomedical imaging (ISBI), hosted by the international skin imaging collaboration (ISIC) , 2016, 2018 IEEE 15th International Symposium on Biomedical Imaging (ISBI 2018).

[22]  D. Ruppert The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2004 .

[23]  Ammara Masood,et al.  Computer Aided Diagnostic Support System for Skin Cancer: A Review of Techniques and Algorithms , 2013, Int. J. Biomed. Imaging.

[24]  G. Guy,et al.  Surgeon General’s Call to Action to Prevent Skin Cancer , 2014, Morbidity and Mortality Weekly Report.

[25]  João Paulo Papa,et al.  Computational methods for pigmented skin lesion classification in images: review and future trends , 2018, Neural Computing and Applications.

[26]  Dong-Hyun Kim,et al.  Multiple skin lesions diagnostics via integrated deep convolutional networks for segmentation and classification , 2020, Comput. Methods Programs Biomed..

[27]  Khalid M. Hosny,et al.  Skin Lesions Classification Into Eight Classes for ISIC 2019 Using Deep Convolutional Neural Network and Transfer Learning , 2020, IEEE Access.

[28]  Mohamed M. Foaud,et al.  Classification of skin lesions using transfer learning and augmentation with Alex-net , 2019, PloS one.

[29]  Nello Cristianini,et al.  An Introduction to Support Vector Machines and Other Kernel-based Learning Methods , 2000 .

[30]  Dr. Kailash Shaw,et al.  Skin Lesion Analysis towards Melanoma Detection , 2018 .

[31]  Suresh Manandhar,et al.  Focusnet: An Attention-Based Fully Convolutional Network for Medical Image Segmentation , 2019, 2019 IEEE 16th International Symposium on Biomedical Imaging (ISBI 2019).

[32]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[33]  Md Ashraful Alam Milton Automated Skin Lesion Classification Using Ensemble of Deep Neural Networks in ISIC 2018: Skin Lesion Analysis Towards Melanoma Detection Challenge , 2019, ArXiv.

[34]  Tanzila Saba,et al.  A comparative study of features selection for skin lesion detection from dermoscopic images , 2019, Network Modeling Analysis in Health Informatics and Bioinformatics.

[35]  Tong Zhang,et al.  An Introduction to Support Vector Machines and Other Kernel-Based Learning Methods , 2001, AI Mag..

[36]  K. P. Sanal Kumar,et al.  Detection of Skin Cancer Using SVM, Random Forest and kNN Classifiers , 2019, Journal of Medical Systems.

[37]  Shuihua Wang,et al.  Cerebral Micro-Bleeding Detection Based on Densely Connected Neural Network , 2019, Front. Neurosci..

[38]  Suresh Chandra Satapathy,et al.  An integrated design of particle swarm optimization (PSO) with fusion of features for detection of brain tumor , 2020, Pattern Recognit. Lett..

[39]  Yingli Tian,et al.  A Heuristic Neural Network Structure Relying on Fuzzy Logic for Images Scoring , 2020, IEEE Transactions on Fuzzy Systems.

[40]  Mingyao Li,et al.  Skin Cancer Diagnosis Based on Support Vector Machine and a New Optimization Algorithm , 2020 .