Dermatological expert system implementing the ABCD rule of dermoscopy for skin disease identification

Abstract Doctors and radiologists generally follow the standard ABCD rule of dermoscopy for differentiating the malignant and benign skin lesions. The estimation of the dermoscopic score by visual inspection only, may lead to the inaccurate diagnosis of the disease at an early stage. In this work, the ABCD attributes have been improvised and quantified in a dermatological expert system (DermESy) for the differentiation of malignant and benign lesions. DermESy, a rule based expert system has been developed by implementing dermatologist’s knowledge with proper quantification of the dermoscopic findings. Using DermESy, the dermoscopic images have been categorized as malignant, benign and suspicious lesions based on the estimated total dermoscopic score (TDS), similar to the findings of an expert. To estimate the TDS, shape, brightness and color variations are considered to modify the ‘A’ score. The color information extraction algorithm is introduced to extract significant color regions to quantify the ‘C’ score. To find the appropriate ‘D’ score of a skin lesion, dermoscopic structures segmentation algorithms have been introduced. In this work, the ABCD rule of dermoscopy has been improvised by considering the spatial properties of dermoscopic structures for improved identification of malignant lesions. An explanatory subsystem is implemented in DermESy to assist the dermatologist with proper in-detail visualization. DermESy has differentiated the benign and malignant skin lesions with 97.69% sensitivity, 97.97% specificity and 97.86% accuracy. The TDS evaluated by DermESy is verified and compared against expert dermatologist’s TDS scores of same dermoscopy images to establish the reliability and robustness of the proposed system.

[1]  Debangshu Dey,et al.  Integration of morphological preprocessing and fractal based feature extraction with recursive feature elimination for skin lesion types classification , 2019, Comput. Methods Programs Biomed..

[2]  Nadia Smaoui,et al.  A developed system for melanoma diagnosis , 2013 .

[3]  Balázs Harangi,et al.  Skin lesion detection based on an ensemble of deep convolutional neural network , 2017, J. Biomed. Informatics.

[4]  Robin Marks M.B.B.S. M.P.H..  An overview of skin cancers , 1995 .

[5]  Debangshu Dey,et al.  Optimal selection of features using wavelet fractal descriptors and automatic correlation bias reduction for classifying skin lesions , 2018, Biomed. Signal Process. Control..

[6]  Catarina Barata,et al.  A System for the Detection of Pigment Network in Dermoscopy Images Using Directional Filters , 2012, IEEE Transactions on Biomedical Engineering.

[7]  Dong-Hyun Kim,et al.  Multiple skin lesions diagnostics via integrated deep convolutional networks for segmentation and classification , 2020, Comput. Methods Programs Biomed..

[8]  Savy Gulati,et al.  Classification of Melanoma from Dermoscopic Images Using Machine Learning , 2019, Smart Intelligent Computing and Applications.

[9]  Iván González-Díaz,et al.  DermaKNet: Incorporating the Knowledge of Dermatologists to Convolutional Neural Networks for Skin Lesion Diagnosis , 2019, IEEE Journal of Biomedical and Health Informatics.

[10]  K Wolff,et al.  In vivo epiluminescence microscopy: improvement of early diagnosis of melanoma. , 1993, The Journal of investigative dermatology.

[11]  Debangshu Dey,et al.  Extraction of features from cross correlation in space and frequency domains for classification of skin lesions , 2019, Biomed. Signal Process. Control..

[12]  Debangshu Dey,et al.  Morphological operations with iterative rotation of structuring elements for segmentation of retinal vessel structures , 2019, Multidimens. Syst. Signal Process..

[13]  Ghassan Hamarneh,et al.  Fully Convolutional Neural Networks to Detect Clinical Dermoscopic Features , 2017, IEEE Journal of Biomedical and Health Informatics.

[14]  David Dagan Feng,et al.  Automated skin lesion segmentation via image-wise supervised learning and multi-scale superpixel based cellular automata , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[15]  Zhiguo Jiang,et al.  Skin lesion segmentation using high-resolution convolutional neural network , 2019, Comput. Methods Programs Biomed..

[16]  Begoña García Zapirain,et al.  Melanomas non-invasive diagnosis application based on the ABCD rule and pattern recognition image processing algorithms , 2011, Comput. Biol. Medicine.

[17]  Zhao Liu,et al.  A GAN-based image synthesis method for skin lesion classification , 2020, Comput. Methods Programs Biomed..

[18]  Reda Kasmi,et al.  Classification of malignant melanoma and benign skin lesions: implementation of automatic ABCD rule , 2016, IET Image Process..

[19]  Alain Pitiot,et al.  Fusing fine-tuned deep features for skin lesion classification , 2019, Comput. Medical Imaging Graph..

[20]  Robin Marks,et al.  An overview of skin cancers , 1995, Cancer.

[21]  Berta Martí Fuster,et al.  Computer-aided classification of suspicious pigmented lesions using wide-field images , 2020, Comput. Methods Programs Biomed..

[22]  Domenico Piccolo,et al.  Computer-automated ABCD versus dermatologists with different degrees of experience in dermoscopy , 2014, European Journal of Dermatology.

[23]  Yuan Zhang,et al.  Classification of melanoma based on feature similarity measurement for codebook learning in the bag-of-features model , 2019, Biomed. Signal Process. Control..

[24]  Ihab Zaqout,et al.  Diagnosis of Skin Lesions Based on Dermoscopic Images Using Image Processing Techniques , 2016, Pattern Recognition - Selected Methods and Applications.

[25]  Mai S. Mabrouk,et al.  Fully Automated Approach for Early Detection of Pigmented Skin Lesion Diagnosis Using ABCD , 2020, J. Heal. Informatics Res..

[26]  Ghassan Hamarneh,et al.  Seven-Point Checklist and Skin Lesion Classification Using Multitask Multimodal Neural Nets , 2019, IEEE Journal of Biomedical and Health Informatics.

[27]  Ming Chao,et al.  Improving Dermoscopic Image Segmentation With Enhanced Convolutional-Deconvolutional Networks , 2017, IEEE Journal of Biomedical and Health Informatics.

[28]  M. J. Katz,et al.  Fractals and the analysis of waveforms. , 1988, Computers in biology and medicine.

[29]  David Dagan Feng,et al.  Step-wise integration of deep class-specific learning for dermoscopic image segmentation , 2019, Pattern Recognit..

[30]  Amitava Chatterjee,et al.  Cross-correlation aided support vector machine classifier for classification of EEG signals , 2009, Expert Syst. Appl..

[31]  Wei Song,et al.  Automatic skin lesion segmentation based on FC-DPN , 2020, Comput. Biol. Medicine.

[32]  Amira S. Ashour,et al.  A novel cumulative level difference mean based GLDM and modified ABCD features ranked using eigenvector centrality approach for four skin lesion types classification , 2018, Comput. Methods Programs Biomed..

[33]  Mun-Taek Choi,et al.  Skin lesion segmentation in dermoscopy images via deep full resolution convolutional networks , 2018, Comput. Methods Programs Biomed..

[34]  W. Stolz,et al.  The ABCD rule of dermatoscopy. High prospective value in the diagnosis of doubtful melanocytic skin lesions. , 1994, Journal of the American Academy of Dermatology.

[35]  S. Süsstrunk,et al.  SLIC Superpixels ? , 2010 .

[36]  João Manuel R. S. Tavares,et al.  Effective features to classify skin lesions in dermoscopic images , 2017, Expert Syst. Appl..

[37]  Farideh Ebrahimi,et al.  A hierarchical structure based on Stacking approach for skin lesion classification , 2020, Expert Syst. Appl..

[38]  João Manuel R. S. Tavares,et al.  A computational approach for detecting pigmented skin lesions in macroscopic images , 2016, Expert Syst. Appl..

[39]  Shenghua Gao,et al.  CE-Net: Context Encoder Network for 2D Medical Image Segmentation , 2019, IEEE Transactions on Medical Imaging.

[40]  G. Argenziano,et al.  Epiluminescence microscopy for the diagnosis of doubtful melanocytic skin lesions. Comparison of the ABCD rule of dermatoscopy and a new 7-point checklist based on pattern analysis. , 1998, Archives of dermatology.

[41]  P. C. Siddalingaswamy,et al.  A methodological approach to classify typical and atypical pigment network patterns for melanoma diagnosis , 2018, Biomed. Signal Process. Control..