Automatic Scale Severity Assessment Method in Psoriasis Skin Images Using Local Descriptors

Psoriasis is a chronic skin condition. Its clinical assessment involves four measures: erythema, scales, induration, and area. In this paper, we introduce a scale severity scoring framework for two-dimensional psoriasis skin images. Specifically, we leverage the bag-of-visual words (BoVWs) model for lesion feature extraction using superpixels as key points. BoVWs model is based on building a vocabulary with specific number of words (i.e., codebook size) by using a clustering algorithm with some local features extracted from a constructed set of key points. This is followed by three-class machine learning classifiers for scale scoring using support vector machine (SVM) and random forest. Besides, we examine eight different local color and texture descriptors, namely color histogram, local binary patterns, edge histogram descriptor, color layout descriptor, scalable color descriptor, color and edge directivity descriptor (CEDD), fuzzy color and texture histogram, and brightness and texture directionality histogram. Further, the selection of codebook and superpixel sizes are studied intensively. A psoriasis image set, consisting of 96 images, is used in this study. The conducted experiments show that color descriptors have the highest performance measures for scale severity scoring. This is followed by the combined color and texture descriptors, whereas texture-based descriptors come last. Moreover, K-means algorithm shows better results in vocabulary building than Gaussian mixed model, in terms of accuracy and computations time. Finally, the proposed method yields a scale severity scoring accuracy of ${{80.81\%}}$ using the following setup: a superpixel of size ${\text{15}} \times {\text{15}} \times {\text{3}}$, a combined color and texture descriptor (i.e., CEDD), a constructed codebook of size 128 using K-means, and SVM for scale scoring.

[1]  Lu Liu,et al.  Content-based image retrieval using color and texture fused features , 2011, Math. Comput. Model..

[2]  P. Mease The Psoriasis Symptom Inventory: An Effective Patient-reported Outcome Measure of Psoriasis Severity , 2015, The Journal of Rheumatology.

[3]  Luc Van Gool,et al.  Speeded-Up Robust Features (SURF) , 2008, Comput. Vis. Image Underst..

[4]  J. Platt Sequential Minimal Optimization : A Fast Algorithm for Training Support Vector Machines , 1998 .

[5]  Thomas Mensink,et al.  Improving the Fisher Kernel for Large-Scale Image Classification , 2010, ECCV.

[6]  Yiannis S. Boutalis,et al.  A hybrid scheme for fast and accurate image retrieval based on color descriptors , 2007 .

[7]  Mark Lebwohl,et al.  Psoriasis , 1906, The Lancet.

[8]  Ian H. Witten,et al.  The WEKA data mining software: an update , 2009, SKDD.

[9]  Bastian Leibe,et al.  Superpixels: An evaluation of the state-of-the-art , 2016, Comput. Vis. Image Underst..

[10]  Yiannis S. Boutalis,et al.  Content based radiology image retrieval using a fuzzy rule based scalable composite descriptor , 2009, Multimedia Tools and Applications.

[11]  Mathias Lux,et al.  Localizing global descriptors for content-based image retrieval , 2015, EURASIP Journal on Advances in Signal Processing.

[12]  R. Strohal,et al.  Psoriasis beyond the skin: a review of the literature on cardiometabolic and psychological co-morbidities of psoriasis , 2014, European Journal of Dermatology.

[13]  Jens Michael Carstensen,et al.  An image based system to automatically and objectivelly score the degreeof redness and scaling in psoriasi lesions. , 2004 .

[14]  Sašo Džeroski,et al.  Improved medical image modality classification using a combination of visual and textual features , 2015, Comput. Medical Imaging Graph..

[15]  Yiannis S. Boutalis,et al.  CEDD: Color and Edge Directivity Descriptor: A Compact Descriptor for Image Indexing and Retrieval , 2008, ICVS.

[16]  A. Kimball,et al.  Psoriasis: is the impairment to a patient’s life cumulative? , 2010, Journal of the European Academy of Dermatology and Venereology.

[17]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[18]  Gabriela Csurka,et al.  Visual categorization with bags of keypoints , 2002, eccv 2004.

[19]  H. A. Jalab,et al.  Compact Composite Descriptors for Content Based Image Retrieval , 2012, 2012 International Conference on Advanced Computer Science Applications and Technologies (ACSAT).

[20]  Leo Breiman,et al.  Random Forests , 2001, Machine Learning.

[21]  J. MacQueen Some methods for classification and analysis of multivariate observations , 1967 .

[22]  Yiannis S. Boutalis,et al.  Investigating the Behavior of Compact Composite Descriptors in Early Fusion, Late Fusion and Distributed Image Retrieval , 2010 .

[23]  Andrew Zisserman,et al.  Scene Classification Via pLSA , 2006, ECCV.

[24]  Thomas Sikora,et al.  The MPEG-7 visual standard for content description-an overview , 2001, IEEE Trans. Circuits Syst. Video Technol..

[25]  Li Fei-Fei,et al.  Towards total scene understanding: Classification, annotation and segmentation in an automatic framework , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[26]  Yiannis S. Boutalis,et al.  FCTH: Fuzzy Color and Texture Histogram - A Low Level Feature for Accurate Image Retrieval , 2008, 2008 Ninth International Workshop on Image Analysis for Multimedia Interactive Services.

[27]  Matti Pietikäinen,et al.  Local Binary Patterns for Still Images , 2011 .

[28]  Trevor Darrell,et al.  Efficient image matching with distributions of local invariant features , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Fei-Fei Li,et al.  Towards total scene understanding: Classification, annotation and segmentation in an automatic framework , 2009, CVPR.

[30]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[31]  Chong-Wah Ngo,et al.  Evaluating bag-of-visual-words representations in scene classification , 2007, MIR '07.

[32]  อนิรุธ สืบสิงห์,et al.  Data Mining Practical Machine Learning Tools and Techniques , 2014 .

[33]  Mohammad Aldeen,et al.  Automatic psoriasis lesion segmentation in two-dimensional skin images using multiscale superpixel clustering , 2017, Journal of medical imaging.

[34]  L. Fry An atlas of psoriasis , 1992 .

[35]  S. Feldman,et al.  Quality of life in patients with psoriasis , 2006, Health and quality of life outcomes.

[36]  Juan Lu,et al.  Automatic Scoring of Erythema and Scaling Severity in Psoriasis Diagnosis , 2012, Australasian Conference on Artificial Intelligence.

[37]  Michael Isard,et al.  Object retrieval with large vocabularies and fast spatial matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.