ICARUS: Retrieving Skin Ulcer Images through Bag-of-Signatures

The images collected during medical exams are a strong asset for diagnosing and decision making. One scenario where clinical images are especially useful is the analysis of chronic lesions on the skin (skin ulcers). The visual appearance of these wounds may provide meaningful clues that may help physicians in the diagnosis. In this context, we propose ICARUS, an image retrieval system for dermatological ulcer images based on Bag-of-Visual-Words of color and texture signatures. ICARUS analyzes the image and extracts only the relevant signatures. The results show that ICARUS achieves improvement of up to 7% in image retrieval precision whereas being up to 5 orders of magnitude faster when compared to the state-of-the-art methods. Our results showed that ICARUS is effective and fast, and successfully adds semantic to the image representation.

[1]  Arnaldo de Albuquerque Araújo,et al.  Representing local binary descriptors with BossaNova for visual recognition , 2014, SAC.

[2]  Rangaraj M. Rangayyan,et al.  Color image processing and content-based image retrieval techniques for the analysis of dermatological lesions , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[3]  Rangaraj M. Rangayyan,et al.  Characterization and pattern recognition of color images of dermatological ulcers - a pilot study , 2014, Comput. Sci. J. Moldova.

[4]  Gongping Yang,et al.  Finger Vein Image Retrieval via Coding Scale-varied Superpixel Feature , 2017, ICMR.

[5]  A. Hoppe,et al.  Analysis of Skin Wound Images Using Digital Color Image Processing: A Preliminary Communication , 2004, The international journal of lower extremity wounds.

[6]  C. V. Jawahar,et al.  Blocks That Shout: Distinctive Parts for Scene Classification , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[7]  Agma J. M. Traina,et al.  BoSS: image retrieval using bag-of-superpixels signatures , 2018, SAC.

[8]  Cordelia Schmid,et al.  Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search , 2008, ECCV.

[9]  Christos Faloutsos,et al.  Fast Feature Selection using Fractal Dimension - Ten Years Later , 2010, J. Inf. Data Manag..

[10]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Ricardo da Silva Torres,et al.  A signature-based bag of visual words method for image indexing and search , 2015, Pattern Recognit. Lett..

[12]  Agma J. M. Traina,et al.  A Label-Scaled Similarity Measure for Content-Based Image Retrieval , 2016, 2016 IEEE International Symposium on Multimedia (ISM).

[13]  Rainer Lienhart,et al.  Bundle min-hashing for logo recognition , 2013, ICMR '13.

[14]  Cordelia Schmid,et al.  Aggregating Local Image Descriptors into Compact Codes , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[15]  Agma J. M. Traina,et al.  Color and Texture Influence on Computer-Aided Diagnosis of Dermatological Ulcers , 2015, 2015 IEEE 28th International Symposium on Computer-Based Medical Systems.

[16]  Shih-Fu Chang,et al.  Segmentation using superpixels: A bipartite graph partitioning approach , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[18]  Ricardo da Silva Torres,et al.  Color and texture applied to a signature-based bag of visual words method for image retrieval , 2017, Multimedia Tools and Applications.

[19]  Bram van Ginneken,et al.  A survey on deep learning in medical image analysis , 2017, Medical Image Anal..

[20]  Sylvio Barbon Junior,et al.  Pattern Recognition of Lower Member Skin Ulcers in Medical Images with Machine Learning Algorithms , 2015, 2015 IEEE 28th International Symposium on Computer-Based Medical Systems.

[21]  Min-Ling Zhang,et al.  A Review on Multi-Label Learning Algorithms , 2014, IEEE Transactions on Knowledge and Data Engineering.

[22]  Rangaraj M. Rangayyan,et al.  Segmentation and analysis of the tissue composition of dermatological ulcers , 2010, CCECE 2010.