Gabor barcodes for medical image retrieval

In recent years, advances in medical imaging have led to the emergence of massive databases, containing images from a diverse range of modalities. This has significantly heightened the need for automated annotation of the images on one side, and fast and memory-efficient content-based image retrieval systems on the other side. Binary descriptors have recently gained more attention as a potential vehicle to achieve these goals. One of the recently introduced binary descriptors for tagging of medical images are Radon barcodes (RBCs) that are driven from Radon transform via local thresholding. Gabor transform is also a powerful transform to extract texture-based information. Gabor features have exhibited robustness against rotation, scale, and also photometric disturbances, such as illumination changes and image noise in many applications. This paper introduces Gabor Barcodes (GBCs), as a novel framework for the image annotation. To find the most discriminative GBC for a given query image, the effects of employing Gabor filters with different parameters, i.e., different sets of scales and orientations, are investigated, resulting in different barcode lengths and retrieval performances. The proposed method has been evaluated on the IRMA dataset with 193 classes comprising of 12,677 x-ray images for indexing, and 1,733 x-rays images for testing. A total error score as low as 351 (≈ 80% accuracy for the first hit) was achieved.

[1]  Arun K. Pujari,et al.  A modified Gabor function for content based image retrieval , 2007, Pattern Recognit. Lett..

[2]  Shawn Newsam,et al.  A texture descriptor for image retrieval and browsing , 1999, Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries (CBAIVL'99).

[3]  Anil K. Jain,et al.  Markov Random Field Texture Models , 1983, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Marina Bosch,et al.  ImageCLEF, Experimental Evaluation in Visual Information Retrieval , 2010 .

[5]  Mehrdad J. Gangeh,et al.  Tumour ROI estimation in ultrasound images via radon barcodes in patients with locally advanced breast cancer , 2016, 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI).

[6]  Johan Montagnat,et al.  Texture based medical image indexing and retrieval: application to cardiac imaging , 2004, MIR '04.

[7]  Seong-Hoon Kim,et al.  X-ray Image Classification Using Random Forests with Local Wavelet-Based CS-Local Binary Patterns , 2011, Journal of Digital Imaging.

[8]  Shutao Li,et al.  Comparison and fusion of multiresolution features for texture classification , 2004, Proceedings of 2004 International Conference on Machine Learning and Cybernetics (IEEE Cat. No.04EX826).

[9]  Anil K. Jain,et al.  Object detection using gabor filters , 1997, Pattern Recognit..

[10]  Barbara Caputo,et al.  Overview of the CLEF 2009 Medical Image Annotation Track , 2009, CLEF.

[11]  Tomasz Andrysiak,et al.  Image retrieval based on hierarchical Gabor filters , 2005 .

[12]  Dennis F. Dunn,et al.  Optimal Gabor filters for texture segmentation , 1995, IEEE Trans. Image Process..

[13]  Saman A. Zonouz,et al.  CloudID: Trustworthy cloud-based and cross-enterprise biometric identification , 2015, Expert Syst. Appl..

[14]  Anil K. Jain,et al.  Unsupervised texture segmentation using Gabor filters , 1990, 1990 IEEE International Conference on Systems, Man, and Cybernetics Conference Proceedings.

[15]  Kai-Kuang Ma,et al.  Rotation-invariant and scale-invariant Gabor features for texture image retrieval , 2007, Image Vis. Comput..

[16]  Thomas Deselaers,et al.  A Content-Based Approach to Image Retrieval in Medical Applications , 2006 .

[17]  Lianping Chen,et al.  Effects of different Gabor filters parameters on image retrieval by texture , 2004, 10th International Multimedia Modelling Conference, 2004. Proceedings..

[18]  Guojun Lu,et al.  Content-based Image Retrieval Using Gabor Texture Features , 2000 .

[19]  Joni-Kristian Kämäräinen,et al.  Invariance properties of Gabor filter-based features-overview and applications , 2006, IEEE Transactions on Image Processing.

[20]  Hamid R. Tizhoosh,et al.  Barcode annotations for medical image retrieval: A preliminary investigation , 2015, 2015 IEEE International Conference on Image Processing (ICIP).