Combining real-valued and binary Gabor-Radon features for classification and search in medical imaging archives

Content-based image retrieval (CBIR) of medical images in large datasets to identify similar images when a query image is given can be very useful in improving the diagnostic decision of the clinical experts and as well in educational scenarios. In this paper, we used two stage classification and retrieval approach to retrieve similar images. First, the Gabor filters are applied to Radon-transformed images to extract features and to train a multi-class SVM. Then based on the classification results and using an extracted Gabor barcode, similar images are retrieved. The proposed method was tested on IRMA dataset which contains more than 14,000 images. Experimental results show the efficiency of our approach in retrieving similar images compared to other Gabor-Radon-oriented methods.

[1]  Chang-Tsun Li,et al.  Effective Extraction of Gabor Features for Adaptive Mammogram Retrieval , 2007, 2007 IEEE International Conference on Multimedia and Expo.

[2]  JainRamesh,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000 .

[3]  Barbara Caputo,et al.  Overview of the CLEF 2009 Medical Image Annotation Track , 2009, CLEF.

[4]  Hamid R. Tizhoosh,et al.  Radon-Gabor barcodes for medical image retrieval , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[5]  Hamid R. Tizhoosh,et al.  Radon features and barcodes for medical image retrieval via SVM , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[6]  Tieniu Tan,et al.  Invariant texture segmentation via circular Gabor filters , 2002, Object recognition supported by user interaction for service robots.

[7]  Hamid R. Tizhoosh,et al.  Gabor barcodes for medical image retrieval , 2016, 2016 IEEE International Conference on Image Processing (ICIP).

[8]  Balasubramanian Raman,et al.  Center symmetric local binary co-occurrence pattern for texture, face and bio-medical image retrieval , 2015, J. Vis. Commun. Image Represent..

[9]  Corinna Cortes,et al.  Support-Vector Networks , 1995, Machine Learning.

[10]  Hamid R. Tizhoosh,et al.  Medical Image Classification via SVM Using LBP Features from Saliency-Based Folded Data , 2015, 2015 IEEE 14th International Conference on Machine Learning and Applications (ICMLA).

[11]  Henning Müller,et al.  The ImageCLEFmed Medical Image Retrieval Task Test Collection , 2009, Journal of Digital Imaging.

[12]  Daniel Fabbri,et al.  Toward content-based image retrieval with deep convolutional neural networks , 2015, Medical Imaging.

[13]  Hamid R. Tizhoosh,et al.  Generating binary tags for fast medical image retrieval based on convolutional nets and Radon Transform , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[14]  Hamid R. Tizhoosh,et al.  Barcode annotations for medical image retrieval: A preliminary investigation , 2015, 2015 IEEE International Conference on Image Processing (ICIP).

[15]  Roland Siegwart,et al.  BRISK: Binary Robust invariant scalable keypoints , 2011, 2011 International Conference on Computer Vision.

[16]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[17]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[18]  Quan Pan,et al.  Rotation and scaling invariant texture classification based on Radon transform and multiscale analysis , 2006, Pattern Recognit. Lett..

[19]  J. Radon.  On the determination of functions from their integral values along certain manifolds , 1986, IEEE Transactions on Medical Imaging.

[20]  Saso Dzeroski,et al.  Hierarchical annotation of medical images , 2011, Pattern Recognit..

[21]  Koby Crammer,et al.  On the Algorithmic Implementation of Multiclass Kernel-based Vector Machines , 2002, J. Mach. Learn. Res..

[22]  Andrew K. C. Wong,et al.  Binary codes for tagging x-ray images via deep de-noising autoencoders , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[23]  Arivazhagan Selvaraj,et al.  Texture classification using Gabor wavelets based rotation invariant features , 2006, Pattern Recognit. Lett..

[24]  Barbara Caputo,et al.  Discriminative cue integration for medical image annotation , 2008, Pattern Recognit. Lett..

[25]  Hayit Greenspan,et al.  X-ray Categorization and Retrieval on the Organ and Pathology Level, Using Patch-Based Visual Words , 2011, IEEE Transactions on Medical Imaging.