A unified learning framework for content based medical image retrieval using a statistical model

This paper presents a unified learning framework for heterogeneous medical image retrieval based on a Full Range Autoregressive Model (FRAR) with the Bayesian approach (BA). Using the unified framework, the color autocorrelogram, edge orientation autocorrelogram (EOAC) and micro-texture information of medical images are extracted. The EOAC is constructed in HSV color space, to circumvent the loss of edges due to spectral and chromatic variations. The proposed system employed adaptive binary tree based support vector machine (ABTSVM) for efficient and fast classification of medical images in feature vector space. The Manhattan distance measure of order one is used in the proposed system to perform a similarity measure in the classified and indexed feature vector space. The precision and recall (PR) method is used as a measure of performance in the proposed system. Short-term based relevance feedback (RF) mechanism is also adopted to reduce the semantic gap. The Experimental results reveal that the retrieval performance of the proposed system for heterogeneous medical image database is better than the existing systems at low computational and storage cost.

[1]  L. Rodney Long,et al.  SPIRS: A Web-based image retrieval system for large biomedical databases , 2009, Int. J. Medical Informatics.

[2]  Haifeng Xu,et al.  Content-based retrieval in picture archiving and communication systems , 2009, Journal of Digital Imaging.

[3]  L. Rodney Long,et al.  Landmarking and feature localization in spine x-rays , 2001, J. Electronic Imaging.

[4]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[5]  H. Müller,et al.  Informatics in radiology (infoRAD): benefits of content-based visual data access in radiology. , 2005, Radiographics : a review publication of the Radiological Society of North America, Inc.

[6]  Ricardo da Silva Torres,et al.  Comparative study of global color and texture descriptors for web image retrieval , 2012, J. Vis. Commun. Image Represent..

[7]  M. S. Sudhakar,et al.  An effective biomedical image retrieval framework in a fuzzy feature space employing Phase Congruency and GeoSOM , 2014, Appl. Soft Comput..

[8]  Bipin C. Desai,et al.  Medical image retrieval with probabilistic multi-class support vector machine classifiers and adaptive similarity fusion , 2008, Comput. Medical Imaging Graph..

[9]  S C Orphanoudakis,et al.  I2C: a system for the indexing, storage, and retrieval of medical images by content. , 1994, Medical informatics = Medecine et informatique.

[10]  Thomas Martin Deserno,et al.  A generic concept for the implementation of medical image retrieval systems , 2007, Int. J. Medical Informatics.

[11]  Ricky K. Taira,et al.  Knowledge-Based Image Retrieval with Spatial and Temporal Constructs , 1998, IEEE Trans. Knowl. Data Eng..

[12]  Nam Chul Kim,et al.  Content-Based Image Retrieval Using Multiresolution Color and Texture Features , 2008, IEEE Transactions on Multimedia.

[13]  Jing Huang,et al.  Image indexing using color correlograms , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[14]  Sung-Nien Yu,et al.  Similarity searching for chest CT images based on object features and spatial relation maps , 2004, The 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[15]  Cheng Wang,et al.  Adaptive binary tree for fast SVM multiclass classification , 2009, Neurocomputing.

[16]  Antoine Geissbühler,et al.  Erratum to "A review of content-based image retrieval systems in medical applications - Clinical benefits and future directions" [I. J. Medical Informatics 73 (1) (2004) 1-23] , 2009, Int. J. Medical Informatics.

[17]  R. Krishnamoorthi,et al.  A statistical framework based on a family of full range autoregressive models for edge extraction , 2007, Pattern Recognit. Lett..

[18]  Rudolf Hanka,et al.  Histological image retrieval based on semantic content analysis , 2003, IEEE Transactions on Information Technology in Biomedicine.

[19]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[20]  Yue Li,et al.  Mammogram retrieval through machine learning within BI-RADS standards , 2011, J. Biomed. Informatics.

[21]  Jamshid Shanbehzadeh,et al.  Image retrieval based on shape similarity by edge orientation autocorrelogram , 2003, Pattern Recognit..

[22]  Lei Zhang,et al.  Image retrieval based on micro-structure descriptor , 2011, Pattern Recognit..

[23]  Koushik Seetharaman,et al.  Texture characterization, representation, description, and classification based on full range Gaussian Markov random field model with Bayesian approach , 2013 .

[24]  Antoine Geissbühler,et al.  A Review of Content{Based Image Retrieval Systems in Medical Applications { Clinical Bene(cid:12)ts and Future Directions , 2022 .

[25]  George R. Thoma,et al.  A Learning-Based Similarity Fusion and Filtering Approach for Biomedical Image Retrieval Using SVM Classification and Relevance Feedback , 2011, IEEE Transactions on Information Technology in Biomedicine.

[26]  Bipin C. Desai,et al.  A unified image retrieval framework on local visual and semantic concept-based feature spaces , 2009, J. Vis. Commun. Image Represent..

[27]  Carla E. Brodley,et al.  ASSERT: A PHYSICIAN-IN-THE-LOOP CONTENT-BASED IMAGE RETRIEVAL SYSTEM FOR HRCT IMAGE DATABASES , 1999 .

[28]  Raj Jain,et al.  Algorithms and strategies for similarity retrieval , 1996 .

[29]  Hermann Ney,et al.  Automatic categorization of medical images for content-based retrieval and data mining. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[30]  Dimitris A. Karras,et al.  Computer-aided tumor detection in endoscopic video using color wavelet features , 2003, IEEE Transactions on Information Technology in Biomedicine.

[31]  Carla E. Brodley,et al.  ASSERT: A Physician-in-the-Loop Content-Based Retrieval System for HRCT Image Databases , 1999, Comput. Vis. Image Underst..

[32]  Hossein Nezamabadi-pour,et al.  Concept learning by fuzzy k-NN classification and relevance feedback for efficient image retrieval , 2009, Expert Syst. Appl..

[33]  Bipin C. Desai,et al.  A Framework for Medical Image Retrieval Using Machine Learning and Statistical Similarity Matching Techniques With Relevance Feedback , 2007, IEEE Transactions on Information Technology in Biomedicine.

[34]  Daekeun You,et al.  Multimodal biomedical image retrieval using hierarchical classification and modality fusion , 2013, International Journal of Multimedia Information Retrieval.

[35]  Hayit Greenspan,et al.  X-ray Categorization and Retrieval on the Organ and Pathology Level, Using Patch-Based Visual Words , 2011, IEEE Transactions on Medical Imaging.

[36]  David Dagan Feng,et al.  Content-based retrieval of dynamic PET functional images , 2000, IEEE Transactions on Information Technology in Biomedicine.

[37]  Wei He,et al.  Image mining for investigative pathology using optimized feature extraction and data fusion , 2005, Comput. Methods Programs Biomed..