A framework for medical image retrieval using merging-based classification with dependency probability-based relevance feedback

Content-based image retrieval (CBIR) systems are used to retrieve relevant images from large-scale databases. In this paper, a framework for the image retrieval of a large-scale database of medical X-ray images is presented. This framework is designed based on query image classification into several prespecified homogeneous classes. Using a merging scheme and an iterative classification, the homogeneous classes are formed from overlapping classes in the database. For this purpose, the shape and texture features, selected using the forward selection algorithm, are optimized by a novel genetic algorithm-based feature reduction and optimization algorithm in the feature space. In this algorithm, using a new fitness function, we try to locate similar images in the database together in the feature space. Using the merging-based classification, the m-nearest classes to the query image are selected as a filtered search space. To increase the retrieval efficiency, we integrate a novel dependency probability-based relevance feedback (RF) approach with the proposed CBIR framework. The proposed RF uses a synthetic distance measure based on the weighted Euclidean distance measure and Gaussian mixture model-based dependency probability similarity measure of the database images to the Gaussian mixture distribution function of the positive images. The experimental results are reported based on a database consisting of 10,000 medical X-ray images of 57 classes (ImageCLEF 2005 database). The provided results show the effectiveness of the proposed framework compared to the approaches presented in the literature.

[1]  Zhongfei Zhang,et al.  Automatic medical image annotation and retrieval , 2008, Neurocomputing.

[2]  Wei-Pang Yang,et al.  A two-level relevance feedback mechanism for image retrieval , 2008, Expert Syst. Appl..

[3]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[4]  Bipin C. Desai,et al.  A Framework for Medical Image Retrieval Using Machine Learning and Statistical Similarity Matching Techniques With Relevance Feedback , 2007, IEEE Transactions on Information Technology in Biomedicine.

[5]  Dah-Jye Lee,et al.  A Spine X-Ray Image Retrieval System Using Partial Shape Matching , 2008, IEEE Transactions on Information Technology in Biomedicine.

[6]  Shixin Yu,et al.  Feature Selection and Classifier Ensembles: A Study on Hyperspectral Remote Sensing Data , 2003 .

[7]  Antoine Rosset,et al.  Comparing features sets for content-based image retrieval in a medical-case database , 2004, SPIE Medical Imaging.

[8]  Guillermo Ayala,et al.  A novel Bayesian framework for relevance feedback in image content-based retrieval systems , 2006, Pattern Recognit..

[9]  Hossein Pourghassem,et al.  Content-based medical image classification using a new hierarchical merging scheme , 2008, Comput. Medical Imaging Graph..

[10]  Carla E. Brodley,et al.  ASSERT: A PHYSICIAN-IN-THE-LOOP CONTENT-BASED IMAGE RETRIEVAL SYSTEM FOR HRCT IMAGE DATABASES , 1999 .

[11]  Anil K. Jain Fundamentals of Digital Image Processing , 2018, Control of Color Imaging Systems.

[12]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  L. Rodney Long,et al.  Evaluation of shape similarity measurement methods for spine X-ray images , 2004, J. Vis. Commun. Image Represent..

[14]  Hermann Ney,et al.  Classification error rate for quantitative evaluation of content-based image retrieval systems , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[15]  Sameer Antani,et al.  Biomedical information from a national collection of spine x-rays: film to content-based retrieval , 2003, SPIE Medical Imaging.

[16]  T M Lehmann,et al.  Content-based Image Retrieval in Medical Applications , 2004, Methods of Information in Medicine.

[17]  George R Thoma,et al.  Image informatics at a national research center. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.

[18]  Bo Zhang,et al.  Gaussian mixture model for relevance feedback in image retrieval , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[19]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[20]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[21]  Mohamed Abdel-Mottaleb,et al.  Hierarchical contour matching for dental X-ray radiographs , 2008, Pattern Recognit..

[22]  Ricky K. Taira,et al.  Knowledge-Based Image Retrieval with Spatial and Temporal Constructs , 1998, IEEE Trans. Knowl. Data Eng..

[23]  Eugene Kim,et al.  Overview of the ImageCLEFmed 2006 Medical Retrieval and Annotation Tasks , 2006, CLEF.

[24]  Fritz Albregtsen,et al.  Fast computation of invariant geometric moments: a new method giving correct results , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[25]  Bipin C. Desai,et al.  Medical image retrieval with probabilistic multi-class support vector machine classifiers and adaptive similarity fusion , 2008, Comput. Medical Imaging Graph..

[26]  Carla E. Brodley,et al.  Using Human Perceptual Categories for Content-Based Retrieval from a Medical Image Database , 2002, Comput. Vis. Image Underst..

[27]  Clarimar José Coelho,et al.  Computer-aided diagnosis in chest radiography for detection of childhood pneumonia , 2008, Int. J. Medical Informatics.

[28]  Carla E. Brodley,et al.  Unsupervised Feature Selection Applied to Content-Based Retrieval of Lung Images , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Hayit Greenspan,et al.  Medical Image Categorization and Retrieval for PACS Using the GMM-KL Framework , 2007, IEEE Transactions on Information Technology in Biomedicine.

[30]  Pat Langley,et al.  Selection of Relevant Features and Examples in Machine Learning , 1997, Artif. Intell..

[31]  Christos Faloutsos,et al.  Fast and Effective Retrieval of Medical Tumor Shapes , 1998, IEEE Trans. Knowl. Data Eng..

[32]  Anil K. Jain,et al.  39 Dimensionality and sample size considerations in pattern recognition practice , 1982, Classification, Pattern Recognition and Reduction of Dimensionality.

[33]  Sung-Nien Yu,et al.  A three-object model for the similarity searches of chest CT images. , 2005, Computerized medical imaging and graphics : the official journal of the Computerized Medical Imaging Society.