Population-based incremental interactive concept learning for image retrieval by stochastic string segmentations

We propose a method for concept-based medical image retrieval that is a superset of existing semantic-based image retrieval methods. We conceive of a concept as an incremental and interactive formalization of the user's conception of an object in an image. The premise is that such a concept is closely related to a user's specific preferences and subjectivity and, thus, allows to deal with the complexity and content-dependency of medical image content. We describe an object in terms of multiple continuous boundary features and represent an object concept by the stochastic characteristics of an object population. A population-based incrementally learning technique, in combination with relevance feedback, is then used for concept customization. The user determines the speed and direction of concept customization using a single parameter that defines the degree of exploration and exploitation of the search space. Images are retrieved from a database in a limited number of steps based upon the customized concept. To demonstrate our method we have performed concept-based image retrieval on a database of 292 digitized X-ray images of cervical vertebrae with a variety of abnormalities. The results show that our method produces precise and accurate results when doing a direct search. In an open-ended search our method efficiently and effectively explores the search space.

[1]  Shumeet Baluja,et al.  A Method for Integrating Genetic Search Based Function Optimization and Competitive Learning , 1994 .

[2]  Chahab Nastar,et al.  Relevance feedback and category search in image databases , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[3]  Hermann Ney,et al.  Statistical framework for model-based image retrieval in medical applications , 2003, J. Electronic Imaging.

[4]  W. Mueller,et al.  Reliability, dependability, and precision of anthropometric measurements. The Second National Health and Nutrition Examination Survey 1976-1980. , 1989, American journal of epidemiology.

[5]  Arnold W. M. Smeulders,et al.  Strings: Variational Deformable Models of Multivariate Continuous Boundary Features , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Arnold W. M. Smeulders,et al.  Strings: Variational Deformable Models of Multivariate Ordered Features , 2001 .

[7]  A Flory,et al.  A four-dimensional approach to medical image retrieval. , 2001, Methods of information in medicine.

[8]  Tat-Seng Chua,et al.  A concept-based image retrieval system , 1994, 1994 Proceedings of the Twenty-Seventh Hawaii International Conference on System Sciences.

[9]  Bir Bhanu,et al.  Concepts learning with fuzzy clustering and relevance feedback , 2002 .

[10]  Thomas S. Huang,et al.  Relevance feedback in image retrieval: A comprehensive review , 2003, Multimedia Systems.

[11]  Ricky K. Taira,et al.  Knowledge-Based Image Retrieval with Spatial and Temporal Constructs , 1998, IEEE Trans. Knowl. Data Eng..

[12]  Frank Dellaert,et al.  Classi cation-Driven Medical Image Retrieval , 1999 .

[13]  L. Brooke The National Library of Medicine. , 1980, Hospital libraries.

[14]  James S. Duncan,et al.  Synthesis of Research: Medical Image Databases: A Content-based Retrieval Approach , 1997, J. Am. Medical Informatics Assoc..

[15]  Nuno Vasconcelos,et al.  Learning from User Feedback in Image Retrieval Systems , 1999, NIPS.

[16]  Thierry Pun,et al.  Content-based query of image databases: inspirations from text retrieval , 2000, Pattern Recognit. Lett..

[17]  C. Goodall Procrustes methods in the statistical analysis of shape , 1991 .

[18]  Henry J. Lowe,et al.  Towards knowledge-based retrieval of medical images. The role of semantic indexing, image content representation and knowledge-based retrieval , 1998, AMIA.

[19]  B. Silverman,et al.  Functional Data Analysis , 1997 .

[20]  Dorin Comaniciu,et al.  Image-guided decision support system for pathology , 1999, Machine Vision and Applications.

[21]  Aleksandra Mojsilovic,et al.  Semantic based categorization, browsing and retrieval in medical image databases , 2002, Proceedings. International Conference on Image Processing.

[22]  F. Dellaert,et al.  cation-Driven Medical Image Retrieval , 1998 .

[23]  L. Rodney Long,et al.  Image query and indexing for digital x rays , 1998, Electronic Imaging.

[24]  EURIPIDES G. M. PETRAKIS Content-Based Retrieval of Medical Images , 2002 .

[25]  Marcel Worring,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Carla E. Brodley,et al.  ASSERT: A Physician-in-the-Loop Content-Based Retrieval System for HRCT Image Databases , 1999, Comput. Vis. Image Underst..

[27]  W. Eric L. Grimson,et al.  A framework for learning query concepts in image classification , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).