Performance prediction for vocabulary-supported image retrieval

The majority of today's content based image retrieval systems rely on low-level image descriptors which limit their capability to support meaningful interactions with the users. Even though relevance feedback helps, most of the current interaction paradigms are far from the semantic representations which most people use to categorize and describe image content. Therefore we propose a concept called "vocabulary-supported image retrieval" which aims to enable the user to access an image database in a more natural way. In particular this paper develops a technique to predict the system's performance with respect to the user query. This allows the system to translate the user query into an internal query which may satisfy predefined criteria such as precision and recall rates. In addition, given the performance parameters of the system's sub-components, the feasibility and the success of the retrieval process can be evaluated beforehand and optimized dynamically online.

[1]  Nuno Vasconcelos,et al.  A Bayesian framework for content-based indexing and retrieval , 1998, Proceedings DCC '98 Data Compression Conference (Cat. No.98TB100225).

[2]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[3]  Bernt Schiele,et al.  Vocabulary-Supported Image Retrieval , 2000, DELOS Workshops / Conferences.

[4]  S. Sclaroff,et al.  ImageRover: a content-based image browser for the World Wide Web , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[5]  T.S. Huang,et al.  A relevance feedback architecture for content-based multimedia information retrieval systems , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[6]  Chahab Nastar,et al.  Relevance feedback and category search in image databases , 1999, Proceedings IEEE International Conference on Multimedia Computing and Systems.

[7]  Alberto Del Bimbo,et al.  Image retrieval by positive and negative examples , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[8]  Ingemar J. Cox,et al.  PicHunter: Bayesian relevance feedback for image retrieval , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[9]  Alex Pentland,et al.  Photobook: Content-based manipulation of image databases , 1996, International Journal of Computer Vision.

[10]  Jitendra Malik,et al.  Blobworld: Image Segmentation Using Expectation-Maximization and Its Application to Image Querying , 2002, IEEE Trans. Pattern Anal. Mach. Intell..