Query feedback for interactive image retrieval

From a perceptual standpoint, the subjectivity inherent in understanding and interpreting visual content in multimedia indexing and retrieval motivates the need for online interactive learning. Since efficiency and speed are important factors in interactive visual content retrieval, most of the current approaches impose restrictive assumptions on similarity calculation and learning algorithms. Specifically, content-based image retrieval techniques generally assume that perceptually similar images are situated close to each other within a connected region of a given space of visual features. This paper proposes a novel method for interactive image retrieval using query feedback. Query feedback learns the user query as well as the correspondence between high-level user concepts and their low-level machine representation by performing retrievals according to multiple queries supplied by the user during the course of a retrieval session. The results presented in this paper demonstrate that this algorithm provides accurate retrieval results with acceptable interaction speed compared to existing methods.

[1]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[2]  Ramesh C. Jain,et al.  A survey on the use of pattern recognition methods for abstraction, indexing and retrieval of images and video , 2002, Pattern Recognit..

[3]  JainRamesh,et al.  Content-Based Image Retrieval at the End of the Early Years , 2000 .

[4]  Fabio Roli,et al.  Comparison and combination of adaptive query shifting and feature relevance learning for content-based image retrieval , 2001, Proceedings 11th International Conference on Image Analysis and Processing.

[5]  Ingemar J. Cox,et al.  The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments , 2000, IEEE Trans. Image Process..

[6]  Thomas S. Huang,et al.  Relevance feedback: a power tool for interactive content-based image retrieval , 1998, IEEE Trans. Circuits Syst. Video Technol..

[7]  Wei-Ying Ma,et al.  Learning similarity measure for natural image retrieval with relevance feedback , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[8]  Ying Wu,et al.  Learning in content-based image retrieval , 2002, Proceedings 2nd International Conference on Development and Learning. ICDL 2002.

[9]  Thomas S. Huang,et al.  One-class SVM for learning in image retrieval , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[10]  B. Reljin,et al.  Adaptive Content-Based Image Retrieval with Relevance Feedback , 2005, EUROCON 2005 - The International Conference on "Computer as a Tool".

[11]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[12]  Wei-Ying Ma,et al.  Learning a semantic space from user's relevance feedback for image retrieval , 2003, IEEE Trans. Circuits Syst. Video Technol..

[13]  Joshua R. Smith,et al.  Metadata-driven multimedia access , 2003, IEEE Signal Process. Mag..

[14]  Zhong Jin,et al.  Integrated probability function and its application to content-based image retrieval by relevance feedback , 2003, Pattern Recognit..

[15]  Borko Furht,et al.  MUSE: A Content-Based Image Search and Retrieval System Using Relevance Feedback , 2004, Multimedia Tools and Applications.

[16]  Arnold W. M. Smeulders,et al.  Color Invariance , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  B. S. Manjunath,et al.  Introduction to MPEG-7: Multimedia Content Description Interface , 2002 .

[18]  John R. Smith,et al.  Quantitative assessment of image retrieval effectiveness , 2001, J. Assoc. Inf. Sci. Technol..

[19]  Ronald Fagin,et al.  Combining Fuzzy Information from Multiple Systems , 1999, J. Comput. Syst. Sci..

[20]  Christos Faloutsos,et al.  FALCON: Feedback Adaptive Loop for Content-Based Retrieval , 2000, VLDB.

[21]  Konstantinos N. Plataniotis,et al.  Retrieval of images from artistic repositories using a decision fusion framework , 2004, IEEE Transactions on Image Processing.

[22]  Yi-Ping Hung,et al.  A Bayesian Method for Content-Based Image Retrieval by Use of Relevance Feedback , 2002, VISUAL.

[23]  Shih-Fu Chang,et al.  Overview of the MPEG-7 standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[24]  Yimin Wu,et al.  A feature re-weighting approach for relevance feedback in image retrieval , 2002, Proceedings. International Conference on Image Processing.

[25]  Ling Guan,et al.  Automatic machine interactions for content-based image retrieval using a self-organizing tree map architecture , 2002, IEEE Trans. Neural Networks.

[26]  John R. Smith,et al.  MPEG-7 multimedia description schemes , 2001, IEEE Trans. Circuits Syst. Video Technol..

[27]  Thomas S. Huang,et al.  Optimizing learning in image retrieval , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[28]  David Hutchison,et al.  The utility of MPEG-7 systems in audio-visual applications with multiple streams , 2003, IEEE Trans. Circuits Syst. Video Technol..

[29]  Thomas S. Huang,et al.  Factor graph framework for semantic video indexing , 2002, IEEE Trans. Circuits Syst. Video Technol..

[30]  Bo Zhang,et al.  Gaussian mixture model for relevance feedback in image retrieval , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[31]  Shaoping Ma,et al.  Relevance feedback in content-based image retrieval: Bayesian framework, feature subspaces, and progressive learning , 2003, IEEE Trans. Image Process..

[32]  Christos Faloutsos,et al.  MindReader: Querying Databases Through Multiple Examples , 1998, VLDB.

[33]  Chih-Yi Chiu,et al.  Learning user preference in a personalized CBIR system , 2002, Object recognition supported by user interaction for service robots.