Ieee Transactions on Circuits and Video Technology 1 Relevance Feedback: a Power Tool for Interactive Content-based Image Retrieval

| Content-Based Image Retrieval (CBIR) has become one of the most active research areas in the past few years. Many visual feature representations have been explored and many systems built. While these research eeorts establish the basis of CBIR, the usefulness of the proposed approaches is limited. Speciically, these eeorts have relatively ignored two distinct characteristics of CBIR systems: (1) the gap between high level concepts and low level features ; (2) subjectivity of human perception of visual content. This paper proposes a relevance feedback based interactive retrieval approach, which eeectively takes into account the above two characteristics in CBIR. During the retrieval process , the user's high level query and perception subjectivity are captured by dynamically updated weights based on the user's feedback. The experimental results over more than 70,000 images show that the proposed approach greatly reduces the user's eeort of composing a query and captures the user's information need more precisely.

[1]  Thomas S. Huang,et al.  Content-based image retrieval with relevance feedback in MARS , 1997, Proceedings of International Conference on Image Processing.

[2]  Hideyuki Tamura,et al.  Textural Features Corresponding to Visual Perception , 1978, IEEE Transactions on Systems, Man, and Cybernetics.

[3]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Anil K. Jain,et al.  Texture classification and segmentation using multiresolution simultaneous autoregressive models , 1992, Pattern Recognit..

[5]  Kannan Ramchandran,et al.  Multimedia Analysis and Retrieval System (MARS) Project , 1996, Data Processing Clinic.

[6]  T.S. Huang,et al.  A relevance feedback architecture for content-based multimedia information retrieval systems , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[7]  Thomas S. Huang,et al.  Relevance feedback techniques in interactive content-based image retrieval , 1997, Electronic Imaging.

[8]  B. S. Manjunath,et al.  Texture features and learning similarity , 1996, Proceedings CVPR IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[9]  Yong Rui,et al.  Multimedia Analysis and Retrieval System , 1997 .

[10]  Henry Stark,et al.  Probability, Random Processes, and Estimation Theory for Engineers , 1995 .

[11]  Christos Faloutsos,et al.  QBIC project: querying images by content, using color, texture, and shape , 1993, Electronic Imaging.

[12]  Rosalind W. Picard,et al.  Interactive Learning Using a "Society of Models" , 2017, CVPR 1996.

[13]  S. Sclaroff,et al.  ImageRover: a content-based image browser for the World Wide Web , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[14]  Shih-Fu Chang,et al.  Transform features for texture classification and discrimination in large image databases , 1994, Proceedings of 1st International Conference on Image Processing.

[15]  B. S. Manjunath,et al.  Image indexing using a texture dictionary , 1995, Other Conferences.

[16]  Dragutin Petkovic,et al.  Query by Image and Video Content: The QBIC System , 1995, Computer.

[17]  W. Bruce Croft,et al.  The INQUERY Retrieval System , 1992, DEXA.

[18]  S. Panchanathan,et al.  Image Indexing Using Moments and Wavelets , 1996, 1996. Digest of Technical Papers., International Conference on Consumer Electronics.

[19]  Amarnath Gupta,et al.  Virage image search engine: an open framework for image management , 1996, Electronic Imaging.

[20]  John P. Oakley,et al.  Storage and Retrieval for Image and Video Databases , 1993 .

[21]  Thomas S. Huang,et al.  Automatic Matching Tool Selection Using Relevance Feedback In Mars , 1997 .

[22]  Michael McGill,et al.  Introduction to Modern Information Retrieval , 1983 .

[23]  Fang Liu,et al.  Periodicity, Directionality, and Randomness: Wold Features for Image Modeling and Retrieval , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Gerard Salton,et al.  Optimization of relevance feedback weights , 1995, SIGIR '95.

[25]  Freddy Fierens,et al.  Interactive outlining: an improved approach using active contours , 1993, Electronic Imaging.

[26]  Aidong Zhang,et al.  Approaches to image retrieval based on compressed data for multimedia database systems , 1996 .

[27]  James Dowe,et al.  Content-based retrieval in multimedia imaging , 1993, Electronic Imaging.

[28]  Thomas S. Huang,et al.  Supporting similarity queries in MARS , 1997, MULTIMEDIA '97.

[29]  Ronald Fagin,et al.  Incorporating User Preferences in Multimedia Queries , 1997, ICDT.

[30]  Shih-Fu Chang,et al.  Visually Searching the Web for Content , 1997, IEEE Multim..

[31]  B. S. Manjunath,et al.  NeTra: A toolbox for navigating large image databases , 1997, Multimedia Systems.

[32]  Shih-Fu Chang,et al.  Image and video search engine for the World Wide Web , 1997, Electronic Imaging.

[33]  C.-C. Jay Kuo,et al.  Texture analysis and classification with tree-structured wavelet transform , 1993, IEEE Trans. Image Process..