Cluster-based relevance feedback for CBIR: a combination of query point movement and query expansion

This paper presents a cluster-based relevance feedback method, which combines two popular techniques of relevance feedback: query point movement and query expansion. Inspired from text retrieval, these two techniques are giving good results for image retrieval. But query point movement is limited by a constraint of unimodality in taking into account the user feedbacks. Query expansion gives better results than query point movement, but it cannot take into account irrelevant images from the user feedbacks. We combine the two techniques to profit from their advantages and to cope with their limitations. From a single point initial query, query expansion provides a multiple point query, which is then enhanced using query point movement. To learn the multiple point queries, the irrelevant feedback images are classified into query points which are clustered from relevant images using the query expansion technique. The experiments show that our method gives better results in comparison with the two techniques of relevance feedback taken individually.

[1]  Yimin Wu,et al.  Interactive pattern analysis for relevance feedback in multimedia information retrieval , 2004, Multimedia Systems.

[2]  James C. French,et al.  Improving image retrieval effectiveness via multiple queries , 2003, MMDB.

[3]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[4]  Jean-Marc Ogier,et al.  Text Retrieval Relevance Feedback Techniques for Bag of Words Model in CBIR , 2009 .

[5]  Ricardo da Silva Torres,et al.  Learning to rank for content-based image retrieval , 2010, MIR '10.

[6]  Claudio Gutierrez,et al.  Survey of graph database models , 2008, CSUR.

[7]  Mark J. Huiskes,et al.  Performance evaluation of relevance feedback methods , 2008, CIVR '08.

[8]  Sharad Mehrotra,et al.  Relevance feedback techniques in the MARS image retrieval system , 2003, Multimedia Systems.

[9]  Hugh E. Williams,et al.  Multiple Example Queries in Content-Based Image Retrieval , 2002, SPIRE.

[10]  Thijs Westerveld,et al.  Multimedia Retrieval Using Multiple Examples , 2004, CIVR.

[11]  Christos Faloutsos,et al.  MindReader: Querying Databases Through Multiple Examples , 1998, VLDB.

[12]  John R. Smith,et al.  Active selection for multi-example querying by content , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[13]  Jianguo Zhang,et al.  The PASCAL Visual Object Classes Challenge , 2006 .

[14]  Ravi Kothari,et al.  On finding the number of clusters , 1999, Pattern Recognit. Lett..

[15]  ChengXiang Zhai,et al.  A study of methods for negative relevance feedback , 2008, SIGIR '08.

[16]  Hichem Frigui,et al.  Clustering by competitive agglomeration , 1997, Pattern Recognit..

[17]  Andrew Zisserman,et al.  Efficient Visual Search for Objects in Videos , 2008, Proceedings of the IEEE.

[18]  C. V. Jawahar,et al.  Analysis of Relevance Feedback in Content Based Image Retrieval , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[19]  Xuelong Li,et al.  Asymmetric bagging and random subspace for support vector machines-based relevance feedback in image retrieval , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Milind R. Naphade,et al.  Learning the semantics of multimedia queries and concepts from a small number of examples , 2005, MULTIMEDIA '05.

[21]  Thomas S. Huang,et al.  Relevance feedback in image retrieval: A comprehensive review , 2003, Multimedia Systems.

[22]  James C. French,et al.  Improving Image Retrieval Effectiveness via Multiple Queries , 2003, MMDB '03.

[23]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .

[24]  Deok-Hwan Kim,et al.  Relevance feedback using adaptive clustering for image similarity retrieval , 2005, J. Syst. Softw..

[25]  Gerard Salton,et al.  The SMART Retrieval System—Experiments in Automatic Document Processing , 1971 .

[26]  Gustavo Carneiro,et al.  Supervised Learning of Semantic Classes for Image Annotation and Retrieval , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Kien A. Hua,et al.  Fast Query Point Movement Techniques for Large CBIR Systems , 2009, IEEE Transactions on Knowledge and Data Engineering.