A Two-Step Similarity Ranking Scheme for Image Retrieval

similarity ranking is one of the keys of a content-based image retrieval (CBIR) system. Among various methods, manifold ranking (MR) is popular for its application to relevance feedback in CBIR. Most existing MR methods only take the visual features into account in the similarity ranking, however, which is not accurate enough to reflect the intrinsic semantic structure of a given image database. In this paper, we propose a two-step similarity ranking scheme that aims to preserve both visual and semantic resemblance in the similarity ranking. Concretely, in the first step it derives an initial visual-based similarity rank through a self-tuning MR solution. In particular, the Gaussian kernel used in our scheme is refined by using a point-wise bandwidth. In the second step, the rank of each database image is further adjusted to achieve semantic consistency by mining the query log. An empirical study shows that using two-step similarity ranking in CBIR is beneficial, and the proposed scheme is more effective than some existing MR approaches.

[1]  Mingyu Lu,et al.  Asymmetric semi-supervised boosting for SVM active learning in CBIR , 2010, CIVR '10.

[2]  Zhongfei Zhang,et al.  BALAS: Empirical Bayesian learning in the relevance feedback for image retrieval , 2006, Image Vis. Comput..

[3]  Hong Shen,et al.  Incorporating Manifold Ranking with Active Learning in Relevance Feedback for Image Retrieval , 2012, 2012 13th International Conference on Parallel and Distributed Computing, Applications and Technologies.

[4]  Bernhard Schölkopf,et al.  Ranking on Data Manifolds , 2003, NIPS.

[5]  Rong Jin,et al.  A unified log-based relevance feedback scheme for image retrieval , 2006, IEEE Transactions on Knowledge and Data Engineering.

[6]  Thomas S. Huang,et al.  Relevance feedback in image retrieval: A comprehensive review , 2003, Multimedia Systems.

[7]  Bir Bhanu,et al.  Integrating relevance feedback techniques for image retrieval using reinforcement learning , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Bir Bhanu,et al.  Long-Term Cross-Session Relevance Feedback Using Virtual Features , 2008, IEEE Transactions on Knowledge and Data Engineering.

[9]  Hong Shen,et al.  Learning with both unlabeled data and query logs for image search , 2014, Comput. Electr. Eng..

[10]  Rong Jin,et al.  Semisupervised SVM batch mode active learning with applications to image retrieval , 2009, TOIS.

[11]  Edward Y. Chang,et al.  Active Learning for Interactive Multimedia Retrieval , 2008, Proceedings of the IEEE.

[12]  Zhi-Hua Zhou,et al.  Enhancing relevance feedback in image retrieval using unlabeled data , 2006, ACM Trans. Inf. Syst..

[13]  James Ze Wang,et al.  Image retrieval: Ideas, influences, and trends of the new age , 2008, CSUR.

[14]  Ulrike von Luxburg,et al.  A tutorial on spectral clustering , 2007, Stat. Comput..

[15]  Hong Shen,et al.  Learning a hybrid similarity measure for image retrieval , 2013, Pattern Recognit..

[16]  Qionghai Dai,et al.  Inequivalent manifold ranking for content-based image retrieval , 2008, 2008 15th IEEE International Conference on Image Processing.

[17]  Bernhard Schölkopf,et al.  Learning with Local and Global Consistency , 2003, NIPS.

[18]  Jingrui He,et al.  Manifold-ranking based image retrieval , 2004, MULTIMEDIA '04.

[19]  Philip S. Yu,et al.  Efficient Relevance Feedback for Content-Based Image Retrieval by Mining User Navigation Patterns , 2011, IEEE Transactions on Knowledge and Data Engineering.

[20]  Jitendra Malik,et al.  Learning Globally-Consistent Local Distance Functions for Shape-Based Image Retrieval and Classification , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[21]  ZhuJianke,et al.  Semisupervised SVM batch mode active learning with applications to image retrieval , 2009 .