Tag ranking by propagating relevance over tag and image graphs

In this paper, we explore the problem of tag ranking by propagating relevance over community-contributed images and their associated tags. To rank the tags more accurately, we propose a novel tag ranking scheme through a two-stage graph-based relevance propagation approach. The first stage constructs a tag graph on each image and implements a random walk process on it in order to get the initial relevance of each tag for one image and the second stage builds a kNN-sparse image graph and propagates the relevance of tags among the web images. The proposed approach is purely data-driven, since the explicit relevance models between tags and images are not assumed. More importantly, compared to existing tag ranking approaches, we propose to leverage the relevance propagation over two graphs, which take into count not only the relationship among tags but also the relationship among images. Extensive experiments have conducted on the NUS-WIDE dataset have demonstrated the effectiveness of the proposed approach.

[1]  De Xu,et al.  Beyond tag relevance: integrating visual attention model and multi-instance learning for tag saliency ranking , 2010, CIVR '10.

[2]  Marcel Worring,et al.  Learning tag relevance by neighbor voting for social image retrieval , 2008, MIR '08.

[3]  Gang Hua,et al.  Descriptive visual words and visual phrases for image applications , 2009, ACM Multimedia.

[4]  Chong-Wah Ngo,et al.  Semantic context modeling with maximal margin Conditional Random Fields for automatic image annotation , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  Shuicheng Yan,et al.  Inferring semantic concepts from community-contributed images and noisy tags , 2009, ACM Multimedia.

[6]  Rajesh P. N. Rao,et al.  Probabilistic Models of the Brain: Perception and Neural Function , 2002 .

[7]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[8]  D. Donoho For most large underdetermined systems of equations, the minimal 𝓁1‐norm near‐solution approximates the sparsest near‐solution , 2006 .

[9]  Sunil Arya,et al.  ANN: library for approximate nearest neighbor searching , 1998 .

[10]  Chong-Wah Ngo,et al.  A revisit of Generative Model for Automatic Image Annotation using Markov Random Fields , 2009, CVPR.

[11]  Michael I. Jordan,et al.  On Spectral Clustering: Analysis and an algorithm , 2001, NIPS.

[12]  Ramesh C. Jain,et al.  Image annotation by kNN-sparse graph-based label propagation over noisily tagged web images , 2011, TIST.

[13]  Paul M. B. Vitányi,et al.  The Google Similarity Distance , 2004, IEEE Transactions on Knowledge and Data Engineering.

[14]  Jeff Shrager,et al.  Observation of Phase Transitions in Spreading Activation Networks , 1987, Science.

[15]  Tat-Seng Chua,et al.  NUS-WIDE: a real-world web image database from National University of Singapore , 2009, CIVR '09.

[16]  Steven C. H. Hoi,et al.  A two-view learning approach for image tag ranking , 2011, WSDM '11.

[17]  Dong Liu,et al.  Tag ranking , 2009, WWW '09.