Leveraging collective wisdom for web video retrieval through heterogeneous community discovery

With the exponential growth of social media, web video retrieval based on contextual information associated with videos has attracted wide attention recently. However, state-of-the-art methods mainly focus on limited kinds of context cues and lack of unified exploration towards multiple heterogeneous contexts. In this paper, we propose a novel web video ranking framework called CommunityRank by leveraging the collective wisdom from a community perspective. Firstly, it formulizes various social relations among users, videos and tags in a heterogeneous context network and further detects its latent community structure. Then the algorithm maps videos into the community space and performs a community-oriented re-ranking through a bipartite graph model. By aggregating the multiple relations, CommunityRank can make the most of textual, visual and social contexts and leads to better search results. The encouraging performances of the proposed method on YouTube video collection demonstrate that the discovered communities reveal topics of interest emerging in collective behaviors and can facilitate web video retrieval.

[1]  Jimeng Sun,et al.  MetaFac: community discovery via relational hypergraph factorization , 2009, KDD.

[2]  Yi-Cheng Zhang,et al.  Bipartite network projection and personal recommendation. , 2007, Physical review. E, Statistical, nonlinear, and soft matter physics.

[3]  Chong-Wah Ngo,et al.  Co-reranking by mutual reinforcement for image search , 2010, CIVR '10.

[4]  Hung-Khoon Tan,et al.  Real-Time Near-Duplicate Elimination for Web Video Search With Content and Context , 2009, IEEE Transactions on Multimedia.

[5]  Lexing Xie,et al.  Modeling personal and social network context for event annotation in images , 2007, JCDL '07.

[6]  Xian-Sheng Hua,et al.  Towards a Relevant and Diverse Search of Social Images , 2010, IEEE Transactions on Multimedia.

[7]  Mason A. Porter,et al.  Communities in Networks , 2009, ArXiv.

[8]  Marcel Worring,et al.  Learning Social Tag Relevance by Neighbor Voting , 2009, IEEE Transactions on Multimedia.

[9]  Changhu Wang,et al.  Content-Based Image Annotation Refinement , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Xiaolong Zhang,et al.  SNDocRank: a social network-based video search ranking framework , 2010, MIR '10.