Effective Diversification for Ambiguous Queries in Social Image Retrieval

Recent years have witnessed a great popularity of social photos sharing websites, which host a tremendous volume of digital images accompanied by their associated tags. Thus, extensive research efforts have been dedicated to tag-based social image search which enables users to formulate their queries using tags. However, tag queries are often ambiguous and typically short. Search results diversification approach is the common solution which aims to increase the number of satisfied users using only a single results set that cover the maximum of query aspects. However, not all queries are uniformly ambiguous and hence different diversification strategies might be suggested. In such context, we propose a new ranking process which dynamically predicts an effective trade-off between the relevance and diversity based results ranking according to the ambiguity level of a given query. Thorough experiments using 12 ambiguous queries over the NUS-WIDE dataset show the effectiveness of our approach over classical uniform diversification approaches.

[1]  Chokri Ben Amar,et al.  Effective concept detection using Second order Co-occurence Flickr context similarity measure SOCFCS , 2012, 2012 10th International Workshop on Content-Based Multimedia Indexing (CBMI).

[2]  Lei Zhang,et al.  IGroup: presenting web image search results in semantic clusters , 2007, CHI.

[3]  Meng Wang,et al.  Social Image Search with Diverse Relevance Ranking , 2010, MMM.

[4]  Matthieu Guillaumin,et al.  Combining Image-Level and Segment-Level Models for Automatic Annotation , 2012, MMM.

[5]  Michele Covell,et al.  Google image swirl: a large-scale content-based image visualization system , 2012, WWW.

[6]  John D. Lafferty,et al.  Beyond independent relevance: methods and evaluation metrics for subtopic retrieval , 2003, SIGIR.

[7]  Chokri Ben Amar,et al.  Improving image search effectiveness by integrating contextual information , 2013, 2013 11th International Workshop on Content-Based Multimedia Indexing (CBMI).

[8]  Ximena Olivares,et al.  Visual diversification of image search results , 2009, WWW '09.

[9]  Filip Radlinski,et al.  Redundancy, diversity and interdependent document relevance , 2009, SIGF.

[10]  Chokri Ben Amar,et al.  REGIMvid at ImageCLEF2012: Improving Diversity in Personal Photo Ranking Using Fuzzy Logic , 2012, CLEF.

[11]  Chokri Ben Amar,et al.  Flickr-based semantic context to refine automatic photo annotation , 2012, 2012 3rd International Conference on Image Processing Theory, Tools and Applications (IPTA).

[12]  Jade Goldstein-Stewart,et al.  The use of MMR, diversity-based reranking for reordering documents and producing summaries , 1998, SIGIR '98.