Image Search Result Summarization with Informative Priors

Though current commercial image search engines provide effective ways to retrieve the relevant images, they are ineffective for users to find the desired from the retrieved hundreds of results, especially for ambiguous queries In this paper, we propose to summarize the search results by several representative images We argue that the relevance and image quality are two important measures for a user friendly summarization since image search results are normally noisy with some low-quality images The two factors, which can be regarded as informative prior of whether an image is a good summary candidate, are modeled into Affinity Propagation framework User studies demonstrate that our proposed method is able to produce a user friendly summary, in terms of relevance, diversity, and coverage.

[1]  Keiji Yanai An automatic image-gathering system for the World-Wide Web by integration of keywords and image features , 2001, Proceedings Fourth International Conference on Computational Intelligence and Multimedia Applications. ICCIMA 2001.

[2]  Mor Naaman,et al.  Generating diverse and representative image search results for landmarks , 2008, WWW.

[3]  Svetlana Lazebnik,et al.  Computing iconic summaries of general visual concepts , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[4]  Delbert Dueck,et al.  Clustering by Passing Messages Between Data Points , 2007, Science.

[5]  Xiaoou Tang,et al.  Photo and Video Quality Evaluation: Focusing on the Subject , 2008, ECCV.

[6]  Tao Mei,et al.  Home Video Visual Quality Assessment With Spatiotemporal Factors , 2007, IEEE Transactions on Circuits and Systems for Video Technology.

[7]  S. Sclaroff,et al.  ImageRover: a content-based image browser for the World Wide Web , 1997, 1997 Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries.

[8]  Yi-Hsuan Yang,et al.  ContextSeer: context search and recommendation at query time for shared consumer photos , 2008, ACM Multimedia.

[9]  James Ze Wang,et al.  Real-time computerized annotation of pictures. , 2008, IEEE transactions on pattern analysis and machine intelligence.

[10]  Thorsten Joachims,et al.  Training linear SVMs in linear time , 2006, KDD '06.

[11]  Andrew J. Davison,et al.  Active Matching , 2008, ECCV.

[12]  Xiaoou Tang,et al.  Real time google and live image search re-ranking , 2008, ACM Multimedia.

[13]  Hong Yu,et al.  Towards Answering Biological Questions with Experimental Evidence: Automatically Identifying Text that Summarize Image Content in Full-Text Articles , 2006, AMIA.

[14]  Jianping Fan,et al.  A novel approach to enable semantic and visual image summarization for exploratory image search , 2008, MIR '08.

[15]  Xiaojin Zhu,et al.  Improving Diversity in Ranking using Absorbing Random Walks , 2007, NAACL.

[16]  Steven M. Seitz,et al.  Scene Summarization for Online Image Collections , 2007, 2007 IEEE 11th International Conference on Computer Vision.