Landmark Summarization With Diverse Viewpoints

Landmark summarization with diverse viewpoints is very important in landmark retrieval, as it can create a comprehensive description of a landmark for users. In this paper we present an approach for summarizing a collection of landmark images from diverse viewpoints. First, we group landmark images with content overlap by viewpoint album (VA) generation. Second, we model the relative viewpoint of each image within the VA based on the spatial layout of distinctive descriptors of a landmark. Third, we express the relative viewpoint of an image with a 4-D viewpoint vector, including horizontal, vertical, scale, and rotation. Finally, we summarize the landmarks in terms of viewpoints. Experimental results show the effectiveness of the proposed landmark summarization approach.

[1]  Edward Y. Chang,et al.  Scalable landmark recognition using EXTENT , 2007, Multimedia Tools and Applications.

[2]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[3]  Ali Shokoufandeh,et al.  Graph-Theoretical Methods in Computer Vision , 2000, Theoretical Aspects of Computer Science.

[4]  Yixin Chen,et al.  Ranking on Data Manifold with Sink Points , 2013, IEEE Transactions on Knowledge and Data Engineering.

[5]  Jon M. Kleinberg,et al.  Mapping the world's photos , 2009, WWW '09.

[6]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..

[7]  Jiebo Luo,et al.  RankCompete: Simultaneous ranking and clustering of information networks , 2012, Neurocomputing.

[8]  Steven M. Seitz,et al.  Scene Summarization for Online Image Collections , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[9]  Daniel P. Huttenlocher,et al.  Landmark classification in large-scale image collections , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[10]  Qi Tian,et al.  Spatial coding for large scale partial-duplicate web image search , 2010, ACM Multimedia.

[11]  Xueming Qian,et al.  Visual summarization of landmarks via viewpoint modeling , 2012, 2012 19th IEEE International Conference on Image Processing.

[12]  Mor Naaman,et al.  Generating diverse and representative image search results for landmarks , 2008, WWW.

[13]  Mor Naaman,et al.  Generating summaries and visualization for large collections of geo-referenced photographs , 2006, MIR '06.

[14]  Kam-Fai Wong,et al.  Interpreting TF-IDF term weights as making relevance decisions , 2008, TOIS.

[15]  Cordelia Schmid,et al.  Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search , 2008, ECCV.

[16]  Luc Van Gool,et al.  World-scale mining of objects and events from community photo collections , 2008, CIVR '08.

[17]  Jiebo Luo,et al.  Beyond GPS: determining the camera viewing direction of a geotagged image , 2010, ACM Multimedia.

[18]  Xueming Qian,et al.  Generating representative images for landmark by discovering high frequency shooting locations from community-contributed photos , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[19]  Yang Song,et al.  Tour the world: a technical demonstration of a web-scale landmark recognition engine , 2009, ACM Multimedia.

[20]  Jan-Michael Frahm,et al.  Modeling and Recognition of Landmark Image Collections Using Iconic Scene Graphs , 2008, International Journal of Computer Vision.

[21]  Yuan Yan Tang,et al.  GPS Estimation from Users' Photos , 2013, MMM.

[22]  Yang Song,et al.  Tour the world: Building a web-scale landmark recognition engine , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[23]  Feng Wu,et al.  Visual summarization of web pages , 2010, SIGIR '10.

[24]  Tamara L. Berg,et al.  Automatic Ranking of Iconic Images , 2007 .

[25]  Katsumi Tanaka,et al.  3D viewpoint-based photo search and information browsing , 2005, SIGIR '05.

[26]  Yiannis Kompatsiaris,et al.  Cluster-Based Landmark and Event Detection for Tagged Photo Collections , 2011, IEEE MultiMedia.

[27]  Wei-Ying Ma,et al.  Diversifying landmark image search results by learning interested views from community photos , 2010, WWW '10.

[28]  Xing Xie,et al.  Mining city landmarks from blogs by graph modeling , 2009, ACM Multimedia.

[29]  Andrew Zisserman,et al.  Video Google: a text retrieval approach to object matching in videos , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[30]  Arnold W. M. Smeulders,et al.  Visual synonyms for landmark image retrieval , 2012, Comput. Vis. Image Underst..

[31]  Yuan Yan Tang,et al.  GPS Estimation for Places of Interest From Social Users' Uploaded Photos , 2013, IEEE Transactions on Multimedia.

[32]  Mor Naaman,et al.  World explorer: visualizing aggregate data from unstructured text in geo-referenced collections , 2007, JCDL '07.

[33]  Xueming Qian,et al.  Mobile image retrieval using multi-photos as query , 2013, 2013 IEEE International Conference on Multimedia and Expo Workshops (ICMEW).

[34]  Michael Isard,et al.  Object retrieval with large vocabularies and fast spatial matching , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Shumeet Baluja,et al.  VisualRank: Applying PageRank to Large-Scale Image Search , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  Yannis Avrithis,et al.  Retrieving landmark and non-landmark images from community photo collections , 2010, ACM Multimedia.

[37]  Hao Xu,et al.  Interactive image search by 2D semantic map , 2010, WWW '10.

[38]  Yi-Liang Zhao,et al.  Generating Representative Views of Landmarks via Scenic Theme Detection , 2011, MMM.

[39]  Natasha Gelfand,et al.  Visual summaries of popular landmarks from community photo collections , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[40]  Tanji Hu,et al.  Summarizing tourist destinations by mining user-generated travelogues and photos , 2011, Comput. Vis. Image Underst..

[41]  Markus A. Stricker,et al.  Similarity of color images , 1995, Electronic Imaging.

[42]  Bastian Leibe,et al.  Discovering favorite views of popular places with iconoid shift , 2011, 2011 International Conference on Computer Vision.

[43]  Ximena Olivares,et al.  Visual diversification of image search results , 2009, WWW '09.

[44]  Henning Müller,et al.  Retrieving Diverse Social Images at MediaEval 2013: Objectives, Dataset and Evaluation , 2013, MediaEval.

[45]  Xueming Qian,et al.  Spatial Verification for Scalable Mobile Image Retrieval , 2014, CIKM.

[46]  B. S. Manjunath,et al.  Texture Features for Browsing and Retrieval of Image Data , 1996, IEEE Trans. Pattern Anal. Mach. Intell..