Landmark Reranking for Smart Travel Guide Systems by Combining and Analyzing Diverse Media

Advanced networking technologies and massive online social media have stimulated a booming growth of travel heterogeneous information in recent years. By employing such information, smart travel guide systems, such as landmark ranking systems, have been proposed to offer diverse online travel services. It is essential for a landmark ranking system to structure, analyze, and search the travel heterogeneous information to produce human-expected results. Therefore, currently the most fundamental yet challenging problems can be concluded: 1) how to fuse heterogeneous tourism information and 2) how to model landmark ranking. In this paper, a novel landmark search system is introduced based on a newly designed heterogeneous information fusion scheme and a query-dependent landmark ranking strategy. Different from the existing travel guide systems, the proposed system can effectively combine the heterogeneous information from multimodality media into a landmark reranking list via a user's query. Experimental results conducted on a large travel information collection illustrate the advantages of the proposed system in terms of both effectiveness and efficiency.

[1]  Zheru Chi,et al.  Realistic Human Action Recognition With Multimodal Feature Selection and Fusion , 2013, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[2]  Wei-Ying Ma,et al.  Diversifying landmark image search results by learning interested views from community photos , 2010, WWW '10.

[3]  Shih-Fu Chang,et al.  A reranking approach for context-based concept fusion in video indexing and retrieval , 2007, CIVR '07.

[4]  Changhu Wang,et al.  Photo2Trip: generating travel routes from geo-tagged photos for trip planning , 2010, ACM Multimedia.

[5]  Ronald Rosenfeld,et al.  Semi-supervised learning with graphs , 2005 .

[6]  Ellen M. Voorhees,et al.  Learning collection fusion strategies , 1995, SIGIR '95.

[7]  Changsheng Xu,et al.  Enhanced 3-D Modeling for Landmark Image Classification , 2012, IEEE Transactions on Multimedia.

[8]  Rong Xiao,et al.  TravelScope: standing on the shoulders of dedicated travelers , 2009, ACM Multimedia.

[9]  Kenneth Ward Church,et al.  A Spelling Correction Program Based on a Noisy Channel Model , 1990, COLING.

[10]  Bernhard Schölkopf,et al.  Ranking on Data Manifolds , 2003, NIPS.

[11]  Pinar Duygulu Sahin,et al.  Re-ranking of web image search results using a graph algorithm , 2008, 2008 19th International Conference on Pattern Recognition.

[12]  Rong Yan,et al.  Multimedia Search with Pseudo-relevance Feedback , 2003, CIVR.

[13]  Christopher C. Yang.  Search Engines Information Retrieval in Practice , 2010, J. Assoc. Inf. Sci. Technol..

[14]  Wen Gao,et al.  Location Discriminative Vocabulary Coding for Mobile Landmark Search , 2011, International Journal of Computer Vision.

[15]  Jackie Rees Ulmer,et al.  Modeling search in group decision support systems , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[16]  Michael Collins,et al.  Ranking Algorithms for Named Entity Extraction: Boosting and the VotedPerceptron , 2002, ACL.

[17]  Rong Yan,et al.  The combination limit in multimedia retrieval , 2003, MULTIMEDIA '03.

[18]  Mor Naaman,et al.  Generating diverse and representative image search results for landmarks , 2008, WWW.

[19]  Yue Gao,et al.  W2Go: a travel guidance system by automatic landmark ranking , 2010, ACM Multimedia.

[20]  Xuelong Li,et al.  Relevance Preserving Projection and Ranking for Web Image Search Reranking , 2015, IEEE Transactions on Image Processing.

[21]  Wei-Ying Ma,et al.  VirtualTour: an online travel assistant based on high quality images , 2006, MM '06.

[22]  Qi Tian,et al.  Image search reranking with multi-latent topical graph , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[23]  T. Landauer,et al.  Indexing by Latent Semantic Analysis , 1990 .

[24]  W. Bruce Croft,et al.  A language modeling approach to information retrieval , 1998, SIGIR '98.

[25]  W. John Wilbur,et al.  The automatic identification of stop words , 1992, J. Inf. Sci..

[26]  Pietro Perona,et al.  A Bayesian hierarchical model for learning natural scene categories , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  Yihong Gong,et al.  Combining content and link for classification using matrix factorization , 2007, SIGIR.

[28]  Didier Sornette,et al.  Manipulating Decision Making of Typical Agents , 2014, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[29]  Jia Chen,et al.  DLMSearch: diversified landmark search by photo , 2012, ACM Multimedia.

[30]  Shih-Fu Chang,et al.  Video search reranking via information bottleneck principle , 2006, MM '06.

[31]  Changsheng Xu,et al.  Mobile Landmark Search with 3D Models , 2014, IEEE Transactions on Multimedia.

[32]  Hongbo Deng,et al.  Effective latent space graph-based re-ranking model with global consistency , 2009, WSDM '09.

[33]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[34]  Noboru Babaguchi,et al.  Extracting Context Information from Microblog Based on Analysis of Online Reviews , 2012, 2012 IEEE International Conference on Multimedia and Expo Workshops.

[35]  Xian-Sheng Hua,et al.  Bayesian video search reranking , 2008, ACM Multimedia.

[36]  Tao Mei,et al.  Query-independent learning for video search , 2008, 2008 IEEE International Conference on Multimedia and Expo.

[37]  Tao Mei,et al.  The Evolution of Research on Multimedia Travel Guide Search and Recommender Systems , 2014, MMM.

[38]  Sheng Tang,et al.  Personalized multimedia web summarizer for tourist , 2008, WWW.