The Evolution of Research on Multimedia Travel Guide Search and Recommender Systems

The importance of multimedia travel guide search and recommender systems has led to a substantial amount of research spanning different computer science and information system disciplines in recent years. The five core research streams we identify here incorporate a few multimedia computing and information retrieval problems that relate to the alternative perspectives of algorithm design for optimizing search/recommendation quality and different methodological paradigms to assess system performance at large scale. They include (1) query analysis, (2) diversification based on different criteria, (3) ranking and reranking, (4) personalization and (5) evaluation. Based on a comprehensive discussion and analysis of these streams, this survey evaluates the recent major contributions to theoretical and system development, and makes some predictions about the road that lies ahead for multimedia computing and information retrieval (IR) researchers in both academia and industry world.

[1]  Federica Cena,et al.  Integrating heterogeneous adaptation techniques to build a flexible and usable mobile tourist guide , 2006, AI Commun..

[2]  Christopher B. Jones,et al.  Workshop on geographic information retrieval, SIGIR 2004 , 2004, SIGF.

[3]  Hao Wu,et al.  Suggesting Topic-Based Query Terms as You Type , 2010, 2010 12th International Asia-Pacific Web Conference.

[4]  Changhu Wang,et al.  Photo2Trip: generating travel routes from geo-tagged photos for trip planning , 2010, ACM Multimedia.

[5]  Stevan Rudinac,et al.  Finding representative and diverse community contributed images to create visual summaries of geographic areas , 2011, MM '11.

[6]  M. Sanderson,et al.  Analyzing geographic queries , 2004 .

[7]  Daniel P. Huttenlocher,et al.  Landmark classification in large-scale image collections , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[8]  Kristen Grauman,et al.  Clues from the beaten path: Location estimation with bursty sequences of tourist photos , 2011, CVPR 2011.

[9]  Yue Gao,et al.  W2Go: a travel guidance system by automatic landmark ranking , 2010, ACM Multimedia.

[10]  Laks V. S. Lakshmanan,et al.  Breaking out of the box of recommendations: from items to packages , 2010, RecSys '10.

[11]  Sheng Tang,et al.  Personalized multimedia web summarizer for tourist , 2008, WWW.

[12]  Changhu Wang,et al.  Equip tourists with knowledge mined from travelogues , 2010, WWW '10.

[13]  Xing Xie,et al.  Collaborative Filtering Meets Mobile Recommendation: A User-Centered Approach , 2010, AAAI.

[14]  Chao Liu,et al.  A probabilistic approach to spatiotemporal theme pattern mining on weblogs , 2006, WWW '06.

[15]  Wei-Ying Ma,et al.  Diversifying landmark image search results by learning interested views from community photos , 2010, WWW '10.

[16]  Xing Xie,et al.  Mining city landmarks from blogs by graph modeling , 2009, ACM Multimedia.

[17]  Wei Vivian Zhang,et al.  Geographic intention and modification in web search , 2008, Int. J. Geogr. Inf. Sci..

[18]  Jon M. Kleinberg,et al.  Mapping the world's photos , 2009, WWW '09.

[19]  Xin Chen,et al.  City-scale landmark identification on mobile devices , 2011, CVPR 2011.

[20]  Mário J. Silva,et al.  Relevance Ranking for Geographic IR , 2006, GIR.

[21]  Tao Mei,et al.  Mobile multimedia travelogue generation by exploring geo-locations and image tags , 2013, 2013 IEEE International Symposium on Circuits and Systems (ISCAS2013).

[22]  Ramesh C. Jain,et al.  GPSView: A scenic driving route planner , 2013, TOMCCAP.

[23]  Hema Raghavan,et al.  Discovering users' specific geo intention in web search , 2009, WWW '09.

[24]  Xing Xie,et al.  Learning travel recommendations from user-generated GPS traces , 2011, TIST.

[25]  Bo Yu,et al.  A query-aware document ranking method for geographic information retrieval , 2007, GIR '07.

[26]  Mor Naaman,et al.  Generating diverse and representative image search results for landmarks , 2008, WWW.

[27]  Susanne Boll,et al.  Generic support for personalized mobile multimedia tourist applications , 2004, MULTIMEDIA '04.

[28]  Wei-Ying Ma,et al.  VirtualTour: an online travel assistant based on high quality images , 2006, MM '06.

[29]  Steven M. Seitz,et al.  Scene Summarization for Online Image Collections , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[30]  Jinwen Ma,et al.  Query topic detection for reformulation , 2007, WWW '07.

[31]  Hong-Yuan Mark Liao,et al.  Personalized travel recommendation by mining people attributes from community-contributed photos , 2011, ACM Multimedia.

[32]  Jia Chen,et al.  DLMSearch: diversified landmark search by photo , 2012, ACM Multimedia.

[33]  Shih-Fu Chang,et al.  Video search reranking via information bottleneck principle , 2006, MM '06.

[34]  Pinar Duygulu Sahin,et al.  Re-ranking of web image search results using a graph algorithm , 2008, 2008 19th International Conference on Pattern Recognition.

[35]  Rong Yan,et al.  Multimedia Search with Pseudo-relevance Feedback , 2003, CIVR.

[36]  Gregory D. Abowd,et al.  Cyberguide: A mobile context‐aware tour guide , 1997, Wirel. Networks.

[37]  Hui Xiong,et al.  Cost-aware travel tour recommendation , 2011, KDD.

[38]  Xuelong Li,et al.  Visual-Textual Joint Relevance Learning for Tag-Based Social Image Search , 2013, IEEE Transactions on Image Processing.

[39]  Marko Modsching,et al.  A location aware mobile tourist guide selecting and interpreting sights and services by context matching , 2005, The Second Annual International Conference on Mobile and Ubiquitous Systems: Networking and Services.

[40]  Wei-Ying Ma,et al.  Image and Video Retrieval , 2003, Lecture Notes in Computer Science.

[41]  Jiang-Ming Yang,et al.  Generating location overviews with images and tags by mining user-generated travelogues , 2009, ACM Multimedia.

[42]  Jaeyoung Choi,et al.  Video2GPS: a demo of multimodal location estimation on flickr videos , 2011, MM '11.

[43]  F. Ricci,et al.  Map-Based Interaction with a Conversational Mobile Recommender System , 2008, 2008 The Second International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies.

[44]  Xian-Sheng Hua,et al.  Bayesian video search reranking , 2008, ACM Multimedia.

[45]  Matthieu Guillaumin,et al.  Combining Image-Level and Segment-Level Models for Automatic Annotation , 2012, MMM.

[46]  Yuan Yan Tang,et al.  GPS Estimation from Users' Photos , 2013, MMM.

[47]  Hailong Sun,et al.  gTravel: a global social travel system , 2012, ACM Multimedia.

[48]  Steven M. Seitz,et al.  Photo tourism: exploring photo collections in 3D , 2006, ACM Trans. Graph..