Augmented Collaborative Filtering for Sparseness Reduction in Personalized POI Recommendation

As mobile device penetration increases, it has become pervasive for images to be associated with locations in the form of geotags. Geotags bridge the gap between the physical world and the cyberspace, giving rise to new opportunities to extract further insights into user preferences and behaviors. In this article, we aim to exploit geotagged photos from online photo-sharing sites for the purpose of personalized Point-of-Interest (POI) recommendation. Owing to the fact that most users have only very limited travel experiences, data sparseness poses a formidable challenge to personalized POI recommendation. To alleviate data sparseness, we propose to augment current collaborative filtering algorithms along from multiple perspectives. Specifically, hybrid preference cues comprising user-uploaded and user-favored photos are harvested to study users’ tastes. Moreover, heterogeneous high-order relationship information is jointly captured from user social networks and POI multimodal contents with hypergraph models. We also build upon the matrix factorization algorithm to integrate the disparate sources of preference and relationship information, and apply our approach to directly optimize user preference rankings. Extensive experiments on a large and publicly accessible dataset well verified the potential of our approach for addressing data sparseness and offering quality recommendations to users, especially for those who have only limited travel experiences.

[1]  Chun Chen,et al.  Music recommendation by unified hypergraph: combining social media information and music content , 2010, ACM Multimedia.

[2]  Hatem Mousselly Sergieh,et al.  World-wide scale geotagged image dataset for automatic image annotation and reverse geotagging , 2014, MMSys '14.

[3]  Zi Huang,et al.  Discovering areas of interest with geo-tagged images and check-ins , 2012, ACM Multimedia.

[4]  Hai Jin,et al.  Content-Based Visual Landmark Search via Multimodal Hypergraph Learning , 2015, IEEE Transactions on Cybernetics.

[5]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[6]  Yue Gao,et al.  W2Go: a travel guidance system by automatic landmark ranking , 2010, ACM Multimedia.

[7]  Xing Xie,et al.  Mining interesting locations and travel sequences from GPS trajectories , 2009, WWW '09.

[8]  Huan Liu,et al.  gSCorr: modeling geo-social correlations for new check-ins on location-based social networks , 2012, CIKM.

[9]  Lei Zhu,et al.  Learning Compact Visual Representation with Canonical Views for Robust Mobile Landmark Search , 2016, IJCAI.

[10]  Hai Jin,et al.  Landmark Classification With Hierarchical Multi-Modal Exemplar Feature , 2015, IEEE Transactions on Multimedia.

[11]  Byron J. Gao,et al.  VSRank: A Novel Framework for Ranking-Based Collaborative Filtering , 2014, TIST.

[12]  Steffen Rendle,et al.  Improving pairwise learning for item recommendation from implicit feedback , 2014, WSDM.

[13]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[14]  Changsheng Xu,et al.  Topic-Sensitive Influencer Mining in Interest-Based Social Media Networks via Hypergraph Learning , 2014, IEEE Transactions on Multimedia.

[15]  Stevan Rudinac,et al.  Generating Visual Summaries of Geographic Areas Using Community-Contributed Images , 2013, IEEE Transactions on Multimedia.

[16]  Jon M. Kleinberg,et al.  Mapping the world's photos , 2009, WWW '09.

[17]  Kian-Lee Tan,et al.  WhereToGo: Personalized Travel Recommendation for Individuals and Groups , 2014, 2014 IEEE 15th International Conference on Mobile Data Management.

[18]  Adam Rae,et al.  Prediction of favourite photos using social, visual, and textual signals , 2010, ACM Multimedia.

[19]  Yifeng Zeng,et al.  Personalized Ranking Metric Embedding for Next New POI Recommendation , 2015, IJCAI.

[20]  Martha Larson,et al.  Collaborative Filtering beyond the User-Item Matrix , 2014, ACM Comput. Surv..

[21]  Hujun Bao,et al.  Spatio-Temporal Video Segmentation of Static Scenes and Its Applications , 2015, IEEE Transactions on Multimedia.

[22]  Hao Ma,et al.  An experimental study on implicit social recommendation , 2013, SIGIR.

[23]  Xiangyu Wang,et al.  Semantic-Based Location Recommendation With Multimodal Venue Semantics , 2015, IEEE Transactions on Multimedia.

[24]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[25]  Mao Ye,et al.  Exploiting geographical influence for collaborative point-of-interest recommendation , 2011, SIGIR.

[26]  Marcel J. T. Reinders,et al.  Using flickr geotags to predict user travel behaviour , 2010, SIGIR.

[27]  Yan-Ying Chen,et al.  Travel Recommendation by Mining People Attributes and Travel Group Types From Community-Contributed Photos , 2013, IEEE Transactions on Multimedia.

[28]  Yu Zheng,et al.  ORec: An Opinion-Based Point-of-Interest Recommendation Framework , 2015, CIKM.

[29]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[30]  Jialie Shen,et al.  Forbidden City Great Wall Old SummerPalace Temple of Heaven Tiananmen Square Avenue of Stars Disneyland Resort Peninsular Hotel Tian Tan Budda Victoria Harbour Big Ben Buckingham Palace , 2016 .

[31]  Tao Mei,et al.  The Evolution of Research on Multimedia Travel Guide Search and Recommender Systems , 2014, MMM.

[32]  Yue Gao,et al.  Multimedia Social Event Detection in Microblog , 2015, MMM.

[33]  Hui Xiong,et al.  Learning geographical preferences for point-of-interest recommendation , 2013, KDD.

[34]  Congfu Xu,et al.  Adaptive Bayesian personalized ranking for heterogeneous implicit feedbacks , 2015, Knowl. Based Syst..

[35]  Tomoharu Iwata,et al.  Travel route recommendation using geotags in photo sharing sites , 2010, CIKM.

[36]  Xing Xie,et al.  GeoMF: joint geographical modeling and matrix factorization for point-of-interest recommendation , 2014, KDD.

[37]  Wei-Ying Ma,et al.  Recommending friends and locations based on individual location history , 2011, ACM Trans. Web.

[38]  Xing Xie,et al.  Collaborative location and activity recommendations with GPS history data , 2010, WWW '10.

[39]  Tao Mei,et al.  Landmark Reranking for Smart Travel Guide Systems by Combining and Analyzing Diverse Media , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[40]  Shuaiqiang Wang,et al.  A Hybrid Multigroup Coclustering Recommendation Framework Based on Information Fusion , 2015, ACM Trans. Intell. Syst. Technol..

[41]  Xuelong Li,et al.  Visual-Textual Joint Relevance Learning for Tag-Based Social Image Search , 2013, IEEE Transactions on Image Processing.

[42]  James Allan,et al.  A comparison of statistical significance tests for information retrieval evaluation , 2007, CIKM '07.

[43]  Michael R. Lyu,et al.  Where You Like to Go Next: Successive Point-of-Interest Recommendation , 2013, IJCAI.

[44]  Nicholas Jing Yuan,et al.  Regularity and Conformity: Location Prediction Using Heterogeneous Mobility Data , 2015, KDD.

[45]  Mohamed F. Mokbel,et al.  Recommendations in location-based social networks: a survey , 2015, GeoInformatica.

[46]  Xing Xie,et al.  Learning travel recommendations from user-generated GPS traces , 2011, TIST.

[47]  Martha Larson,et al.  Nontrivial landmark recommendation using geotagged photos , 2013, TIST.

[48]  Martha Larson,et al.  Global-Scale Location Prediction for Social Images Using Geo-Visual Ranking , 2015, IEEE Transactions on Multimedia.

[49]  B. S. Manjunath,et al.  Multi-Label Learning With Fused Multimodal Bi-Relational Graph , 2014, IEEE Transactions on Multimedia.

[50]  Michael R. Lyu,et al.  Fused Matrix Factorization with Geographical and Social Influence in Location-Based Social Networks , 2012, AAAI.

[51]  Nadia Magnenat-Thalmann,et al.  Time-aware point-of-interest recommendation , 2013, SIGIR.

[52]  Tao Mei,et al.  Author Topic Model-Based Collaborative Filtering for Personalized POI Recommendations , 2015, IEEE Transactions on Multimedia.

[53]  Qi Tian,et al.  Mining flickr landmarks by modeling reconstruction sparsity , 2011, TOMCCAP.

[54]  Tat-Seng Chua,et al.  Social-Sensed Image Search , 2014, TOIS.

[55]  Xiaoli Li,et al.  Rank-GeoFM: A Ranking based Geographical Factorization Method for Point of Interest Recommendation , 2015, SIGIR.

[56]  Zhiguo Gong,et al.  Identifying Points of Interest Using Heterogeneous Features , 2014, ACM Trans. Intell. Syst. Technol..

[57]  Alejandro Jaimes,et al.  Analyzing Favorite Behavior in Flickr , 2013, MMM.

[58]  Jiayu Zhou,et al.  Collaborative Recommendation of Photo-Taking Geolocations , 2014, GeoMM '14.