DeepPIM: A deep neural point-of-interest imputation model

Abstract A point-of-interest (POI) is a specific location in which someone is interested. In social network services such as Instagram, users share their experiences with text and photos, and link POIs to their posts. POIs can be utilized to understand user preferences and behavior. However, not all posts have POI information. In our study, we found more than half of the posts do not have POI information. The current state-of-the-art POI imputation model adds missing POI information. However, it relies on a conventional machine learning method that requires a substantial amount of laborious feature engineering. To address this problem, we propose DeepPIM, a deep neural POI imputation model that does not require feature engineering. DeepPIM automatically generates textual, visual, user, and temporal features from text, photo, user, and posting time information, respectively. For evaluating DeepPIM, we construct a new large-scale POI dataset. We show that DeepPIM significantly outperforms the current state-of-the-art model on the dataset. Our newly created large-scale POI dataset and the source code of DeepPIM are available at http://github.com/qnfnwkd/DeepPIM .

[1]  Xiaoli Li,et al.  Where you Instagram?: Associating Your Instagram Photos with Points of Interest , 2015, CIKM.

[2]  Nadia Magnenat-Thalmann,et al.  Time-aware point-of-interest recommendation , 2013, SIGIR.

[3]  Martha Larson,et al.  Geo-Distinctive Visual Element Matching for Location Estimation of Images , 2016, IEEE Transactions on Multimedia.

[4]  Pavel Serdyukov,et al.  Placing flickr photos on a map , 2009, SIGIR.

[5]  Thorsten Joachims,et al.  Training linear SVMs in linear time , 2006, KDD '06.

[6]  Jon M. Kleinberg,et al.  Mapping the world's photos , 2009, WWW '09.

[7]  Alexei A. Efros,et al.  IM2GPS: estimating geographic information from a single image , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[8]  Timothy Baldwin,et al.  Text-Based Twitter User Geolocation Prediction , 2014, J. Artif. Intell. Res..

[9]  Xin Liu,et al.  Exploring the Context of Locations for Personalized Location Recommendations , 2016, IJCAI.

[10]  Daniel P. Huttenlocher,et al.  Landmark classification in large-scale image collections , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[11]  Yoshua Bengio,et al.  Deep Sparse Rectifier Neural Networks , 2011, AISTATS.

[12]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[13]  Raghuraman Gopalan,et al.  Hierarchical sparse coding with geometric prior for visual geo-location , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[14]  Dong Xu,et al.  Where your photo is taken: Geolocation prediction for social images , 2014, J. Assoc. Inf. Sci. Technol..

[15]  Bo An,et al.  POI2Vec: Geographical Latent Representation for Predicting Future Visitors , 2017, AAAI.

[16]  Xiaohui Yu,et al.  NLPMM: A Next Location Predictor with Markov Modeling , 2014, PAKDD.

[17]  Michael R. Lyu,et al.  Where You Like to Go Next: Successive Point-of-Interest Recommendation , 2013, IJCAI.

[18]  Subbarao Kambhampati,et al.  What We Instagram: A First Analysis of Instagram Photo Content and User Types , 2014, ICWSM.

[19]  Xing Xie,et al.  Collaborative location and activity recommendations with GPS history data , 2010, WWW '10.

[20]  Hui Xiong,et al.  Learning geographical preferences for point-of-interest recommendation , 2013, KDD.

[21]  Meng Wang,et al.  Image Location Inference by Multisaliency Enhancement , 2017, IEEE Transactions on Multimedia.

[22]  Tieniu Tan,et al.  Predicting the Next Location: A Recurrent Model with Spatial and Temporal Contexts , 2016, AAAI.

[23]  Huan Liu,et al.  What Your Images Reveal: Exploiting Visual Contents for Point-of-Interest Recommendation , 2017, WWW.

[24]  Michael R. Lyu,et al.  STELLAR: Spatial-Temporal Latent Ranking for Successive Point-of-Interest Recommendation , 2016, AAAI.

[25]  Huan Liu,et al.  Content-Aware Point of Interest Recommendation on Location-Based Social Networks , 2015, AAAI.

[26]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[27]  Mao Ye,et al.  Exploiting geographical influence for collaborative point-of-interest recommendation , 2011, SIGIR.