Exploiting Pre-Trained Network Embeddings for Recommendations in Social Networks

Recommender systems as one of the most efficient information filtering techniques have been widely studied in recent years. However, traditional recommender systems only utilize user-item rating matrix for recommendations, and the social connections and item sequential patterns are ignored. But in our real life, we always turn to our friends for recommendations, and often select the items that have similar sequential patterns. In order to overcome these challenges, many studies have taken social connections and sequential information into account to enhance recommender systems. Although these existing studies have achieved good results, most of them regard social influence and sequential information as regularization terms, and the deep structure hidden in social networks and rating patterns has not been fully explored. On the other hand, neural network based embedding methods have shown their power in many recommendation tasks with their ability to extract high-level representations from raw data. Motivated by the above observations, we take the advantage of network embedding techniques and propose an embedding-based recommendation method, which is composed of the embedding model and the collaborative filtering model. Specifically, to exploit the deep structure hidden in social networks and rating patterns, a neural network based embedding model is first pre-trained, where the external user and item representations are extracted. Then, we incorporate these extracted factors into a collaborative filtering model by fusing them with latent factors linearly, where our method not only can leverage the external information to enhance recommendation, but also can exploit the advantage of collaborative filtering techniques. Experimental results on two real-world datasets demonstrate the effectiveness of our proposed method and the importance of these external extracted factors.

[1]  Charles Elkan,et al.  Link Prediction via Matrix Factorization , 2011, ECML/PKDD.

[2]  Michael R. Lyu,et al.  Effective missing data prediction for collaborative filtering , 2007, SIGIR.

[3]  Daniel P. W. Ellis,et al.  Content-Aware Collaborative Music Recommendation Using Pre-trained Neural Networks , 2015, ISMIR.

[4]  Ji-Rong Wen,et al.  Learning Distributed Representations for Recommender Systems with a Network Embedding Approach , 2016, AIRS.

[5]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[6]  Charles Elkan,et al.  A Log-Linear Model with Latent Features for Dyadic Prediction , 2010, 2010 IEEE International Conference on Data Mining.

[7]  Thomas Hofmann,et al.  Collaborative filtering via gaussian probabilistic latent semantic analysis , 2003, SIGIR.

[8]  Haesun Park,et al.  Bounded matrix factorization for recommender system , 2013, Knowledge and Information Systems.

[9]  Chang-Dong Wang,et al.  FTMF: Recommendation in social network with Feature Transfer and Probabilistic Matrix Factorization , 2016, 2016 International Joint Conference on Neural Networks (IJCNN).

[10]  Michael R. Lyu,et al.  Learning to recommend with explicit and implicit social relations , 2011, TIST.

[11]  Xi Chen,et al.  Temporal Collaborative Filtering with Bayesian Probabilistic Tensor Factorization , 2010, SDM.

[12]  Jun Ma,et al.  Social Trust Aware Item Recommendation for Implicit Feedback , 2015, Journal of Computer Science and Technology.

[13]  Min Zhao,et al.  Social temporal collaborative ranking for context aware movie recommendation , 2013, TIST.

[14]  Ling Chen,et al.  Spatial-Aware Hierarchical Collaborative Deep Learning for POI Recommendation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[15]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[16]  Jérôme Gensel,et al.  Contextual User Profile for Adapting Information in Nomadic Environments , 2007, WISE Workshops.

[17]  Michael R. Lyu,et al.  Learning to recommend with social trust ensemble , 2009, SIGIR.

[18]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[19]  Zi Huang,et al.  Joint Modeling of User Check-in Behaviors for Real-time Point-of-Interest Recommendation , 2016, ACM Trans. Inf. Syst..

[20]  Mingzhe Wang,et al.  LINE: Large-scale Information Network Embedding , 2015, WWW.

[21]  Shazia Wasim Sadiq,et al.  Discovering interpretable geo-social communities for user behavior prediction , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[22]  Zhiyuan Liu,et al.  A Neural Network Approach to Joint Modeling Social Networks and Mobile Trajectories , 2016, ArXiv.

[23]  Zhaohui Wu,et al.  On Deep Learning for Trust-Aware Recommendations in Social Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[24]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[25]  John F. Canny,et al.  Collaborative filtering with privacy via factor analysis , 2002, SIGIR '02.

[26]  David M. Blei,et al.  Factorization Meets the Item Embedding: Regularizing Matrix Factorization with Item Co-occurrence , 2016, RecSys.

[27]  Weitong Chen,et al.  Learning Graph-based POI Embedding for Location-based Recommendation , 2016, CIKM.

[28]  Inderjit S. Dhillon,et al.  Parallel matrix factorization for recommender systems , 2014, Knowl. Inf. Syst..

[29]  Huan Liu,et al.  Exploiting Local and Global Social Context for Recommendation , 2013, IJCAI.

[30]  Shotaro Akaho,et al.  Model-Based Approaches for Independence-Enhanced Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining Workshops (ICDMW).

[31]  Wolfgang Nejdl,et al.  Introduction to the special section on twitter and microblogging services , 2013, TIST.

[32]  Bamshad Mobasher,et al.  The Role of Emotions in Context-aware Recommendation , 2013, Decisions@RecSys.

[33]  Yang Wang,et al.  SPTF: A Scalable Probabilistic Tensor Factorization Model for Semantic-Aware Behavior Prediction , 2017, 2017 IEEE International Conference on Data Mining (ICDM).

[34]  Hao Wang,et al.  Adapting to User Interest Drift for POI Recommendation , 2016, IEEE Transactions on Knowledge and Data Engineering.

[35]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[36]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[37]  Hady Wirawan Lauw,et al.  Representation Learning for Homophilic Preferences , 2016, RecSys.

[38]  Jun Ma,et al.  Learning to recommend with social relation ensemble , 2012, CIKM '12.

[39]  Hongzhi Yin,et al.  Spatio-Temporal Recommendation in Social Media , 2016, SpringerBriefs in Computer Science.

[40]  Hao Ma,et al.  An experimental study on implicit social recommendation , 2013, SIGIR.

[41]  Chi-Yin Chow,et al.  TICRec: A Probabilistic Framework to Utilize Temporal Influence Correlations for Time-Aware Location Recommendations , 2016, IEEE Transactions on Services Computing.

[42]  Martin Ester,et al.  TrustWalker: a random walk model for combining trust-based and item-based recommendation , 2009, KDD.

[43]  Chi-Yin Chow,et al.  LORE: exploiting sequential influence for location recommendations , 2014, SIGSPATIAL/GIS.

[44]  Wei-Ta Chu,et al.  A hybrid recommendation system considering visual information for predicting favorite restaurants , 2017, World Wide Web.

[45]  Chunyan Miao,et al.  Exploiting Geographical Neighborhood Characteristics for Location Recommendation , 2014, CIKM.

[46]  Nathan Srebro,et al.  Fast maximum margin matrix factorization for collaborative prediction , 2005, ICML.

[47]  Ling Chen,et al.  SPORE: A sequential personalized spatial item recommender system , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[48]  Xing Xie,et al.  GeoMF: joint geographical modeling and matrix factorization for point-of-interest recommendation , 2014, KDD.

[49]  Lidan Shou,et al.  SLADE: A Smart Large-Scale Task Decomposer in Crowdsourcing , 2018, IEEE Transactions on Knowledge and Data Engineering.

[50]  Weimin Li,et al.  Social recommendation based on trust and influence in SNS environments , 2017, Multimedia Tools and Applications.

[51]  Li Kuang,et al.  Identifying Core Users Based on Trust Relationships and Interest Similarity in Recommender System , 2016, 2016 IEEE International Conference on Web Services (ICWS).

[52]  Mejari Kumar,et al.  Connecting Social Media to E-Commerce: Cold-Start Product Recommendation using Microblogging Information , 2018 .

[53]  Martin Ester,et al.  A matrix factorization technique with trust propagation for recommendation in social networks , 2010, RecSys '10.

[54]  Michael R. Lyu,et al.  SoRec: social recommendation using probabilistic matrix factorization , 2008, CIKM '08.

[55]  Douglas B. Terry,et al.  Using collaborative filtering to weave an information tapestry , 1992, CACM.

[56]  Jeffrey Dean,et al.  Distributed Representations of Words and Phrases and their Compositionality , 2013, NIPS.

[57]  Lei Chen,et al.  Online mobile Micro-Task Allocation in spatial crowdsourcing , 2016, 2016 IEEE 32nd International Conference on Data Engineering (ICDE).

[58]  Paolo Avesani,et al.  Trust-aware recommender systems , 2007, RecSys '07.

[59]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[60]  Yulan He,et al.  Connecting Social Media to E-Commerce: Cold-Start Product Recommendation Using Microblogging Information , 2016, IEEE Transactions on Knowledge and Data Engineering.

[61]  Saurabh Kataria,et al.  Distributed Representations for Content-Based and Personalized Tag Recommendation , 2015, 2015 IEEE International Conference on Data Mining Workshop (ICDMW).

[62]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[63]  Qin Lv,et al.  Item-based top-N recommendation resilient to aggregated information revelation , 2014, Knowl. Based Syst..

[64]  Nicholas Jing Yuan,et al.  Regularized Content-Aware Tensor Factorization Meets Temporal-Aware Location Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).