A Joint Neural Model for User Behavior Prediction on Social Networking Platforms

Social networking services provide platforms for users to perform two kinds of behaviors: consumption behavior (e.g., recommending items of interest) and social link behavior (e.g., recommending potential social links). Accurately modeling and predicting users’ two kinds of behaviors are two core tasks in these platforms with various applications. Recently, with the advance of neural networks, many neural-based models have been designed to predict a single users’ behavior, i.e., social link behavior or consumption behavior. Compared to the classical shallow models, these neural-based models show better performance to drive a user’s behavior by modeling the complex patterns. However, there are few works exploiting whether it is possible to design a neural-based model to jointly predict users’ two kinds of behaviors to further enhance the prediction performance. In fact, social scientists have already shown that users’ two kinds of behaviors are not isolated; people trend to the consumption recommendation of friends on social platforms and would like to make new friends with like-minded users. While some previous works jointly model users’ two kinds of behaviors with shallow models, we argue that the correlation between users’ two kinds of behaviors are complex, which could not be well-designed with shallow linear models. To this end, in this article, we propose a neural joint behavior prediction model named Neural Joint Behavior Prediction Model (NJBP) to mutually enhance the prediction performance of these two tasks on social networking platforms. Specifically, there are two key characteristics of our proposed model: First, to model the correlation of users’ two kinds of behaviors, we design a fusion layer in the neural network to model the positive correlation of users’ two kinds of behaviors. Second, as the observed links in the social network are often very sparse, we design a new link-based loss function that could preserve the social network topology. After that, we design a joint optimization function to allow the two behaviors modeling tasks to be trained to mutually enhance each other. Finally, extensive experimental results on two real-world datasets show that our proposed method is on average 7.14% better than the best baseline on social link behavior while 6.21% on consumption behavior prediction. Compared with the pair-wise loss function on two datasets, our proposed link-based loss function improves at least 4.69% on the social link behavior prediction and 4.72% on the consumption behavior prediction.

[1]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[2]  Jian Pei,et al.  A Survey on Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[3]  Tao Chen,et al.  TriRank: Review-aware Explainable Recommendation by Modeling Aspects , 2015, CIKM.

[4]  Xing Xie,et al.  xDeepFM: Combining Explicit and Implicit Feature Interactions for Recommender Systems , 2018, KDD.

[5]  Azadeh Iranmehr,et al.  Trust Management for Semantic Web , 2009, 2009 Second International Conference on Computer and Electrical Engineering.

[6]  Lukás Burget,et al.  Recurrent neural network based language model , 2010, INTERSPEECH.

[7]  Alexander J. Smola,et al.  Like like alike: joint friendship and interest propagation in social networks , 2011, WWW.

[8]  M. Newman,et al.  Vertex similarity in networks. , 2005, Physical review. E, Statistical, nonlinear, and soft matter physics.

[9]  Yanjie Fu,et al.  Joint Item Recommendation and Attribute Inference: An Adaptive Graph Convolutional Network Approach , 2020, SIGIR.

[10]  Qi Liu,et al.  Patent Litigation Prediction: A Convolutional Tensor Factorization Approach , 2018, IJCAI.

[11]  Dekang Lin,et al.  An Information-Theoretic Definition of Similarity , 1998, ICML.

[12]  M. Ozer,et al.  Social and juristic challenges of artificial intelligence , 2019, Palgrave Communications.

[13]  Sanda Martinčić-Ipšić,et al.  Link prediction on Twitter , 2017, PloS one.

[14]  Xiaojie Yuan,et al.  Neural Framework for Joint Evolution Modeling of User Feedback and Social Links in Dynamic Social Networks , 2018, IJCAI.

[15]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[16]  Le Wu,et al.  A Hierarchical Attention Model for Social Contextual Image Recommendation , 2018, IEEE Transactions on Knowledge and Data Engineering.

[17]  Le Wu,et al.  Modeling Users' Preferences and Social Links in Social Networking Services: A Joint-Evolving Perspective , 2016, AAAI.

[18]  Hui Li,et al.  A Deep Learning Approach to Link Prediction in Dynamic Networks , 2014, SDM.

[19]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[20]  Jon M. Kleinberg,et al.  The link-prediction problem for social networks , 2007, J. Assoc. Inf. Sci. Technol..

[21]  Xiangnan He,et al.  Attributed Social Network Embedding , 2017, IEEE Transactions on Knowledge and Data Engineering.

[22]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[23]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[24]  Yong Yu,et al.  Neural Link Prediction over Aligned Networks , 2018, AAAI.

[25]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[26]  Charu C. Aggarwal,et al.  Heterogeneous Network Embedding via Deep Architectures , 2015, KDD.

[27]  Jure Leskovec,et al.  node2vec: Scalable Feature Learning for Networks , 2016, KDD.

[28]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[29]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[30]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[31]  Nicholas Jing Yuan,et al.  Relevance Meets Coverage , 2016, ACM Trans. Intell. Syst. Technol..

[32]  Le Wu,et al.  A Neural Influence Diffusion Model for Social Recommendation , 2019, SIGIR.

[33]  Fei Wang,et al.  Scalable Recommendation with Social Contextual Information , 2014, IEEE Transactions on Knowledge and Data Engineering.

[34]  Jun Zhang,et al.  A Neural Collaborative Filtering Model with Interaction-based Neighborhood , 2017, CIKM.

[35]  Huan Liu,et al.  Exploiting homophily effect for trust prediction , 2013, WSDM.

[36]  George Karypis,et al.  Item-based top-N recommendation algorithms , 2004, TOIS.

[37]  Hui Xiong,et al.  Mutual Reinforcement of Academic Performance Prediction and Library Book Recommendation , 2016, 2016 IEEE 16th International Conference on Data Mining (ICDM).

[38]  Max Welling,et al.  Graph Convolutional Matrix Completion , 2017, ArXiv.

[39]  Charu C. Aggarwal,et al.  Evolutionary Network Analysis , 2014, ACM Comput. Surv..

[40]  Priya Satia,et al.  What guns meant in eighteenth-century Britain , 2019, Palgrave Communications.

[41]  Steven Skiena,et al.  DeepWalk: online learning of social representations , 2014, KDD.

[42]  Anh Duc Duong,et al.  Addressing cold-start problem in recommendation systems , 2008, ICUIMC '08.

[43]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[44]  Tat-Seng Chua,et al.  Neural Graph Collaborative Filtering , 2019, SIGIR.

[45]  Dirk Helbing,et al.  Saving Human Lives: What Complexity Science and Information Systems can Contribute , 2014, Journal of statistical physics.

[46]  Charles Elkan,et al.  Link Prediction via Matrix Factorization , 2011, ECML/PKDD.

[47]  Zhongfei Zhang,et al.  Dropout Training of Matrix Factorization and Autoencoder for Link Prediction in Sparse Graphs , 2015, SDM.

[48]  Wenwu Zhu,et al.  Structural Deep Network Embedding , 2016, KDD.

[49]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[50]  Arun Sundararajan,et al.  Distinguishing influence-based contagion from homophily-driven diffusion in dynamic networks , 2009, Proceedings of the National Academy of Sciences.

[51]  Jennifer Widom,et al.  SimRank: a measure of structural-context similarity , 2002, KDD.

[52]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[53]  Yi Tay,et al.  Deep Learning based Recommender System: A Survey and New Perspectives , 2018 .

[54]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[55]  Mark J. Huiskes,et al.  The MIR flickr retrieval evaluation , 2008, MIR '08.

[56]  Ghazaleh Beigi,et al.  Exploiting Emotional Information for Trust/Distrust Prediction , 2016, SDM.

[57]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[58]  Le Wu,et al.  Attentive Recurrent Social Recommendation , 2018, SIGIR.

[59]  Danqi Chen,et al.  Reasoning With Neural Tensor Networks for Knowledge Base Completion , 2013, NIPS.

[60]  Martin Ester,et al.  A matrix factorization technique with trust propagation for recommendation in social networks , 2010, RecSys '10.

[61]  Le Wu,et al.  Collaborative Neural Social Recommendation , 2018, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[62]  Alex Beutel,et al.  Recurrent Recommender Networks , 2017, WSDM.

[63]  Junping Du,et al.  Modeling the Evolution of Users’ Preferences and Social Links in Social Networking Services , 2017, IEEE Transactions on Knowledge and Data Engineering.