User Preference Learning for Online Social Recommendation

A social recommendation system has attracted a lot of attention recently in the research communities of information retrieval, machine learning, and data mining. Traditional social recommendation algorithms are often based on batch machine learning methods which suffer from several critical limitations, e.g., extremely expensive model retraining cost whenever new user ratings arrive, unable to capture the change of user preferences over time. Therefore, it is important to make social recommendation system suitable for real-world online applications where data often arrives sequentially and user preferences may change dynamically and rapidly. In this paper, we present a new framework of online social recommendation from the viewpoint of online graph regularized user preference learning (OGRPL), which incorporates both collaborative user-item relationship as well as item content features into an unified preference learning process. We further develop an efficient iterative procedure, OGRPL-FW which utilizes the Frank-Wolfe algorithm, to solve the proposed online optimization problem. We conduct extensive experiments on several large-scale datasets, in which the encouraging results demonstrate that the proposed algorithms obtain significantly lower errors (in terms of both RMSE and MAE) than the state-of-the-art online recommendation methods when receiving the same amount of training data in the online learning process.

[1]  Yelong Shen,et al.  Learning personal + social latent factor model for social recommendation , 2012, KDD.

[2]  Jun Zhu,et al.  Online Nonparametric Max-Margin Matrix Factorization for Collaborative Prediction , 2012, 2014 IEEE International Conference on Data Mining.

[3]  Hui Xiong,et al.  Point-of-Interest Recommendation in Location Based Social Networks with Topic and Location Awareness , 2013, SDM.

[4]  Hao Ma,et al.  An experimental study on implicit social recommendation , 2013, SIGIR.

[5]  Yan Liu,et al.  Collaborative Topic Regression with Social Matrix Factorization for Recommendation Systems , 2012, ICML.

[6]  Jinfeng Yi,et al.  Crowdclustering with Sparse Pairwise Labels: A Matrix Completion Approach , 2012, HCOMP@AAAI.

[7]  Wu-Jun Li,et al.  Collaborative Topic Regression with Social Regularization for Tag Recommendation , 2013, IJCAI.

[8]  Fei Wang,et al.  Scalable Recommendation with Social Contextual Information , 2014, IEEE Transactions on Knowledge and Data Engineering.

[9]  Raymond J. Mooney,et al.  Content-boosted collaborative filtering for improved recommendations , 2002, AAAI/IAAI.

[10]  Li Guo,et al.  Combining Heterogenous Social and Geographical Information for Event Recommendation , 2014, AAAI.

[11]  Zhigang Luo,et al.  Online Nonnegative Matrix Factorization With Robust Stochastic Approximation , 2012, IEEE Transactions on Neural Networks and Learning Systems.

[12]  Chun Chen,et al.  Social Recommendation Using Low-Rank Semidefinite Program , 2011, AAAI.

[13]  Naonori Ueda,et al.  Online Passive-Aggressive Algorithms for Non-Negative Matrix Factorization and Completion , 2014, AISTATS.

[14]  Steven C. H. Hoi,et al.  Second Order Online Collaborative Filtering , 2013, ACML.

[15]  Huan Liu,et al.  Exploring temporal effects for location recommendation on location-based social networks , 2013, RecSys.

[16]  Shujian Huang,et al.  A Synthetic Approach for Recommendation: Combining Ratings, Social Relations, and Reviews , 2015, IJCAI.

[17]  Martin Ester,et al.  Recommendation in social networks , 2013, RecSys.

[18]  Jing Wang,et al.  Online Group Feature Selection , 2013, IJCAI.

[19]  Guillermo Sapiro,et al.  Online Learning for Matrix Factorization and Sparse Coding , 2009, J. Mach. Learn. Res..

[20]  Laks V. S. Lakshmanan,et al.  Optimal recommendations under attraction, aversion, and social influence , 2014, KDD.

[21]  Jie Tang,et al.  Recommendation in social media: recent advances and new frontiers , 2014, KDD.

[22]  Huan Liu,et al.  Content-Aware Point of Interest Recommendation on Location-Based Social Networks , 2015, AAAI.

[23]  Thore Graepel,et al.  WWW 2009 MADRID! Track: Data Mining / Session: Statistical Methods Matchbox: Large Scale Online Bayesian Recommendations , 2022 .

[24]  Harald Steck,et al.  Circle-based recommendation in online social networks , 2012, KDD.

[25]  Huan Liu,et al.  Exploring Implicit Hierarchical Structures for Recommender Systems , 2015, IJCAI.

[26]  Lifeng Sun,et al.  Joint Social and Content Recommendation for User-Generated Videos in Online Social Network , 2013, IEEE Transactions on Multimedia.

[27]  Cewu Lu,et al.  Online Robust Dictionary Learning , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Huan Liu,et al.  Exploiting Local and Global Social Context for Recommendation , 2013, IJCAI.

[29]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[30]  Shuicheng Yan,et al.  Robust Object Tracking with Online Multi-lifespan Dictionary Learning , 2013, 2013 IEEE International Conference on Computer Vision.

[31]  Wilfred Ng,et al.  Expert Finding for Question Answering via Graph Regularized Matrix Completion , 2015, IEEE Transactions on Knowledge and Data Engineering.

[32]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[33]  Kaare Brandt Petersen,et al.  The Matrix Cookbook , 2006 .

[34]  Wei Pang,et al.  Hete-CF: Social-Based Collaborative Filtering Recommendation Using Heterogeneous Relations , 2014, 2014 IEEE International Conference on Data Mining.

[35]  Martin Jaggi,et al.  A Simple Algorithm for Nuclear Norm Regularized Problems , 2010, ICML.

[36]  Martin Jaggi,et al.  Revisiting Frank-Wolfe: Projection-Free Sparse Convex Optimization , 2013, ICML.

[37]  Michael R. Lyu,et al.  UserRec: A User Recommendation Framework in Social Tagging Systems , 2010, AAAI.

[38]  Jianyong Wang,et al.  Incorporating heterogeneous information for personalized tag recommendation in social tagging systems , 2012, KDD.

[39]  Elad Hazan,et al.  Projection-free Online Learning , 2012, ICML.

[40]  Mu Zhu,et al.  Content-boosted matrix factorization for recommender systems: experiments with recipe recommendation , 2011, RecSys '11.

[41]  Jinfeng Yi,et al.  Inferring Users' Preferences from Crowdsourced Pairwise Comparisons: A Matrix Completion Approach , 2013, HCOMP.

[42]  Yujia Li,et al.  Celebrity Recommendation with Collaborative Social Topic Regression , 2013, IJCAI.

[43]  Henryk Wozniakowski,et al.  Estimating the Largest Eigenvalue by the Power and Lanczos Algorithms with a Random Start , 1992, SIAM J. Matrix Anal. Appl..

[44]  Xi Zhang,et al.  TopRec: domain-specific recommendation through community topic mining in social network , 2013, WWW '13.

[45]  Rong Jin,et al.  Online Feature Selection and Its Applications , 2014, IEEE Transactions on Knowledge and Data Engineering.

[46]  Arindam Banerjee,et al.  Online (cid:96) 1 -Dictionary Learning with Application to Novel Document Detection , 2012 .

[47]  Jieping Ye,et al.  An accelerated gradient method for trace norm minimization , 2009, ICML '09.

[48]  Mikhail Belkin,et al.  Manifold Regularization: A Geometric Framework for Learning from Labeled and Unlabeled Examples , 2006, J. Mach. Learn. Res..

[49]  Emmanuel J. Candès,et al.  Matrix Completion With Noise , 2009, Proceedings of the IEEE.

[50]  Tze-Yun Leong,et al.  Online Feature Selection for Model-based Reinforcement Learning , 2013, ICML.

[51]  s-taiji Dual Averaging and Proximal Gradient Descent for Online Alternating Direction Multiplier Method , 2013 .

[52]  N. Latha,et al.  Personalized Recommendation Combining User Interest and Social Circle , 2015 .

[53]  Min Zhao,et al.  Online evolutionary collaborative filtering , 2010, RecSys '10.

[54]  J. Kuczy,et al.  Estimating the Largest Eigenvalue by the Power and Lanczos Algorithms with a Random Start , 1992 .

[55]  Koby Crammer,et al.  Online Passive-Aggressive Algorithms , 2003, J. Mach. Learn. Res..

[56]  Xing Xie,et al.  Mobile Query Recommendation via Tensor Function Learning , 2015, IJCAI.

[57]  Chen Zhang,et al.  News Recommendation in Forum-Based Social Media , 2010, AAAI.