Attribute-Aware Recommender System Based on Collaborative Filtering: Survey and Classification

Attribute-aware CF models aim at rating prediction given not only the historical rating given by users to items but also the information associated with users (e.g., age), items (e.g., price), and ratings (e.g., rating time). This paper surveys work in the past decade to develop attribute-aware CF systems and finds that they can be classified into four different categories mathematically. We provide readers not only with a high-level mathematical interpretation of the existing work in this area but also with mathematical insight into each category of models. Finally, we provide in-depth experiment results comparing the effectiveness of the major models in each category.

[1]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[2]  Seungjin Choi,et al.  Hierarchical variational Bayesian matrix co-factorization , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Balázs Hidasi,et al.  Fast ALS-based tensor factorization for context-aware recommendation from implicit feedback , 2012, ECML/PKDD.

[4]  Yuhong Guo,et al.  Convex Co-Embedding for Matrix Completion with Predictive Side Information , 2017, AAAI.

[5]  James She,et al.  Collaborative Variational Autoencoder for Recommender Systems , 2017, KDD.

[6]  Jie Tang,et al.  Addressing cold start in recommender systems: a semi-supervised co-training algorithm , 2014, SIGIR.

[7]  Stephen E. Robertson,et al.  SoftRank: optimizing non-smooth rank metrics , 2008, WSDM '08.

[8]  Sang-goo Lee,et al.  Context-Aware Recommendation by Aggregating User Context , 2009, 2009 IEEE Conference on Commerce and Enterprise Computing.

[9]  ChengXiang Zhai,et al.  Improving one-class collaborative filtering by incorporating rich user information , 2010, CIKM.

[10]  Ulrich Paquet,et al.  Xbox movies recommendations: variational bayes matrix factorization with embedded feature selection , 2013, RecSys.

[11]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[12]  Geoffrey J. Gordon,et al.  Relational learning via collective matrix factorization , 2008, KDD.

[13]  Lina Yao,et al.  Deep Learning Based Recommender System , 2017, ACM Comput. Surv..

[14]  Lei Yu,et al.  A Hybrid Collaborative Filtering Model with Deep Structure for Recommender Systems , 2017, AAAI.

[15]  M. Narasimha Murty,et al.  Fusing Diversity in Recommendations in Heterogeneous Information Networks , 2018, WSDM.

[16]  Martha Larson,et al.  Collaborative Filtering beyond the User-Item Matrix , 2014, ACM Comput. Surv..

[17]  Lars Schmidt-Thieme,et al.  Learning Attribute-to-Feature Mappings for Cold-Start Recommendations , 2010, 2010 IEEE International Conference on Data Mining.

[18]  Jinbo Bi,et al.  A Sparse Interactive Model for Matrix Completion with Side Information , 2016, NIPS.

[19]  Martha Larson,et al.  CLiMF: learning to maximize reciprocal rank with collaborative less-is-more filtering , 2012, RecSys.

[20]  Erik Duval,et al.  Context-Aware Recommender Systems for Learning: A Survey and Future Challenges , 2012, IEEE Transactions on Learning Technologies.

[21]  Martha Larson,et al.  CARS2: Learning Context-aware Representations for Context-aware Recommendations , 2014, CIKM.

[22]  Christopher Meek,et al.  Tied boltzmann machines for cold start recommendations , 2008, RecSys '08.

[23]  Arkadiusz Paterek,et al.  Improving regularized singular value decomposition for collaborative filtering , 2007 .

[24]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[25]  Karl Aberer,et al.  SoCo: a social network aided context-aware recommender system , 2013, WWW.

[26]  Huan Liu,et al.  Content-Aware Point of Interest Recommendation on Location-Based Social Networks , 2015, AAAI.

[27]  George Karypis,et al.  Sparse linear methods with side information for top-n recommendations , 2012, RecSys.

[28]  Alexandros Karatzoglou,et al.  Gaussian process factorization machines for context-aware recommendations , 2014, SIGIR.

[29]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[30]  Sangkeun Lee,et al.  Random walk based entity ranking on graph for multidimensional recommendation , 2011, RecSys '11.

[31]  Chih-Jen Lin,et al.  A Unified Algorithm for One-Cass Structured Matrix Factorization with Side Information , 2017, AAAI.

[32]  Michael R. Lyu,et al.  Improving Recommender Systems by Incorporating Social Contextual Information , 2011, TOIS.

[33]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[34]  Max Welling,et al.  Bayesian Matrix Factorization with Side Information and Dirichlet Process Mixtures , 2010, AAAI.

[35]  Zi Huang,et al.  Discrete Deep Learning for Fast Content-Aware Recommendation , 2018, WSDM.

[36]  Gediminas Adomavicius,et al.  Context-aware recommender systems , 2008, RecSys '08.

[37]  Maciej Kula,et al.  Metadata Embeddings for User and Item Cold-start Recommendations , 2015, CBRecSys@RecSys.

[38]  Laks V. S. Lakshmanan,et al.  HeteroMF: recommendation in heterogeneous information networks using context dependent factor models , 2013, WWW.

[39]  Luo Si,et al.  Matrix co-factorization for recommendation with rich side information and implicit feedback , 2011, HetRec '11.

[40]  Alessandro Bozzon,et al.  Learning Hierarchical Feature Influence for Recommendation by Recursive Regularization , 2016, RecSys.

[41]  Nicholas Jing Yuan,et al.  Collaborative Knowledge Base Embedding for Recommender Systems , 2016, KDD.

[42]  Pietro Liò,et al.  Bayesian Hybrid Matrix Factorisation for Data Integration , 2017, AISTATS.

[43]  Philip S. Yu,et al.  PathSim , 2011, Proc. VLDB Endow..

[44]  Kai Lu,et al.  Exploiting and Exploring Hierarchical Structure in Music Recommendation , 2012, AIRS.

[45]  Alexander J. Smola,et al.  Like like alike: joint friendship and interest propagation in social networks , 2011, WWW.

[46]  Chong Wang,et al.  Latent Collaborative Retrieval , 2012, ICML.

[47]  Binshan Lin,et al.  Using contextual information and multidimensional approach for recommendation , 2009, Expert Syst. Appl..

[48]  Ruslan Salakhutdinov,et al.  Bayesian probabilistic matrix factorization using Markov chain Monte Carlo , 2008, ICML '08.

[49]  Tong Zhang,et al.  Gradient boosting factorization machines , 2014, RecSys '14.

[50]  Sangkeun Lee,et al.  Exploiting Contextual Information from Event Logs for Personalized Recommendation , 2010, Computer and Information Science.

[51]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[52]  Naonori Ueda,et al.  Polynomial Networks and Factorization Machines: New Insights and Efficient Training Algorithms , 2016, ICML.

[53]  Seungjin Choi,et al.  Scalable Variational Bayesian Matrix Factorization with Side Information , 2014, AISTATS.

[54]  Yong Liu,et al.  Your neighbors affect your ratings: on geographical neighborhood influence to rating prediction , 2014, SIGIR.

[55]  Balázs Hidasi,et al.  General factorization framework for context-aware recommendations , 2014, Data Mining and Knowledge Discovery.

[56]  James Caverlee,et al.  TAPER: A Contextual Tensor-Based Approach for Personalized Expert Recommendation , 2016, RecSys.

[57]  Akram Salah,et al.  Exploiting User Demographic Attributes for Solving Cold-Start Problem in Recommender System , 2013 .

[58]  Qian Zhao,et al.  GB-CENT: Gradient Boosted Categorical Embedding and Numerical Trees , 2017, WWW.

[59]  Yi Zhang,et al.  Contextual Recommendation based on Text Mining , 2010, COLING.

[60]  Inderjit S. Dhillon,et al.  Tumblr Blog Recommendation with Boosted Inductive Matrix Completion , 2015, CIKM.

[61]  Yehuda Koren,et al.  Yahoo! music recommendations: modeling music ratings with temporal dynamics and item taxonomy , 2011, RecSys '11.

[62]  Scott Sanner,et al.  Social collaborative filtering for cold-start recommendations , 2014, RecSys '14.

[63]  Martha Larson,et al.  TFMAP: optimizing MAP for top-n context-aware recommendation , 2012, SIGIR '12.

[64]  Chih-Jen Lin,et al.  Field-aware Factorization Machines for CTR Prediction , 2016, RecSys.

[65]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[66]  Deepak Agarwal,et al.  Regression-based latent factor models , 2009, KDD.

[67]  Nuria Oliver,et al.  Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering , 2010, RecSys '10.

[68]  Xu Chen,et al.  Learning to Rank Features for Recommendation over Multiple Categories , 2016, SIGIR.

[69]  Charles Elkan,et al.  A Log-Linear Model with Latent Features for Dyadic Prediction , 2010, 2010 IEEE International Conference on Data Mining.

[70]  Seungjin Choi,et al.  Weighted Nonnegative Matrix Co-Tri-Factorization for Collaborative Prediction , 2009, ACML.

[71]  Guillaume Bouchard,et al.  Convex Collective Matrix Factorization , 2013, AISTATS.

[72]  Hayder Radha,et al.  Cold-Start Item and User Recommendation with Decoupled Completion and Transduction , 2015, RecSys.

[73]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[74]  Gao Cong,et al.  A General Recommendation Model for Heterogeneous Networks , 2016, IEEE Transactions on Knowledge and Data Engineering.

[75]  Yong Yu,et al.  SVDFeature: a toolkit for feature-based collaborative filtering , 2012, J. Mach. Learn. Res..

[76]  Chih-Jen Lin,et al.  LIBMF: A Library for Parallel Matrix Factorization in Shared-memory Systems , 2016, J. Mach. Learn. Res..

[77]  Christopher Meek,et al.  A unified approach to building hybrid recommender systems , 2009, RecSys '09.

[78]  Chong Wang,et al.  Collaborative topic modeling for recommending scientific articles , 2011, KDD.

[79]  Guillermo Sapiro,et al.  Kernelized Probabilistic Matrix Factorization: Exploiting Graphs and Side Information , 2012, SDM.

[80]  Yi-Hsuan Yang,et al.  Addressing Cold Start for Next-song Recommendation , 2016, RecSys.

[81]  Seungjin Choi,et al.  Bayesian Matrix Co-Factorization: Variational Algorithm and Cramér-Rao Bound , 2011, ECML/PKDD.

[82]  Bernd Ludwig,et al.  Matrix factorization techniques for context aware recommendation , 2011, RecSys '11.

[83]  Philip S. Yu,et al.  Multi-view Machines , 2015, WSDM.

[84]  Balázs Hidasi,et al.  Context-aware Preference Modeling with Factorization , 2015, RecSys.

[85]  Dit-Yan Yeung,et al.  Collaborative Deep Learning for Recommender Systems , 2014, KDD.

[86]  Jian Liu,et al.  Dual Similarity Regularization for Recommendation , 2016, PAKDD.

[87]  Thore Graepel,et al.  Matchbox: Large Scale Bayesian Recommendations , 2009 .

[88]  Samuel Kaski,et al.  Kernelized Bayesian Matrix Factorization , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[89]  Yizhou Sun,et al.  On Sampling Strategies for Neural Network-based Collaborative Filtering , 2017, KDD.

[90]  Congfu Xu,et al.  Tensor Completion with Side Information: A Riemannian Manifold Approach , 2017, IJCAI.

[91]  Chris H. Q. Ding,et al.  Collaborative Filtering: Weighted Nonnegative Matrix Factorization Incorporating User and Item Graphs , 2010, SDM.

[92]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[93]  Scott Sanner,et al.  Low-Rank Linear Cold-Start Recommendation from Social Data , 2017, AAAI.

[94]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[95]  Lars Schmidt-Thieme,et al.  Fast context-aware recommendations with factorization machines , 2011, SIGIR.

[96]  Dit-Yan Yeung,et al.  Collaborative Recurrent Autoencoder: Recommend while Learning to Fill in the Blanks , 2016, NIPS.

[97]  Yehuda Koren,et al.  Advances in Collaborative Filtering , 2011, Recommender Systems Handbook.

[98]  Amin Mantrach,et al.  Item cold-start recommendations: learning local collective embeddings , 2014, RecSys '14.

[99]  Tao Zhang,et al.  Recommendation in Heterogeneous Information Networks Based on Generalized Random Walk Model and Bayesian Personalized Ranking , 2018, WSDM.

[100]  Raphaël Troncy,et al.  entity2rec: Learning User-Item Relatedness from Knowledge Graphs for Top-N Item Recommendation , 2017, RecSys.

[101]  John R. Anderson,et al.  Beyond Globally Optimal: Focused Learning for Improved Recommendations , 2017, WWW.

[102]  Julian J. McAuley,et al.  VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback , 2015, AAAI.

[103]  Qiang Yang,et al.  General Functional Matrix Factorization Using Gradient Boosting , 2013, ICML.

[104]  Miao Xu,et al.  Speedup Matrix Completion with Side Information: Application to Multi-Label Learning , 2013, NIPS.

[105]  Sachin Garg,et al.  Response prediction using collaborative filtering with hierarchies and side-information , 2011, KDD.

[106]  Zhen Lin,et al.  Context-Aware Collaborative Topic Regression with Social Matrix Factorization for Recommender Systems , 2014, AAAI.

[107]  Nagarajan Natarajan,et al.  Inductive matrix completion for predicting gene–disease associations , 2014, Bioinform..

[108]  Philip S. Yu,et al.  Multilinear Factorization Machines for Multi-Task Multi-View Learning , 2017, WSDM.

[109]  Xiaoyu Du,et al.  Outer Product-based Neural Collaborative Filtering , 2018, IJCAI.

[110]  Jia Li,et al.  Latent Cross: Making Use of Context in Recurrent Recommender Systems , 2018, WSDM.

[111]  Yizhou Sun,et al.  Personalized entity recommendation: a heterogeneous information network approach , 2014, WSDM.

[112]  Xuan Li,et al.  User Graph Regularized Pairwise Matrix Factorization for Item Recommendation , 2011, ADMA.

[113]  Ryan P. Adams,et al.  Incorporating Side Information in Probabilistic Matrix Factorization with Gaussian Processes , 2010, UAI.

[114]  Hong Shen,et al.  Two-Phase Layered Learning Recommendation via Category Structure , 2014, PAKDD.

[115]  F. O. Isinkaye,et al.  Recommendation systems: Principles, methods and evaluation , 2015 .

[116]  Wei Wu,et al.  Learning Context-aware Latent Representations for Context-aware Collaborative Filtering , 2015, SIGIR.

[117]  Sunho Park,et al.  Hierarchical Bayesian Matrix Factorization with Side Information , 2013, IJCAI.

[118]  F. Maxwell Harper,et al.  The MovieLens Datasets: History and Context , 2016, TIIS.

[119]  Deborah Estrin,et al.  Collaborative Metric Learning , 2017, WWW.

[120]  Min Xiao,et al.  Predictive Collaborative Filtering with Side Information , 2016, IJCAI.

[121]  Naonori Ueda,et al.  Convex Factorization Machines , 2015, ECML/PKDD.

[122]  Arindam Banerjee,et al.  Generalized Probabilistic Matrix Factorizations for Collaborative Filtering , 2010, 2010 IEEE International Conference on Data Mining.

[123]  Yuhong Guo,et al.  Learning Discriminative Recommendation Systems with Side Information , 2017, IJCAI.

[124]  Hiroyuki Kasai,et al.  Low-rank tensor completion: a Riemannian manifold preconditioning approach , 2016, ICML.