DeepCF: A Unified Framework of Representation Learning and Matching Function Learning in Recommender System

In general, recommendation can be viewed as a matching problem, i.e., match proper items for proper users. However, due to the huge semantic gap between users and items, it's almost impossible to directly match users and items in their initial representation spaces. To solve this problem, many methods have been studied, which can be generally categorized into two types, i.e., representation learning-based CF methods and matching function learning-based CF methods. Representation learning-based CF methods try to map users and items into a common representation space. In this case, the higher similarity between a user and an item in that space implies they match better. Matching function learning-based CF methods try to directly learn the complex matching function that maps user-item pairs to matching scores. Although both methods are well developed, they suffer from two fundamental flaws, i.e., the limited expressiveness of dot product and the weakness in capturing low-rank relations respectively. To this end, we propose a general framework named DeepCF, short for Deep Collaborative Filtering, to combine the strengths of the two types of methods and overcome such flaws. Extensive experiments on four publicly available datasets demonstrate the effectiveness of the proposed DeepCF framework.

[1]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[2]  Chang-Dong Wang,et al.  Low-Rank and Sparse Cross-Domain Recommendation Algorithm , 2018, DASFAA.

[3]  Philip S. Yu,et al.  Serendipitous Recommendation in E-Commerce Using Innovator-Based Collaborative Filtering , 2019, IEEE Transactions on Cybernetics.

[4]  Yee Whye Teh,et al.  Learning Label Trees for Probabilistic Modelling of Implicit Feedback , 2012, NIPS.

[5]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[6]  Qian Zhao,et al.  GB-CENT: Gradient Boosted Categorical Embedding and Numerical Trees , 2017, WWW.

[7]  Chang-Dong Wang,et al.  An item orientated recommendation algorithm from the multi-view perspective , 2017, Neurocomputing.

[8]  Xiaoyu Du,et al.  Outer Product-based Neural Collaborative Filtering , 2018, IJCAI.

[9]  Jia Li,et al.  Latent Cross: Making Use of Context in Recurrent Recommender Systems , 2018, WSDM.

[10]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[11]  Girish Keshav Palshikar,et al.  What’s Next? A Recommendation System for Industrial Training , 2017, Data Science and Engineering.

[12]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[13]  Tat-Seng Chua,et al.  Neural Factorization Machines for Sparse Predictive Analytics , 2017, SIGIR.

[14]  Martin Ester,et al.  Collaborative Denoising Auto-Encoders for Top-N Recommender Systems , 2016, WSDM.

[15]  Tat-Seng Chua,et al.  Fast Matrix Factorization for Online Recommendation with Implicit Feedback , 2016, SIGIR.

[16]  Douglas W. Oard,et al.  Implicit Feedback for Recommender Systems , 1998 .

[17]  Qiang Yang,et al.  One-Class Collaborative Filtering , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[18]  Scott Sanner,et al.  AutoRec: Autoencoders Meet Collaborative Filtering , 2015, WWW.

[19]  Peter Glöckner,et al.  Why Does Unsupervised Pre-training Help Deep Learning? , 2013 .

[20]  Julian J. McAuley,et al.  VBPR: Visual Bayesian Personalized Ranking from Implicit Feedback , 2015, AAAI.

[21]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[22]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[23]  Chang-Dong Wang,et al.  Item orientated recommendation by multi-view intact space learning with overlapping , 2019, Knowl. Based Syst..

[24]  Yunming Ye,et al.  DeepFM: A Factorization-Machine based Neural Network for CTR Prediction , 2017, IJCAI.

[25]  Jun Zhang,et al.  A Neural Collaborative Filtering Model with Interaction-based Neighborhood , 2017, CIKM.

[26]  Hao Ma,et al.  An experimental study on implicit social recommendation , 2013, SIGIR.

[27]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[28]  Tat-Seng Chua,et al.  TEM: Tree-enhanced Embedding Model for Explainable Recommendation , 2018, WWW.

[29]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[30]  Cigdem Bakir Collaborative Filtering with Temporal Dynamics with Using Singular Value Decomposition , 2018 .

[31]  Hang Li,et al.  Deep Learning for Matching in Search and Recommendation , 2018, SIGIR.

[32]  Tat-Seng Chua,et al.  Neural Collaborative Filtering , 2017, WWW.

[33]  Ruslan Salakhutdinov,et al.  Bayesian probabilistic matrix factorization using Markov chain Monte Carlo , 2008, ICML '08.

[34]  Yong Liu,et al.  Your neighbors affect your ratings: on geographical neighborhood influence to rating prediction , 2014, SIGIR.

[35]  Yi Zhang,et al.  Deep Embedding Forest: Forest-based Serving with Deep Embedding Features , 2017, KDD.

[36]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.