BoostFM: Boosted Factorization Machines for Top-N Feature-based Recommendation

Feature-based matrix factorization techniques such as Factorization Machines (FM) have been proven to achieve impressive accuracy for the rating prediction task. However, most common recommendation scenarios are formulated as a top-N item ranking problem with implicit feedback (e.g., clicks, purchases)rather than explicit ratings. To address this problem, with both implicit feedback and feature information, we propose a feature-based collaborative boosting recommender called BoostFM, which integrates boosting into factorization models during the process of item ranking. Specifically, BoostFM is an adaptive boosting framework that linearly combines multiple homogeneous component recommenders, which are repeatedly constructed on the basis of the individual FM model by a re-weighting scheme. Two ways are proposed to efficiently train the component recommenders from the perspectives of both pairwise and listwise Learning-to-Rank (L2R). The properties of our proposed method are empirically studied on three real-world datasets. The experimental results show that BoostFM outperforms a number of state-of-the-art approaches for top-N recommendation.

[1]  Robert E. Schapire,et al.  Explaining AdaBoost , 2013, Empirical Inference.

[2]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1995, EuroCOLT.

[3]  Yoav Freund,et al.  A Short Introduction to Boosting , 1999 .

[4]  Lars Schmidt-Thieme,et al.  Pairwise interaction tensor factorization for personalized tag recommendation , 2010, WSDM '10.

[5]  Yehuda Koren,et al.  Collaborative filtering with temporal dynamics , 2009, KDD.

[6]  Martha Larson,et al.  TFMAP: optimizing MAP for top-n context-aware recommendation , 2012, SIGIR '12.

[7]  Xi Chen,et al.  Temporal Collaborative Filtering with Bayesian Probabilistic Tensor Factorization , 2010, SDM.

[8]  Yu Haitao,et al.  Joint Geo-Spatial Preference and Pairwise Ranking for Point-of-Interest Recommendation , 2016 .

[9]  Nuria Oliver,et al.  Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering , 2010, RecSys '10.

[10]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[11]  Chunyan Miao,et al.  A Boosting Algorithm for Item Recommendation with Implicit Feedback , 2015, IJCAI.

[12]  Weinan Zhang,et al.  LambdaFM: Learning Optimal Ranking with Factorization Machines Using Lambda Surrogates , 2016, CIKM.

[13]  Gregory N. Hullender,et al.  Learning to rank using gradient descent , 2005, ICML.

[14]  Steffen Rendle,et al.  Factorization Machines , 2010, 2010 IEEE International Conference on Data Mining.

[15]  Li Chen,et al.  Proceedings of the Twenty-Third International Joint Conference on Artificial Intelligence GBPR: Group Preference Based Bayesian Personalized Ranking for One-Class Collaborative Filtering , 2022 .

[16]  Hang Li,et al.  AdaRank: a boosting algorithm for information retrieval , 2007, SIGIR.

[17]  Martha Larson,et al.  CARS2: Learning Context-aware Representations for Context-aware Recommendations , 2014, CIKM.

[18]  Paola Campadelli,et al.  A Boosting Algorithm for Regression , 1997, ICANN.

[19]  Weinan Zhang,et al.  Optimizing Factorization Machines for Top-N Context-Aware Recommendations , 2016, WISE.

[20]  Brian D. Davison,et al.  Co-factorization machines: modeling user interests and predicting individual decisions in Twitter , 2013, WSDM.

[21]  Zhendong Niu,et al.  Novel Boosting Frameworks to Improve the Performance of Collaborative Filtering , 2013, ACML.

[22]  Quoc V. Le,et al.  Learning to Rank with Nonsmooth Cost Functions , 2006, Neural Information Processing Systems.

[23]  Steffen Rendle,et al.  Factorization Machines with libFM , 2012, TIST.

[24]  Xiaoli Li,et al.  Rank-GeoFM: A Ranking based Geographical Factorization Method for Point of Interest Recommendation , 2015, SIGIR.

[25]  Konstantina Christakopoulou,et al.  Collaborative Ranking with a Push at the Top , 2015, WWW.

[26]  Lei Wang,et al.  AdaBoost with SVM-based component classifiers , 2008, Eng. Appl. Artif. Intell..

[27]  Hailong Sun,et al.  AdaMF: Adaptive Boosting Matrix Factorization for Recommender System , 2014, WAIM.

[28]  Tong Zhang,et al.  Gradient boosting factorization machines , 2014, RecSys '14.

[29]  Francesco Ricci,et al.  Context-based splitting of item ratings in collaborative filtering , 2009, RecSys '09.

[30]  Jun Wang,et al.  Optimizing top-n collaborative filtering via dynamic negative item sampling , 2013, SIGIR.

[31]  Yoav Freund,et al.  A decision-theoretic generalization of on-line learning and an application to boosting , 1997, EuroCOLT.

[32]  J. Friedman Special Invited Paper-Additive logistic regression: A statistical view of boosting , 2000 .

[33]  BoostMF: Boosted Matrix Factorisation for Collaborative Ranking , 2015, ECML/PKDD.

[34]  Feng Liang,et al.  Exploiting ranking factorization machines for microblog retrieval , 2013, CIKM.

[35]  Steffen Rendle,et al.  Improving pairwise learning for item recommendation from implicit feedback , 2014, WSDM.

[36]  Joemon M. Jose,et al.  Joint Geo-Spatial Preference and Pairwise Ranking for Point-of-Interest Recommendation , 2016, 2016 IEEE 28th International Conference on Tools with Artificial Intelligence (ICTAI).