FeatureMF: An Item Feature Enriched Matrix Factorization Model for Item Recommendation

Matrix Factorization (MF) is one of the most successful Collaborative Filtering (CF) techniques used in recommender systems due to its effectiveness and ability to deal with very large user-item rating matrix. However, when the rating matrix sparseness increases its performance deteriorates. Expanding MF to include side-information of users and items has been shown by many researchers both to improve general recommendation performance and to help alleviate the data-sparsity and cold-start issues in CF. In regard to item feature side-information, most schemes incorporate this information through a two stage process: intermediate results (e.g., on item similarity) are first computed based on item attributes; these are then combined with MF. In this paper, focussing on item side-information, we propose a model that directly incorporates item features into the MF framework in a single step process. The model, which we name FeatureMF, does this by projecting every available attribute datum in each of the item features into the same latent factor space with users and items, thereby in effect enriching item representation in MF. Results are presented of comparative performance experiments of the model against three state-of-the-art item information enriched models, as well as against four reference benchmark models, using two public real-world datasets, Douban and Yelp, with four training:test ratio scenarios each. It is shown to yield the best recommendation performance over all these models across all contexts including data-sparsity situations, in particular, achieving over 0.9% to over 6.5% MAE recommendation performance improvement over the next best model, HERec. FeatureMF is also found to alleviate cold start and to scale well, almost linearly, in regard to computational time, as a function of dataset size.

[1]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[2]  Ivan Ganchev,et al.  A trust-enriched approach for item-based collaborative filtering recommendations , 2016, 2016 IEEE 12th International Conference on Intelligent Computer Communication and Processing (ICCP).

[3]  Martin Ester,et al.  A matrix factorization technique with trust propagation for recommendation in social networks , 2010, RecSys '10.

[4]  Stephen J. Wright,et al.  Hogwild: A Lock-Free Approach to Parallelizing Stochastic Gradient Descent , 2011, NIPS.

[5]  Mu Zhu,et al.  Content‐boosted matrix factorization techniques for recommender systems , 2012, Stat. Anal. Data Min..

[6]  Ivan Ganchev,et al.  A Hybrid Service Recommendation Prototype Adapted for the UCWW: A Smart-City Orientation , 2017, Wirel. Commun. Mob. Comput..

[7]  Neil Yorke-Smith,et al.  A Novel Recommendation Model Regularized with User Trust and Item Ratings , 2016, IEEE Transactions on Knowledge and Data Engineering.

[8]  Lars Schmidt-Thieme,et al.  Attribute-aware non-linear co-embeddings of graph features , 2019, RecSys.

[9]  Ivan Ganchev,et al.  Hybrid recommendation for sparse rating matrix: A heterogeneous information network approach , 2017, 2017 IEEE 2nd Advanced Information Technology, Electronic and Automation Control Conference (IAEAC).

[10]  Philip S. Yu,et al.  Heterogeneous Information Network Embedding for Recommendation , 2017, IEEE Transactions on Knowledge and Data Engineering.

[11]  Yang Gao,et al.  Attributes coupling based matrix factorization for item recommendation , 2017, Applied Intelligence.

[12]  Philip S. Yu,et al.  Semantic Path based Personalized Recommendation on Weighted Heterogeneous Information Networks , 2015, CIKM.

[13]  Vincent P. Wade,et al.  Personalised Information Retrieval: survey and classification , 2013, User Modeling and User-Adapted Interaction.

[14]  Arkadiusz Paterek,et al.  Predicting movie ratings and recommender systems , 2012 .

[15]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[16]  Hong Qu,et al.  An Efficient Deep Learning Model to Infer User Demographic Information From Ratings , 2019, IEEE Access.

[17]  Yi Tay,et al.  Deep Learning based Recommender System: A Survey and New Perspectives , 2018 .

[18]  Alexander J. Smola,et al.  Parallelized Stochastic Gradient Descent , 2010, NIPS.

[19]  Ruslan Salakhutdinov,et al.  Bayesian probabilistic matrix factorization using Markov chain Monte Carlo , 2008, ICML '08.

[20]  Yehuda Koren,et al.  On the Difficulty of Evaluating Baselines: A Study on Recommender Systems , 2019, ArXiv.

[21]  Philip S. Yu,et al.  SemRec: a personalized semantic recommendation method based on weighted heterogeneous information networks , 2018, World Wide Web.

[22]  Iván Cantador,et al.  Alleviating the new user problem in collaborative filtering by exploiting personality information , 2016, User Modeling and User-Adapted Interaction.

[23]  Jian Wang,et al.  Deep hybrid collaborative filtering for Web service recommendation , 2018, Expert Syst. Appl..

[24]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[25]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[26]  Abhinandan Das,et al.  Google news personalization: scalable online collaborative filtering , 2007, WWW '07.

[27]  Ivan Ganchev,et al.  Exploiting User Feedbacks in Matrix Factorization for Recommender Systems , 2017, MEDI.

[28]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[29]  T. Chai,et al.  Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature , 2014 .

[30]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[31]  Philip S. Yu,et al.  Leveraging Meta-path based Context for Top- N Recommendation with A Neural Co-Attention Model , 2018, KDD.

[32]  Zhihua Cui,et al.  Personalized Recommendation System Based on Collaborative Filtering for IoT Scenarios , 2020, IEEE Transactions on Services Computing.

[33]  Jian Liu,et al.  Recommendation in heterogeneous information network via dual similarity regularization , 2016, International Journal of Data Science and Analytics.

[34]  Léon Bottou,et al.  Stochastic Gradient Descent Tricks , 2012, Neural Networks: Tricks of the Trade.

[35]  Lina Yao,et al.  AutoSVD++: An Efficient Hybrid Collaborative Filtering Model via Contractive Auto-encoders , 2017, SIGIR.

[36]  James Bennett,et al.  The Netflix Prize , 2007 .

[37]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[38]  Dietmar Jannach,et al.  Are we really making much progress? A worrying analysis of recent neural recommendation approaches , 2019, RecSys.

[39]  Martha Larson,et al.  Collaborative Filtering beyond the User-Item Matrix , 2014, ACM Comput. Surv..

[40]  Neil Yorke-Smith,et al.  LibRec: A Java Library for Recommender Systems , 2015, UMAP Workshops.

[41]  Mohan S. Kankanhalli,et al.  A^3NCF: An Adaptive Aspect Attention Model for Rating Prediction , 2018, IJCAI.

[42]  Arkadiusz Paterek,et al.  Improving regularized singular value decomposition for collaborative filtering , 2007 .