Identifying representative users in matrix factorization-based recommender systems: application to solving the content-less new item cold-start problem

Matrix factorization has proven to be one of the most accurate recommendation approaches. However, it faces one major shortcoming: the latent features that result from the factorization are not directly interpretable. Providing interpretation for these features is important not only to help explain the recommendations presented to users, but also to understand the underlying relations between the users and the items. This paper consists of 2 contributions. First, we propose to automatically interpret features as users, referred to as representative users. This interpretation relies on the study of the matrices that result from the factorization and on their link with the original rating matrix. Such an interpretation is not only performed automatically, as it does not require any human expertise, but it also helps to explain the recommendations. The second proposition of this paper is to exploit this interpretation to alleviate the content-less new item cold-start problem. The experiments conducted on several benchmark datasets confirm that the features discovered by a Non-Negative Matrix Factorization can be interpreted as users and that representative users are a reliable source of information that allows to accurately estimate ratings on new items. They are thus a promising way to solve the new item cold-start problem.

[1]  David C. Wilson,et al.  Assessing Impacts of a Power User Attack on a Matrix Factorization Collaborative Recommender System , 2014, FLAIRS.

[2]  Dennis M. Wilkinson,et al.  Large-Scale Parallel Collaborative Filtering for the Netflix Prize , 2008, AAIM.

[3]  Guokun Lai,et al.  Explicit factor models for explainable recommendation based on phrase-level sentiment analysis , 2014, SIGIR.

[4]  Shujian Huang,et al.  A Synthetic Approach for Recommendation: Combining Ratings, Social Relations, and Reviews , 2015, IJCAI.

[5]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[6]  Wei Chu,et al.  Information Services]: Web-based services , 2022 .

[7]  H. Sebastian Seung,et al.  Learning the parts of objects by non-negative matrix factorization , 1999, Nature.

[8]  Armelle Brun,et al.  Towards Leader Based Recommendations , 2013, The Influence of Technology on Social Network Analysis and Mining.

[9]  Mingxuan Sun,et al.  Learning multiple-question decision trees for cold-start recommendation , 2013, WSDM.

[10]  Lars Schmidt-Thieme,et al.  Learning Attribute-to-Feature Mappings for Cold-Start Recommendations , 2010, 2010 IEEE International Conference on Data Mining.

[11]  Erik Duval,et al.  Context-Aware Recommender Systems for Learning: A Survey and Future Challenges , 2012, IEEE Transactions on Learning Technologies.

[12]  Massih-Reza Amini,et al.  Factorisation en matrices non négatives pour le filtrage collaboratif , 2006, CORIA.

[13]  Xavier Amatriain,et al.  The wisdom of the few: a collaborative filtering approach based on expert opinions from the web , 2009, SIGIR.

[14]  Mehrbakhsh Nilashi,et al.  Collaborative filtering recommender systems , 2013 .

[15]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[16]  Bernhard Schölkopf,et al.  A Kernel for Protein Secondary Structure Prediction , 2004 .

[17]  Hagit Shatkay,et al.  Discovering semantic features in the literature: a foundation for building functional associations , 2006, BMC Bioinformatics.

[18]  H. Sebastian Seung,et al.  Algorithms for Non-negative Matrix Factorization , 2000, NIPS.

[19]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[20]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[21]  George Karypis,et al.  A Comprehensive Survey of Neighborhood-based Recommendation Methods , 2011, Recommender Systems Handbook.

[22]  Deepak Agarwal,et al.  fLDA: matrix factorization through latent dirichlet allocation , 2010, WSDM '10.

[23]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[24]  Pasquale Lops,et al.  Content-based Recommender Systems: State of the Art and Trends , 2011, Recommender Systems Handbook.

[25]  Wolfram Höpken,et al.  Evaluating Recommender Systems in Tourism - A Case Study from Austria , 2008, ENTER.

[26]  Anh Duc Duong,et al.  Addressing cold-start problem in recommendation systems , 2008, ICUIMC '08.

[27]  Francesco Ricci,et al.  Cold-Start Management with Cross-Domain Collaborative Filtering and Tags , 2013, EC-Web.

[28]  John Riedl,et al.  Mining influence in recommender systems , 2007 .

[29]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[30]  Dan Frankowski,et al.  Collaborative Filtering Recommender Systems , 2007, The Adaptive Web.

[31]  Abhinandan Das,et al.  Google news personalization: scalable online collaborative filtering , 2007, WWW '07.

[32]  Rong Pan,et al.  Constrained collective matrix factorization , 2012, RecSys.

[33]  辛欣,et al.  When Factorization Meets Heterogeneous Latent Topics: An Interpretable Cross-Site Recommendation Framework , 2015 .

[34]  Barry Smyth,et al.  Similarity vs. Diversity , 2001, ICCBR.

[35]  S. Goreinov,et al.  How to find a good submatrix , 2010 .

[36]  Shiu-li Huang,et al.  Designing utility-based recommender systems for e-commerce: Evaluation of preference-elicitation methods , 2011, Electron. Commer. Res. Appl..

[37]  A. Boyer,et al.  Search for User-related Features in Matrix Factorization-based Recommender Systems , 2014 .

[38]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[39]  Riccardo Dondi,et al.  Algorithmic Aspects in Information and Management , 2016, Lecture Notes in Computer Science.

[40]  Mark P. Graus,et al.  Understanding the Latent Features of Matrix Factorization Algorithms in Movie Recommender Systems , 2011 .

[41]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[42]  Lakhmi C. Jain,et al.  Recommender Systems in E-Learning Environments , 2017 .

[43]  Raymond J. Mooney,et al.  Content-boosted collaborative filtering for improved recommendations , 2002, AAAI/IAAI.

[44]  Mark P. Graus,et al.  Using latent features diversification to reduce choice difficulty in recommendation lists , 2011 .

[45]  Geoffrey J. Gordon,et al.  Relational learning via collective matrix factorization , 2008, KDD.

[46]  Armelle Brun,et al.  Can Latent Features Be Interpreted as Users in Matrix Factorization-Based Recommender Systems? , 2014, 2014 IEEE/WIC/ACM International Joint Conferences on Web Intelligence (WI) and Intelligent Agent Technologies (IAT).

[47]  Zoubin Ghahramani,et al.  Cold-start Active Learning with Robust Ordinal Matrix Factorization , 2014, ICML.

[48]  Pengfei Yue,et al.  Learning to Recommend with Hidden Factor Models and Social Trust Ensemble , 2015 .

[49]  Shuang-Hong Yang,et al.  Functional matrix factorizations for cold-start recommendation , 2011, SIGIR.

[50]  Rashmi R. Sinha,et al.  The role of transparency in recommender systems , 2002, CHI Extended Abstracts.

[51]  Nuria Oliver,et al.  Multiverse recommendation: n-dimensional tensor factorization for context-aware collaborative filtering , 2010, RecSys '10.

[52]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[53]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[54]  Chao Liu,et al.  Wisdom of the better few: cold start recommendation via representative based rating elicitation , 2011, RecSys '11.

[55]  Sven Behnke,et al.  Discovering hierarchical speech features using convolutional non-negative matrix factorization , 2003, Proceedings of the International Joint Conference on Neural Networks, 2003..

[56]  Ruslan Salakhutdinov,et al.  Bayesian probabilistic matrix factorization using Markov chain Monte Carlo , 2008, ICML '08.

[57]  P. Mohan Anand,et al.  Addressing Cold Start Problem in Recommendation System Using Custom Built Hadoop Ecosystem , 2018, 2018 Second International Conference on Inventive Communication and Computational Technologies (ICICCT).

[58]  Sean M. McNee,et al.  Getting to know you: learning new user preferences in recommender systems , 2002, IUI '02.

[59]  Martin Ester,et al.  A Transitivity Aware Matrix Factorization Model for Recommendation in Social Networks , 2011, IJCAI.

[60]  Martin SAVESKI June,et al.  Cold Start Recommendations : A Non-negative Matrix Factorization Approach , 2013 .

[61]  Alexandros Nanopoulos,et al.  Recommender systems in e-learning environments: a survey of the state-of-the-art and possible extensions , 2015, Artificial Intelligence Review.

[62]  Marco Rossetti,et al.  Advancing Recommender Systems from the Algorithm, Interface and Methodological Perspective , 2015 .

[63]  Guy Shani,et al.  Evaluating Recommendation Systems , 2011, Recommender Systems Handbook.

[64]  Fillia Makedon,et al.  Learning from Incomplete Ratings Using Non-negative Matrix Factorization , 2006, SDM.

[65]  Karthik Devarajan,et al.  Nonnegative Matrix Factorization: An Analytical and Interpretive Tool in Computational Biology , 2008, PLoS Comput. Biol..

[66]  Seungjin Choi,et al.  Weighted Nonnegative Matrix Co-Tri-Factorization for Collaborative Prediction , 2009, ACML.

[67]  Domonkos Tikk,et al.  Scalable Collaborative Filtering Approaches for Large Recommender Systems , 2009, J. Mach. Learn. Res..

[68]  Fernando Ortega,et al.  Using Hierarchical Graph Maps to Explain Collaborative Filtering Recommendations , 2014, Int. J. Intell. Syst..

[69]  Alok N. Choudhary,et al.  Elver: Recommending Facebook pages in cold start situation without content features , 2013, 2013 IEEE International Conference on Big Data.

[70]  John Riedl,et al.  Explaining collaborative filtering recommendations , 2000, CSCW '00.