Metalearning and Recommender Systems: A literature review and empirical study on the algorithm selection problem for Collaborative Filtering

Abstract The problem of information overload motivated the appearance of Recommender Systems. From the several open problems in this area, the decision of which is the best recommendation algorithm for a specific problem is one of the most important and less studied. The current trend to solve this problem is the experimental evaluation of several recommendation algorithms in a handful of datasets. However, these studies require an extensive amount of computational resources, particularly processing time. To avoid these drawbacks, researchers have investigated the use of Metalearning to select the best recommendation algorithms in different scopes. Such studies allow to understand the relationships between data characteristics and the relative performance of recommendation algorithms, which can be used to select the best algorithm(s) for a new problem. The contributions of this study are two-fold: 1) to identify and discuss the key concepts of algorithm selection for recommendation algorithms via a systematic literature review and 2) to perform an experimental study on the Metalearning approaches reviewed in order to identify the most promising concepts for automatic selection of recommendation algorithms.

[1]  Daniel Dajun Zeng,et al.  Why Does Collaborative Filtering Work? Transaction-Based Recommendation Model Validation and Selection by Analyzing Bipartite Random Graphs , 2011, INFORMS J. Comput..

[2]  Kenneth Y. Goldberg,et al.  Eigentaste: A Constant Time Collaborative Filtering Algorithm , 2001, Information Retrieval.

[3]  Myra Spiliopoulou,et al.  Predicting the Performance of Collaborative Filtering Algorithms , 2014, WIMS '14.

[4]  Rongsheng Wang,et al.  The Followee Recommendation Algorithm Based on Microblog User Interest and Characteristic , 2014 .

[5]  Carlos Soares,et al.  A Meta-Learning Method to Select the Kernel Width in Support Vector Regression , 2004, Machine Learning.

[6]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  Selecting Collaborative Filtering Algorithms Using Metalearning , 2016, ECML/PKDD.

[7]  Jure Leskovec,et al.  Hidden factors and hidden topics: understanding rating dimensions with review text , 2013, RecSys.

[8]  João Mendes-Moreira,et al.  Towards Automatic Generation of Metafeatures , 2016, PAKDD.

[9]  Abraham Bernstein,et al.  A survey of intelligent assistants for data analysis , 2013, CSUR.

[10]  John Riedl,et al.  Analysis of recommendation algorithms for e-commerce , 2000, EC '00.

[11]  Lars Schmidt-Thieme,et al.  MyMediaLite: a free recommender system library , 2011, RecSys '11.

[12]  Teresa Bernarda Ludermir,et al.  Meta-learning approaches to selecting time series models , 2004, Neurocomputing.

[13]  Gediminas Adomavicius,et al.  Impact of data characteristics on recommender systems performance , 2012, TMIS.

[14]  Steven D. Brown,et al.  Handbook of applied multivariate statistics and mathematical modeling , 2000 .

[15]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[16]  Juntao Liu,et al.  Conditional preference in recommender systems , 2015, Expert Syst. Appl..

[17]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[18]  Fernando Ortega,et al.  Recommending items to group of users using Matrix Factorization based Collaborative Filtering , 2016, Inf. Sci..

[19]  Sophie Ahrens,et al.  Recommender Systems , 2012 .

[20]  Alan Said,et al.  Comparative recommender system evaluation: benchmarking recommendation frameworks , 2014, RecSys '14.

[21]  Thierry Bertin-Mahieux,et al.  The Million Song Dataset , 2011, ISMIR.

[22]  Ricardo Vilalta,et al.  Metalearning - Applications to Data Mining , 2008, Cognitive Technologies.

[23]  John Riedl,et al.  When recommenders fail: predicting recommender failure for algorithm selection and combination , 2012, RecSys.

[24]  Yang Guo,et al.  A survey of collaborative filtering based social recommender systems , 2014, Comput. Commun..

[25]  Junwei Wang,et al.  Recurrent neural network based recommendation for time heterogeneous feedback , 2016, Knowl. Based Syst..

[26]  Toon De Pessemier,et al.  MovieTweetings: a movie rating dataset collected from twitter , 2013, RecSys 2013.

[27]  Juntao Liu,et al.  Bayesian Probabilistic Matrix Factorization with Social Relations and Item Contents for recommendation , 2013, Decis. Support Syst..

[28]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[29]  Iván Cantador,et al.  Time-aware recommender systems: a comprehensive survey and analysis of existing evaluation protocols , 2013, User Modeling and User-Adapted Interaction.

[30]  Matthew Richardson,et al.  Trust Management for the Semantic Web , 2003, SEMWEB.

[31]  Junwei Wang,et al.  Representing conditional preference by boosted regression trees for recommendation , 2016, Inf. Sci..

[32]  John R. Rice,et al.  The Algorithm Selection Problem , 1976, Adv. Comput..

[33]  Gediminas Adomavicius,et al.  Incorporating contextual information in recommender systems using a multidimensional approach , 2005, TOIS.

[34]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[35]  André Carlos Ponce de Leon Ferreira de Carvalho,et al.  MetaStream: A meta-learning based method for periodic algorithm selection in time-changing data , 2014, Neurocomputing.

[36]  Janez Demsar,et al.  Statistical Comparisons of Classifiers over Multiple Data Sets , 2006, J. Mach. Learn. Res..

[37]  Josephine Griffith,et al.  Investigations into user rating information and predictive accuracy in a collaborative filtering domain , 2012, SAC '12.

[38]  Robin D. Burke,et al.  Hybrid Web Recommender Systems , 2007, The Adaptive Web.

[39]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[40]  Hwanjo Yu,et al.  Deep hybrid recommender systems via exploiting document context and statistics of items , 2017, Inf. Sci..

[41]  José Juan Pazos-Arias,et al.  Providing entertainment by content-based filtering and semantic reasoning in intelligent recommender systems , 2008, IEEE Transactions on Consumer Electronics.

[42]  Yue Lu,et al.  Latent aspect rating analysis without aspect keyword supervision , 2011, KDD.

[43]  Víctor Hugo Menéndez-Domínguez,et al.  Evaluation and selection of group recommendation strategies for collaborative searching of learning objects , 2015, Int. J. Hum. Comput. Stud..

[44]  David J. Spiegelhalter,et al.  Machine Learning, Neural and Statistical Classification , 2009 .