A survey of active learning in collaborative filtering recommender systems

In collaborative filtering recommender systems user's preferences are expressed as ratings for items, and each additional rating extends the knowledge of the system and affects the system's recommendation accuracy. In general, the more ratings are elicited from the users, the more effective the recommendations are. However, the usefulness of each rating may vary significantly, i.e., different ratings may bring a different amount and type of information about the user's tastes. Hence, specific techniques, which are defined as "active learning strategies", can be used to selectively choose the items to be presented to the user for rating. In fact, an active learning strategy identifies and adopts criteria for obtaining data that better reflects users' preferences and enables to generate better recommendations.So far, a variety of active learning strategies have been proposed in the literature. In this article, we survey recent strategies by grouping them with respect to two distinct dimensions: personalization, i.e., whether the system selected items are different for different users or not, and, hybridization, i.e., whether active learning is guided by a single criterion (heuristic) or by multiple criteria. In addition, we present a comprehensive overview of the evaluation methods and metrics that have been employed by the research community in order to test active learning strategies for collaborative filtering. Finally, we compare the surveyed strategies and provide guidelines for their usage in recommender systems.

[1]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[2]  Peter A. Flach,et al.  Machine Learning - The Art and Science of Algorithms that Make Sense of Data , 2012 .

[3]  Lars Schmidt-Thieme,et al.  A supervised active learning framework for recommender systems based on decision trees , 2015, User Modeling and User-Adapted Interaction.

[4]  Francesco Ricci,et al.  User Personality and the New User Problem in a Context-Aware Point of Interest Recommender System , 2015, ENTER.

[5]  Yoav Shoham,et al.  Fab: content-based, collaborative recommendation , 1997, CACM.

[6]  Francesco Ricci,et al.  Personality-Based Active Learning for Collaborative Filtering Recommender Systems , 2013, AI*IA.

[7]  Masashi Sugiyama,et al.  Influence-based collaborative active learning , 2007, RecSys '07.

[8]  Lior Rokach,et al.  Recommender Systems: Introduction and Challenges , 2015, Recommender Systems Handbook.

[9]  M. Kubát An Introduction to Machine Learning , 2017, Springer International Publishing.

[10]  Pasquale Lops,et al.  Content-based Recommender Systems: State of the Art and Trends , 2011, Recommender Systems Handbook.

[11]  Mouzhi Ge,et al.  Context Dependent Preference Acquisition with Personality-Based Active Learning in Mobile Recommender Systems , 2014, HCI.

[12]  Wei Zeng,et al.  Useful acquiring ratings for collaborative filtering , 2009, 2009 IEEE Youth Conference on Information, Computing and Telecommunication.

[13]  Stephen Chi-fai Chan,et al.  Applicability of Demographic Recommender System to Tourist Attractions: A Case Study on Trip Advisor , 2012, 2012 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[14]  Greg Linden,et al.  Amazon . com Recommendations Item-to-Item Collaborative Filtering , 2001 .

[15]  Sean M. McNee,et al.  Getting to know you: learning new user preferences in recommender systems , 2002, IUI '02.

[16]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[17]  Robin D. Burke,et al.  Hybrid Recommender Systems: Survey and Experiments , 2002, User Modeling and User-Adapted Interaction.

[18]  Yehuda Koren,et al.  Advances in Collaborative Filtering , 2011, Recommender Systems Handbook.

[19]  Rong Hu,et al.  Enhancing collaborative filtering systems with personality information , 2011, RecSys '11.

[20]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[21]  Francesco Ricci,et al.  Cold-Start Management with Cross-Domain Collaborative Filtering and Tags , 2013, EC-Web.

[22]  Craig Boutilier,et al.  Active Collaborative Filtering , 2002, UAI.

[23]  Franca Garzotto,et al.  Content-Based Video Recommendation System Based on Stylistic Visual Features , 2016, Journal on Data Semantics.

[24]  Li Chen,et al.  Evaluating recommender systems from the user’s perspective: survey of the state of the art , 2012, User Modeling and User-Adapted Interaction.

[25]  David M. Pennock,et al.  Categories and Subject Descriptors , 2001 .

[26]  Pasquale Lops,et al.  A content-collaborative recommender that exploits WordNet-based user profiles for neighborhood formation , 2007, User Modeling and User-Adapted Interaction.

[27]  Francesco Ricci,et al.  Context-Aware Recommender Systems , 2011, AI Mag..

[28]  Mingxuan Sun,et al.  Learning multiple-question decision trees for cold-start recommendation , 2013, WSDM.

[29]  S. Gosling,et al.  A very brief measure of the Big-Five personality domains , 2003 .

[30]  Francisco de A. T. de Carvalho,et al.  ActiveCP: A Method for Speeding up User Preferences Acquisition in Collaborative Filtering Systems , 2002, SBIA.

[31]  Michael J. Pazzani,et al.  A Framework for Collaborative, Content-Based and Demographic Filtering , 1999, Artificial Intelligence Review.

[32]  Burr Settles,et al.  Active Learning Literature Survey , 2009 .

[33]  Gediminas Adomavicius,et al.  Multi-Criteria Recommender Systems , 2011, Recommender Systems Handbook.

[34]  Daniel Dajun Zeng,et al.  Why Does Collaborative Filtering Work? Transaction-Based Recommendation Model Validation and Selection by Analyzing Bipartite Random Graphs , 2011, INFORMS J. Comput..

[35]  Taghi M. Khoshgoftaar,et al.  A Survey of Collaborative Filtering Techniques , 2009, Adv. Artif. Intell..

[36]  Gediminas Adomavicius,et al.  Incorporating contextual information in recommender systems using a multidimensional approach , 2005, TOIS.

[37]  Yong Yu,et al.  Interview process learning for top-n recommendation , 2013, RecSys.

[38]  Thomas G. Dietterich What is machine learning? , 2020, Archives of Disease in Childhood.

[39]  Eitan M. Gurari,et al.  Introduction to the theory of computation , 1989 .

[40]  J. Avery,et al.  The long tail. , 1995, Journal of the Tennessee Medical Association.

[41]  Carlos Eduardo R. de Mello,et al.  Active learning driven by rating impact analysis , 2010, RecSys '10.

[42]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[43]  Shao-Lun Lee Commodity recommendations of retail business based on decisiontree induction , 2010, Expert Syst. Appl..

[44]  Mouzhi Ge,et al.  Interactive Food Recommendation for Groups , 2014, RecSys Posters.

[45]  Iván Cantador,et al.  Alleviating the new user problem in collaborative filtering by exploiting personality information , 2016, User Modeling and User-Adapted Interaction.

[46]  Sean M. McNee,et al.  Interfaces for Eliciting New User Preferences in Recommender Systems , 2003, User Modeling.

[47]  Giuseppe Carenini,et al.  Towards more conversational and collaborative recommender systems , 2003, IUI '03.

[48]  John Riedl,et al.  Learning preferences of new users in recommender systems: an information theoretic approach , 2008, SKDD.

[49]  Pasquale Lops,et al.  Semantics-aware Content-based Recommender Systems , 2014, CBRecSys@RecSys.

[50]  Shuang-Hong Yang,et al.  Functional matrix factorizations for cold-start recommendation , 2011, SIGIR.

[51]  Sindhu Kutty,et al.  Recommendations and Predictions With t-greedy Active Learning , 2009 .

[52]  Daphne Koller,et al.  Active learning: theory and applications , 2001 .

[53]  Tim Hussein,et al.  Choice-based preference elicitation for collaborative filtering recommender systems , 2014, CHI.

[54]  Eduardo F. Morales,et al.  An Introduction to Reinforcement Learning , 2011 .

[55]  R. McCrae,et al.  An introduction to the five-factor model and its applications. , 1992, Journal of personality.

[56]  Chih-Chao Ma A Guide to Singular Value Decomposition for Collaborative Filtering , 2008 .

[57]  Lars Schmidt-Thieme,et al.  Active learning for aspect model in recommender systems , 2011, 2011 IEEE Symposium on Computational Intelligence and Data Mining (CIDM).

[58]  Yiming Yang,et al.  Personalized active learning for collaborative filtering , 2008, SIGIR '08.

[59]  Luo Si,et al.  A Bayesian Approach toward Active Learning for Collaborative Filtering , 2004, UAI.

[60]  F. Ricci,et al.  System-Wide Effectiveness of Active Learning in Collaborative Filtering , 2011 .

[61]  Yehuda Koren,et al.  Adaptive bootstrapping of recommender systems using decision trees , 2011, WSDM '11.

[62]  Fredrik Olsson,et al.  A literature survey of active machine learning in the context of natural language processing , 2009 .

[63]  Ignacio Fernández-Tobías,et al.  Parsimonious and Adaptive Contextual Information Acquisition in Recommender Systems , 2015, IntRS@RecSys.

[64]  Yehuda Koren,et al.  On bootstrapping recommender systems , 2010, CIKM.

[65]  Ian Soboroff. Charles Nicholas Combining Content and Collaboration in Text Filtering , 1999 .

[66]  Paolo Cremonesi,et al.  Toward Building a Content-Based Video Recommendation System Based on Low-Level Features , 2015, EC-Web.

[67]  Robin Burke,et al.  Knowledge-based recommender systems , 2000 .

[68]  Joseph A. Konstan,et al.  Evaluating recommender behavior for new users , 2014, RecSys '14.

[69]  David Cohn,et al.  Active Learning , 2010, Encyclopedia of Machine Learning.

[70]  Francesco Ricci,et al.  Techniques for cold-starting context-aware mobile recommender systems for tourism , 2014, Intelligenza Artificiale.

[71]  G. G. Stokes "J." , 1890, The New Yale Book of Quotations.

[72]  Pattie Maes,et al.  Agent-mediated Electronic Commerce : A Survey , 1998 .

[73]  Mouzhi Ge,et al.  A Review of Information Quality Research - Develop a Research Agenda , 2007, ICIQ.

[74]  Gerhard Friedrich,et al.  Recommender Systems - An Introduction , 2010 .

[75]  Paolo Cremonesi,et al.  Tutorial on cross-domain recommender systems , 2014, RecSys '14.

[76]  Francesco Ricci,et al.  Adapting to Natural Rating Acquisition with Combined Active Learning Strategies , 2012, ISMIS.

[77]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[78]  Mouzhi Ge,et al.  Using Tags and Latent Factors in a Food Recommender System , 2015, Digital Health.

[79]  Chao Liu,et al.  Wisdom of the better few: cold start recommendation via representative based rating elicitation , 2011, RecSys '11.

[80]  Lars Schmidt-Thieme,et al.  Non-myopic active learning for recommender systems based on Matrix Factorization , 2011, 2011 IEEE International Conference on Information Reuse & Integration.

[81]  Gleb Beliakov,et al.  Aggregation Functions for Recommender Systems , 2015, Recommender Systems Handbook.

[82]  Wei Chu,et al.  Information Services]: Web-based services , 2022 .

[83]  Qiang Yang,et al.  Active Dual Collaborative Filtering with Both Item and Attribute Feedback , 2011, AAAI.

[84]  Sophie Ahrens,et al.  Recommender Systems , 2012 .

[85]  Francesco Ricci,et al.  Rating Elicitation Strategies for Collaborative Filtering , 2011, EC-Web.

[86]  Arnd Kohrs,et al.  Improving collaborative filtering for new-users by smart object selection , 2001 .

[87]  Rong Hu,et al.  A comparative user study on rating vs. personality quiz based preference elicitation methods , 2009, IUI.

[88]  George Karypis,et al.  A Comprehensive Survey of Neighborhood-based Recommendation Methods , 2011, Recommender Systems Handbook.

[89]  John Riedl,et al.  GroupLens: an open architecture for collaborative filtering of netnews , 1994, CSCW '94.

[90]  Roberto Turrin,et al.  Performance of recommender algorithms on top-n recommendation tasks , 2010, RecSys '10.

[91]  Shiu-li Huang,et al.  Designing utility-based recommender systems for e-commerce: Evaluation of preference-elicitation methods , 2011, Electron. Commer. Res. Appl..

[92]  Rossano Schifanella,et al.  Cold-start news recommendation with domain-dependent browse graph , 2014, RecSys '14.

[93]  Bamshad Mobasher,et al.  Contextual Recommendation , 2007, WebMine.

[94]  Mouzhi Ge,et al.  Interaction Design in a Mobile Food Recommender System , 2015, IntRS@RecSys.

[95]  Hsuan-Tien Lin,et al.  Learning From Data , 2012 .

[96]  Masashi Sugiyama,et al.  Active Learning in Recommender Systems , 2011, Recommender Systems Handbook.

[97]  Pattie Maes,et al.  Social information filtering: algorithms for automating “word of mouth” , 1995, CHI '95.

[98]  Jurij F. Tasic,et al.  The LDOS-PerAff-1 corpus of facial-expression video clips with affective, personality and user-interaction metadata , 2012, Journal on Multimodal User Interfaces.

[99]  Guy Shani,et al.  Evaluating Recommendation Systems , 2011, Recommender Systems Handbook.

[101]  Bernd Ludwig,et al.  Matrix factorization techniques for context aware recommendation , 2011, RecSys '11.

[102]  Francesco Ricci,et al.  Active learning strategies for rating elicitation in collaborative filtering , 2013, ACM Trans. Intell. Syst. Technol..

[103]  Gerhard Friedrich,et al.  Constraint-Based Recommender Systems , 2015, Recommender Systems Handbook.

[104]  Francesco Ricci,et al.  Active Learning in Collaborative Filtering Recommender Systems , 2014, EC-Web.