A comparison of calibrated and intent-aware recommendations

Calibrated and intent-aware recommendation are recent approaches to recommendation that have apparent similarities. Both try, to a certain extent, to cover the user's interests, as revealed by her user profile. In this paper, we compare them in detail. On two datasets, we show the extent to which intent-aware recommendations are calibrated and the extent to which calibrated recommendations are diverse. We consider two ways of defining a user's interests, one based on item features, the other based on subprofiles of the user's profile. We find that defining interests in terms of subprofiles results in highest precision and the best relevance/diversity trade-off. Along the way, we define a new version of calibrated recommendation and three new evaluation metrics.

[1]  Guy Shani,et al.  Evaluating Recommendation Systems , 2011, Recommender Systems Handbook.

[2]  Sean M. McNee,et al.  Being accurate is not enough: how accuracy metrics have hurt recommender systems , 2006, CHI Extended Abstracts.

[3]  Barry Smyth,et al.  Similarity vs. Diversity , 2001, ICCBR.

[4]  Derek Bridge,et al.  Accurate and Diverse Recommendations Using Item-Based SubProfiles , 2018, FLAIRS Conference.

[5]  Derek Bridge,et al.  Automatic Playlist Continuation using Subprofile-Aware Diversification , 2018, RecSys Challenge.

[6]  Eli Pariser.  FILTER BUBBLE: Wie wir im Internet entmündigt werden , 2012 .

[7]  Craig MacDonald,et al.  Exploiting query reformulations for web search result diversification , 2010, WWW '10.

[8]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[9]  Jade Goldstein-Stewart,et al.  The Use of MMR, Diversity-Based Reranking for Reordering Documents and Producing Summaries , 1998, SIGIR Forum.

[10]  Domonkos Tikk,et al.  Fast als-based matrix factorization for explicit and implicit feedback datasets , 2010, RecSys '10.

[11]  Harald Steck,et al.  Calibrated recommendations , 2018, RecSys.

[12]  Saul Vargas,et al.  Explicit relevance models in intent-oriented information retrieval diversification , 2012, SIGIR '12.

[13]  Charles L. A. Clarke,et al.  Novelty and diversity in information retrieval evaluation , 2008, SIGIR '08.

[14]  Saul Vargas,et al.  Intent-oriented diversity in recommender systems , 2011, SIGIR.

[15]  Neil J. Hurley,et al.  Intent-Aware Diversification Using a Constrained PLSA , 2016, RecSys.

[16]  Eli Pariser,et al.  The Filter Bubble: What the Internet Is Hiding from You , 2011 .

[17]  M. L. Fisher,et al.  An analysis of approximations for maximizing submodular set functions—I , 1978, Math. Program..

[18]  Sreenivas Gollapudi,et al.  Diversifying search results , 2009, WSDM '09.

[19]  Bamshad Mobasher,et al.  A Clustering Approach for Personalizing Diversity in Collaborative Recommender Systems , 2017, UMAP.

[20]  Jade Goldstein-Stewart,et al.  The use of MMR, diversity-based reranking for reordering documents and producing summaries , 1998, SIGIR '98.

[21]  Derek Bridge,et al.  Diversity, Serendipity, Novelty, and Coverage , 2016, ACM Trans. Interact. Intell. Syst..

[22]  Saul Vargas,et al.  Coverage, redundancy and size-awareness in genre diversity for recommender systems , 2014, RecSys '14.

[23]  David M. Blei,et al.  Factorization Meets the Item Embedding: Regularizing Matrix Factorization with Item Co-occurrence , 2016, RecSys.

[24]  Derek Bridge,et al.  Subprofile-aware diversification of recommendations , 2019, User Modeling and User-Adapted Interaction.

[25]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.