Balancing accuracy and diversity in recommendations using matrix completion framework

Unified framework for joint accuracy-diversity optimization in recommender systems.Convex formulation utilizing item metadata for accuracy-diversity trade-off.Design an efficient algorithm using split Bregman technique for our formulation. Design of recommender systems aimed at achieving high prediction accuracy is a widely researched area. However, several studies have suggested the need for diversified recommendations, with acceptable level of accuracy, to avoid monotony and improve customers experience. However, increasing diversity comes with an associated reduction in recommendation accuracy; thereby necessitating an optimum tradeoff between the two. In this work, we attempt to achieve accuracy-diversity balance, by exploiting available ratings and item metadata, through a single (joint) optimization model built over the matrix completion framework. Most existing works, unlike our formulation, propose a 2-stage model - a heuristic item ranking scheme on top of an existing collaborative filtering technique. Experimental evaluation on a movie recommender system indicates that our model achieves higher diversity for a given drop in accuracy as compared to existing state of the art techniques.

[1]  George Karypis,et al.  FISM: factored item similarity models for top-N recommender systems , 2013, KDD.

[2]  Maoguo Gong,et al.  Multi-objective optimization for long tail recommendation , 2016, Knowl. Based Syst..

[3]  Maryam Fazel,et al.  Iterative reweighted algorithms for matrix rank minimization , 2012, J. Mach. Learn. Res..

[4]  Gediminas Adomavicius,et al.  Improving Aggregate Recommendation Diversity Using Ranking-Based Techniques , 2012, IEEE Transactions on Knowledge and Data Engineering.

[5]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[6]  Stephen P. Boyd,et al.  Distributed Optimization and Statistical Learning via the Alternating Direction Method of Multipliers , 2011, Found. Trends Mach. Learn..

[7]  Barry Smyth,et al.  Mining the real-time web: A novel approach to product recommendation , 2012, Knowl. Based Syst..

[8]  Hui Tian,et al.  A new user similarity model to improve the accuracy of collaborative filtering , 2014, Knowl. Based Syst..

[9]  Saul Vargas,et al.  Novelty and diversity enhancement and evaluation in recommender systems and information retrieval , 2014, SIGIR.

[10]  Sun Park,et al.  Novel Recommendation Based on Personal Popularity Tendency , 2011, 2011 IEEE 11th International Conference on Data Mining.

[11]  Alexander Tuzhilin,et al.  The long tail of recommender systems and how to leverage it , 2008, RecSys '08.

[12]  Guy Shani,et al.  Evaluating Recommendation Systems , 2011, Recommender Systems Handbook.

[13]  Charles L. Lawson,et al.  Solving least squares problems , 1976, Classics in applied mathematics.

[14]  Emmanuel J. Candès,et al.  The Power of Convex Relaxation: Near-Optimal Matrix Completion , 2009, IEEE Transactions on Information Theory.

[15]  Panagiotis Adamopoulos,et al.  On Unexpectedness in Recommender Systems , 2013, ACM Trans. Intell. Syst. Technol..

[16]  Tom Goldstein,et al.  The Split Bregman Method for L1-Regularized Problems , 2009, SIAM J. Imaging Sci..

[17]  Hiroyuki Kitagawa,et al.  A Probabilistic Model for Diversifying Recommendation Lists , 2013, APWeb.

[18]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[19]  Fernando Ortega,et al.  Improving collaborative filtering recommender system results and performance using genetic algorithms , 2011, Knowl. Based Syst..

[20]  Neil J. Hurley,et al.  Novel Item Recommendation by User Profile Partitioning , 2009, 2009 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology.

[21]  I. Daubechies,et al.  An iterative thresholding algorithm for linear inverse problems with a sparsity constraint , 2003, math/0307152.

[22]  Sean M. McNee,et al.  Being accurate is not enough: how accuracy metrics have hurt recommender systems , 2006, CHI Extended Abstracts.

[23]  Thomas Hofmann,et al.  Latent semantic models for collaborative filtering , 2004, TOIS.

[24]  Fernando Ortega,et al.  A non negative matrix factorization for collaborative filtering recommender systems based on a Bayesian probabilistic model , 2016, Knowl. Based Syst..

[25]  Michael A. Saunders,et al.  LSQR: An Algorithm for Sparse Linear Equations and Sparse Least Squares , 1982, TOMS.

[26]  Yehuda Koren,et al.  Advances in Collaborative Filtering , 2011, Recommender Systems Handbook.

[27]  Pablo A. Parrilo,et al.  Guaranteed Minimum-Rank Solutions of Linear Matrix Equations via Nuclear Norm Minimization , 2007, SIAM Rev..

[28]  S. Yun,et al.  An accelerated proximal gradient algorithm for nuclear norm regularized linear least squares problems , 2009 .

[29]  Barry Smyth,et al.  Similarity vs. Diversity , 2001, ICCBR.

[30]  Òscar Celma,et al.  A new approach to evaluating novel recommendations , 2008, RecSys '08.

[31]  Katja Niemann,et al.  A new collaborative filtering approach for increasing the aggregate diversity of recommender systems , 2013, KDD.

[32]  Daniel Dajun Zeng,et al.  A framework for diversifying recommendation lists by user interest expansion , 2016, Knowl. Based Syst..

[33]  Saul Vargas,et al.  Improving sales diversity by recommending users to items , 2014, RecSys '14.

[34]  Arindam Banerjee,et al.  Generalized Probabilistic Matrix Factorizations for Collaborative Filtering , 2010, 2010 IEEE International Conference on Data Mining.

[35]  John Riedl,et al.  Is seeing believing?: how recommender system interfaces affect users' opinions , 2003, CHI '03.

[36]  J. Bobadilla,et al.  Recommender systems survey , 2013, Knowl. Based Syst..

[37]  Mouzhi Ge,et al.  Beyond accuracy: evaluating recommender systems by coverage and serendipity , 2010, RecSys '10.

[38]  Javier Parapar,et al.  Item-based relevance modelling of recommendations for getting rid of long tail products , 2016, Knowl. Based Syst..

[39]  Sahin Albayrak,et al.  Increasing Diversity Through Furthest Neighbor-Based Recommendation , 2012 .

[40]  G. James Blaine,et al.  Continuous Monitoring of Physiologic Variables with a Dedicated Minicomputer , 1975, Computer.

[41]  FATIH GEDIKLI,et al.  Improving recommendation accuracy based on item-specific tag preferences , 2013, TIST.

[42]  Wotao Yin,et al.  A Block Coordinate Descent Method for Regularized Multiconvex Optimization with Applications to Nonnegative Tensor Factorization and Completion , 2013, SIAM J. Imaging Sci..

[43]  Angshul Majumdar,et al.  A Comprehensive Recommender System Model: Improving Accuracy for Both Warm and Cold Start Users , 2015, IEEE Access.

[44]  Yang Guo,et al.  A survey of collaborative filtering based social recommender systems , 2014, Comput. Commun..

[45]  Bidyut Kr. Patra,et al.  A knowledge reuse framework for improving novelty and diversity in recommendations , 2015, CODS.

[46]  Neil J. Hurley,et al.  Novelty and Diversity in Top-N Recommendation -- Analysis and Evaluation , 2011, TOIT.

[47]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[48]  Feng Nan,et al.  Low Rank Matrix Completion , 2009 .