Prediction uncertainty in collaborative filtering: Enhancing personalized online product ranking

Personalized product ranking provides support to the decision making of online consumers and helps improve their satisfaction, since consumers always face a large volume of choices when they are shopping online. Recommender systems with collaborative filtering techniques are commonly used for this purpose, wherein products are ranked according to their predicted ratings. However, this kind of ranking approaches (namely, Ranking by Collaborative Filtering, RCF for short) have generally ignored the impacts of prediction uncertainty. This paper proposes a novel ranking approach called RPU (Ranking with Prediction Uncertainty), which utilizes posterior rating distribution and confidence level of prediction as two key factors for prediction uncertainty. Serving as a critical component of the generalized ranking framework, RPU aims to improve the accuracy of personalized product ranking through incorporating the uncertainty information. Experiments using real-world data of movie ratings show that RPU achieves higher ranking performance compared to traditional RCF and the results are robust in terms of sparse data. We propose a novel approach (RPU) for personalized online product ranking.RPU improves the accuracy of ranking by considering prediction uncertainty.Posterior distribution and confidence level are used as key factors for uncertainty.Experiments using real-world data show that RPU achieves advantageous performance.The results are robust in terms of sparse data.

[1]  Izak Benbasat,et al.  Interactive Decision Aids for Consumer Decision Making in E-Commerce: The Influence of Perceived Strategy Restrictiveness , 2009, MIS Q..

[2]  George Karypis,et al.  Item-based top-N recommendation algorithms , 2004, TOIS.

[3]  Daniel Dajun Zeng,et al.  Why Does Collaborative Filtering Work? Transaction-Based Recommendation Model Validation and Selection by Analyzing Bipartite Random Graphs , 2011, INFORMS J. Comput..

[4]  Kenneth Y. Goldberg,et al.  Eigentaste: A Constant Time Collaborative Filtering Algorithm , 2001, Information Retrieval.

[5]  Judith Masthoff,et al.  Effective explanations of recommendations: user-centered design , 2007, RecSys '07.

[6]  Yi-Chung Hu,et al.  Recommendation using neighborhood methods with preference-relation-based similarity , 2014, Inf. Sci..

[7]  Valerie J. Trifts,et al.  Consumer Decision Making in Online Shopping Environments: The Effects of Interactive Decision Aids , 2000 .

[8]  Yi-Cheng Zhang,et al.  Solving the apparent diversity-accuracy dilemma of recommender systems , 2008, Proceedings of the National Academy of Sciences.

[9]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[10]  John Riedl,et al.  Explaining collaborative filtering recommendations , 2000, CSCW '00.

[11]  Fernando Ortega,et al.  Incorporating reliability measurements into the predictions of a recommender system , 2013, Inf. Sci..

[12]  Stephen E. Robertson,et al.  Probabilistic relevance ranking for collaborative filtering , 2008, Information Retrieval.

[13]  Sean M. McNee,et al.  Confidence Displays and Training in Recommender Systems , 2003, INTERACT.

[14]  Jonathan L. Herlocker,et al.  A collaborative filtering algorithm and evaluation metric that accurately model the user experience , 2004, SIGIR '04.

[15]  Yang Guo,et al.  A survey of collaborative filtering based social recommender systems , 2014, Comput. Commun..

[16]  Gediminas Adomavicius,et al.  Improving Aggregate Recommendation Diversity Using Ranking-Based Techniques , 2012, IEEE Transactions on Knowledge and Data Engineering.

[17]  Patrick Seemann,et al.  Matrix Factorization Techniques for Recommender Systems , 2014 .

[18]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[19]  Yehuda Koren,et al.  OrdRec: an ordinal model for predicting personalized item rating distributions , 2011, RecSys '11.

[20]  Maciej A. Mazurowski,et al.  Estimating confidence of individual rating predictions in collaborative filtering recommender systems , 2013, Expert Syst. Appl..

[21]  John Riedl,et al.  Application of Dimensionality Reduction in Recommender System - A Case Study , 2000 .

[22]  Martin Wattenberg,et al.  Ad click prediction: a view from the trenches , 2013, KDD.

[23]  Ritu Agarwal,et al.  Competing "Creatively" in Sponsored Search Markets: The Effect of Rank, Differentiation Strategy, and Competition on Performance , 2011, Inf. Syst. Res..

[24]  Kristin Diehl,et al.  Searching Ordered Sets: Evaluations from Sequences under Search , 2005 .

[25]  Tianxi Cai,et al.  Estimating the Confidence Interval for Prediction Errors of Support Vector Machine Classifiers , 2008, J. Mach. Learn. Res..

[26]  Jaana Kekäläinen,et al.  Cumulated gain-based evaluation of IR techniques , 2002, TOIS.

[27]  Yue Lu,et al.  Investigating task performance of probabilistic topic models: an empirical study of PLSA and LDA , 2011, Information Retrieval.

[28]  Christopher M. Bishop,et al.  Pattern Recognition and Machine Learning (Information Science and Statistics) , 2006 .

[29]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[30]  Ruslan Salakhutdinov,et al.  Probabilistic Matrix Factorization , 2007, NIPS.

[31]  Gediminas Adomavicius,et al.  Towards more confident recommendations: Improving recommender systems using filtering approach based on rating variance , 2007 .

[32]  Fernando Ortega,et al.  Trees for explaining recommendations made through collaborative filtering , 2013, Inf. Sci..

[33]  Ruslan Salakhutdinov,et al.  Bayesian probabilistic matrix factorization using Markov chain Monte Carlo , 2008, ICML '08.

[34]  Gediminas Adomavicius,et al.  Optimization-Based Approaches for Maximizing Aggregate Recommendation Diversity , 2014, INFORMS J. Comput..

[35]  Hsinchun Chen,et al.  Applying associative retrieval techniques to alleviate the sparsity problem in collaborative filtering , 2004, TOIS.

[36]  Hao Wang,et al.  From clicking to consideration: A business intelligence approach to estimating consumers' consideration probabilities , 2013, Decis. Support Syst..

[37]  Gediminas Adomavicius,et al.  Toward the next generation of recommender systems: a survey of the state-of-the-art and possible extensions , 2005, IEEE Transactions on Knowledge and Data Engineering.

[38]  Ramayya Krishnan,et al.  Designing a Better Shopbot , 2004, Manag. Sci..

[39]  Izak Benbasat,et al.  E-Commerce Product Recommendation Agents: Use, Characteristics, and Impact , 2007, MIS Q..

[40]  Gediminas Adomavicius,et al.  Impact of data characteristics on recommender systems performance , 2012, TMIS.

[41]  Beibei Li,et al.  Designing Ranking Systems for Hotels on Travel Search Engines by Mining User-Generated and Crowd-Sourced Content , 2011, Mark. Sci..

[42]  Yehuda Koren,et al.  Factorization meets the neighborhood: a multifaceted collaborative filtering model , 2008, KDD.

[43]  Mong-Li Lee,et al.  Tagcloud-based explanation with feedback for recommender systems , 2013, SIGIR.

[44]  Beibei Li,et al.  Examining the Impact of Ranking on Consumer Behavior and Search Engine Revenue , 2013, Manag. Sci..

[45]  Klaus Adam Learning While Searching for the Best Alternative , 2001, J. Econ. Theory.