Debiasing the Human-Recommender System Feedback Loop in Collaborative Filtering

Recommender Systems (RSs) are widely used to help online users discover products, books, news, music, movies, courses, restaurants, etc. Because a traditional recommendation strategy always shows the most relevant items (thus with highest predicted rating), traditional RS’s are expected to make popular items become even more popular and non-popular items become even less popular which in turn further divides the haves (popular) from the have-nots (unpopular). Therefore, a major problem with RSs is that they may introduce biases affecting the exposure of items, thus creating a popularity divide of items during the feedback loop that occurs with users, and this may lead the RS to make increasingly biased recommendations over time. In this paper, we view the RS environment as a chain of events that are the result of interactions between users and the RS. Based on that, we propose several debiasing algorithms during this chain of events, and evaluate how these algorithms impact the predictive behavior of the RS, as well as trends in the popularity distribution of items over time. We also propose a novel blind-spot-aware matrix factorization (MF) algorithm to debias the RS. Results show that propensity matrix factorization achieved a certain level of debiasing of the RS while active learning combined with the propensity MF achieved a higher debiasing effect on recommendations.

[1]  Deborah Estrin,et al.  Unbiased offline recommender evaluation for missing-not-at-random implicit feedback , 2018, RecSys.

[2]  Loren G. Terveen,et al.  Exploring the filter bubble: the effect of using recommender systems on content diversity , 2014, WWW.

[3]  Thorsten Joachims,et al.  Recommendations as Treatments: Debiasing Learning and Evaluation , 2016, ICML.

[4]  David F. Gleich,et al.  Rank aggregation via nuclear norm minimization , 2011, KDD.

[5]  David A. Cohn,et al.  Active Learning with Statistical Models , 1996, NIPS.

[6]  Olfa Nasraoui,et al.  Human-Recommender Systems: From Benchmark Data to Benchmark Cognitive Models , 2016, RecSys.

[7]  Olfa Nasraoui,et al.  Human-Algorithm Interaction Biases in the Big Data Cycle: A Markov Chain Iterated Learning Framework , 2016, ArXiv.

[8]  Stephen J. Wright.  Coordinate descent algorithms , 2015, Mathematical Programming.

[9]  Bamshad Mobasher,et al.  Controlling Popularity Bias in Learning-to-Rank Recommendation , 2017, RecSys.

[10]  Thorsten Joachims,et al.  Fairness of Exposure in Rankings , 2018, KDD.

[11]  Olfa Nasraoui,et al.  Iterated Algorithmic Bias in the Interactive Machine Learning Process of Information Filtering , 2018, KDIR.

[12]  David M. Blei,et al.  Causal Inference for Recommendation , 2016 .

[13]  Yifan Hu,et al.  Collaborative Filtering for Implicit Feedback Datasets , 2008, 2008 Eighth IEEE International Conference on Data Mining.

[14]  David M. Blei,et al.  Modeling User Exposure in Recommendation , 2015, WWW.

[15]  Olfa Nasraoui,et al.  Unifying recommendation and active learning for human-algorithm interactions , 2017, CogSci.

[16]  Karthik Ramani,et al.  Deconvolving Feedback Loops in Recommender Systems , 2016, NIPS.

[17]  J. F. Scott.  Distribution Theory , 1973, Nature.

[18]  Barbara E. Engelhardt,et al.  How algorithmic confounding in recommendation systems increases homogeneity and decreases utility , 2017, RecSys.