Deconfounded Causal Collaborative Filtering

Recommender systems may be confounded by various types of confounding factors (also called confounders) that may lead to inaccurate recommendations and sacrificed recommendation performance. Current approaches to solving the problem usually design each specific model for each specific confounder. However, realworld systems may include a huge number of confounders and thus designing each specific model for each specific confounder is unrealistic. More importantly, except for those “explicit confounders” that researchers can manually identify and process such as item’s position in the ranking list, there are also many “latent confounders” that are beyond the imagination of researchers. For example, users’ rating on a song may depend on their current mood or the current weather, and users’ preference on ice creams may depend on the air temperature. Such latent confounders may be unobservable in the recorded training data. To solve the problem, we propose a deconfounded causal collaborative filtering model. We first frame user behaviors with unobserved confounders into a causal graph, and then we design a front-door adjustment model carefully fused with machine learning to deconfound the influence of unobserved confounders. The proposed model is able to handle both global confounders and personalized confounders. Experiments on real-world datasets show that our method is able to deconfound unobserved confounders to achieve better recommendation performance.

[1]  Yifan Zhang,et al.  Correcting for Selection Bias in Learning-to-rank Systems , 2020, WWW.

[2]  Yang Wang,et al.  Unbiased LambdaMART: An Unbiased Pairwise Learning-to-Rank Algorithm , 2018, WWW.

[3]  Lars Schmidt-Thieme,et al.  BPR: Bayesian Personalized Ranking from Implicit Feedback , 2009, UAI.

[4]  Yunqi Li,et al.  Towards Personalized Fairness based on Causal Notion , 2021, SIGIR.

[5]  Chen Gao,et al.  Disentangling User Interest and Conformity for Recommendation with Causal Embedding , 2021, WWW.

[6]  J. Pearl,et al.  Causal Inference in Statistics: A Primer , 2016 .

[7]  Jianmo Ni,et al.  Justifying Recommendations using Distantly-Labeled Reviews and Fine-Grained Aspects , 2019, EMNLP.

[8]  Robin Burke,et al.  The Connection Between Popularity Bias, Calibration, and Fairness in Recommendation , 2020, RecSys.

[9]  Thorsten Joachims,et al.  Estimating Position Bias without Intrusive Interventions , 2018, WSDM.

[10]  Deborah Estrin,et al.  Unbiased offline recommender evaluation for missing-not-at-random implicit feedback , 2018, RecSys.

[11]  Xiangnan He,et al.  Deconfounded Recommendation for Alleviating Bias Amplification , 2021, KDD.

[12]  Zi Huang,et al.  CausalRec: Causal Inference for Visual Debiasing in Visually-Aware Recommendation , 2021, ACM Multimedia.

[13]  Ashish Sharma,et al.  An Adversarial Approach to Improve Long-Tail Performance in Neural Collaborative Filtering , 2018, CIKM.

[14]  D. Rubin,et al.  The central role of the propensity score in observational studies for causal effects , 1983 .

[15]  Yuta Saito,et al.  Unbiased Recommender Learning from Missing-Not-At-Random Implicit Feedback , 2020, WSDM.

[16]  Thorsten Joachims,et al.  Unbiased Learning-to-Rank with Biased Feedback , 2016, WSDM.

[17]  Jinfeng Yi,et al.  Model-Agnostic Counterfactual Reasoning for Eliminating Popularity Bias in Recommender System , 2020, KDD.

[18]  Xiangnan He,et al.  AutoDebias: Learning to Debias for Recommendation , 2021, SIGIR.

[19]  Yi Chang,et al.  Unbiased Learning to Rank in Feeds Recommendation , 2021, WSDM.

[20]  David M. Blei,et al.  The Blessings of Multiple Causes , 2018, Journal of the American Statistical Association.

[21]  Stephen Bonner,et al.  Causal embeddings for recommendation , 2017, RecSys.

[22]  Thorsten Joachims,et al.  Recommendations as Treatments: Debiasing Learning and Evaluation , 2016, ICML.

[23]  Alan Said,et al.  Comparative recommender system evaluation: benchmarking recommendation frameworks , 2014, RecSys '14.

[24]  Richard S. Zemel,et al.  Collaborative prediction and ranking with non-random missing data , 2009, RecSys '09.

[25]  Rui Zhang,et al.  Doubly Robust Joint Learning for Recommendation on Data Missing Not at Random , 2019, ICML.

[26]  James Caverlee,et al.  Popularity Bias in Dynamic Recommendation , 2021, KDD.

[27]  D. Blei,et al.  Causal Inference for Recommender Systems , 2020, RecSys.

[28]  Chih-Jen Lin,et al.  Improving Ad Click Prediction by Considering Non-displayed Events , 2019, CIKM.

[29]  W. Bruce Croft,et al.  Unbiased Learning to Rank with Unbiased Propensity Estimation , 2018, SIGIR.

[30]  Asymmetric Tri-training for Debiasing Missing-Not-At-Random Explicit Feedback , 2019, SIGIR.

[31]  M. de Rijke,et al.  Policy-Aware Unbiased Learning to Rank for Top-k Rankings , 2020, SIGIR.

[32]  James Caverlee,et al.  Popularity-Opportunity Bias in Collaborative Filtering , 2021, WSDM.

[33]  Marc Najork,et al.  Learning to Rank with Selection Bias in Personal Search , 2016, SIGIR.

[34]  Zachary C. Lipton,et al.  Correcting Exposure Bias for Link Recommendation , 2021, ICML.

[35]  Yehuda Koren,et al.  Matrix Factorization Techniques for Recommender Systems , 2009, Computer.

[36]  Ruocheng Guo,et al.  Debiasing Grid-based Product Search in E-commerce , 2020, KDD.

[37]  M. de Rijke,et al.  Cascade Model-based Propensity Estimation for Counterfactual Learning to Rank , 2020, SIGIR.

[38]  Masoud Mansoury,et al.  Multi-sided Exposure Bias in Recommendation , 2020, ArXiv.

[39]  Guohui Ling,et al.  Causal Intervention for Leveraging Popularity Bias in Recommendation , 2021, SIGIR.

[40]  Richard S. Zemel,et al.  Collaborative Filtering and the Missing at Random Assumption , 2007, UAI.

[41]  Shujian Huang,et al.  Deep Matrix Factorization Models for Recommender Systems , 2017, IJCAI.

[42]  Zhen Qin,et al.  Attribute-based Propensity for Unbiased Learning in Recommender Systems: Algorithm and Case Studies , 2020, KDD.