Bringing Friends into the Loop of Recommender Systems: An Exploratory Study

The recommender system (RS), as a computer-supported information filtering system, is ubiquitous and influences what we eat, watch, or even like. In online RS, interactions between users and the system form a feedback loop: users take actions based on the recommendations provided by RS, and RS updates its recommendations accordingly. As such interactions increase, the issue of recommendation homogeneity intensifies, which significantly impairs user experience. In the face of this long-standing issue, the newly-emerging social e-commerce offers a new solution -- bringing friends' recommendations into the loop (friend-in-the-loop). In this paper, we conduct an exploratory study on the benefits of friend-in-the-loop through mixed methods on a leading social e-commerce platform in China, Beidian. We reveal that friend-in-the-loop provides users with more accurate and diverse recommendations than merely RS, and significantly alleviates algorithmic homogeneity. Moreover, our qualitative results demonstrate that the introduction of friends' external knowledge, consumers' trust, and empathy accounts for these benefits. Overall, we elaborate that friend-in-the-loop comprehensively benefits both users and RS, and it is a promising HCI-based solution to recommendation homogeneity, which offers insightful implications on designing future human-algorithm collaboration models.

[1]  Martin Ester,et al.  A matrix factorization technique with trust propagation for recommendation in social networks , 2010, RecSys '10.

[2]  Tao Wang,et al.  When Your Friends Become Sellers: An Empirical Study of Social Commerce Site Beidian , 2019, ICWSM.

[3]  Jöran Beel,et al.  A comparative analysis of offline and online evaluations and discussion of research paper recommender system evaluation , 2013, RepSys '13.

[4]  Loren Terveen,et al.  Beyond Recommender Systems: Helping People Help Each Other , 2001 .

[5]  Krishna P. Gummadi,et al.  Fighting Fire with Fire: Using Antidote Data to Improve Polarization and Fairness of Recommender Systems , 2018, WSDM.

[6]  Stefano Ermon,et al.  Generative Adversarial Imitation Learning , 2016, NIPS.

[7]  Qiong Wu,et al.  Recent Advances in Diversified Recommendation , 2019, ArXiv.

[8]  Huan Liu,et al.  Exploiting Local and Global Social Context for Recommendation , 2013, IJCAI.

[9]  Thorsten Joachims,et al.  Fairness of Exposure in Rankings , 2018, KDD.

[10]  Xiao Ma,et al.  Entire Space Multi-Task Model: An Effective Approach for Estimating Post-Click Conversion Rate , 2018, SIGIR.

[11]  A. Odén,et al.  Arguments for Fisher's Permutation Test , 1975 .

[12]  Toon De Pessemier,et al.  A user-centric evaluation of recommender algorithms for an event recommendation system , 2011, RecSys 2011.

[13]  John Hannon,et al.  Recommending twitter users to follow using content and collaborative filtering approaches , 2010, RecSys '10.

[14]  Depeng Jin,et al.  Community Value Prediction in Social E-commerce , 2021, WWW.

[15]  Jon Kleinberg,et al.  Making sense of recommendations , 2019, Journal of Behavioral Decision Making.

[16]  Michael J. Watts,et al.  IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS Publication Information , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[17]  Paul Resnick,et al.  Recommender systems , 1997, CACM.

[18]  Fengli Xu,et al.  Understanding the Role of Intermediaries in Online Social E-commerce , 2020, Proc. ACM Hum. Comput. Interact..

[19]  Barbara E. Engelhardt,et al.  How algorithmic confounding in recommendation systems increases homogeneity and decreases utility , 2017, RecSys.

[20]  Guido Caldarelli,et al.  Echo Chambers: Emotional Contagion and Group Polarization on Facebook , 2016, Scientific Reports.

[21]  Zhilong Chen,et al.  Predicting Customer Value with Social Relationships via Motif-based Graph Attention Networks , 2021, WWW.

[22]  Chao Liu,et al.  Recommender systems with social regularization , 2011, WSDM '11.

[23]  Bamshad Mobasher,et al.  Feedback Loop and Bias Amplification in Recommender Systems , 2020, CIKM.

[24]  M. McPherson,et al.  Birds of a Feather: Homophily in Social Networks , 2001 .

[25]  LiYong,et al.  "I Think You'll Like It" , 2019 .

[26]  Christophe Van den Bulte,et al.  Referral Programs and Customer Value , 2011 .

[27]  Eli Pariser,et al.  The Filter Bubble: What the Internet Is Hiding from You , 2011 .

[28]  Zhaohui Wu,et al.  On Deep Learning for Trust-Aware Recommendations in Social Networks , 2017, IEEE Transactions on Neural Networks and Learning Systems.

[29]  Olfa Nasraoui,et al.  Unifying recommendation and active learning for human-algorithm interactions , 2017, CogSci.

[30]  Jürgen Ziegler,et al.  Let Me Explain: Impact of Personal and Impersonal Explanations on Trust in Recommender Systems , 2019, CHI.

[31]  Zhi Zhang,et al.  A review of social recommendation , 2018, 2018 13th IEEE Conference on Industrial Electronics and Applications (ICIEA).

[32]  Yi-Cheng Zhang,et al.  Solving the apparent diversity-accuracy dilemma of recommender systems , 2008, Proceedings of the National Academy of Sciences.

[33]  Ajith Ramanathan,et al.  Practical Diversified Recommendations on YouTube with Determinantal Point Processes , 2018, CIKM.

[34]  Jonathan L. Herlocker,et al.  Evaluating collaborative filtering recommender systems , 2004, TOIS.

[35]  Olfa Nasraoui,et al.  Debiasing the Human-Recommender System Feedback Loop in Collaborative Filtering , 2019, WWW.

[36]  Gary L. Kreps,et al.  Trust and sources of health information: the impact of the Internet and its implications for health care providers: findings from the first Health Information National Trends Survey. , 2005, Archives of internal medicine.

[37]  John Riedl,et al.  Item-based collaborative filtering recommendation algorithms , 2001, WWW '01.

[38]  Michael R. Lyu,et al.  SoRec: social recommendation using probabilistic matrix factorization , 2008, CIKM '08.

[39]  Jure Leskovec,et al.  Understanding Behaviors that Lead to Purchasing: A Case Study of Pinterest , 2016, KDD.

[40]  Laming Chen,et al.  Fast Greedy MAP Inference for Determinantal Point Process to Improve Recommendation Diversity , 2017, NeurIPS.

[41]  Huan Liu,et al.  Social recommendation: a review , 2013, Social Network Analysis and Mining.

[42]  John Riedl,et al.  Recommender systems: from algorithms to user experience , 2012, User Modeling and User-Adapted Interaction.

[43]  Junyu Niu,et al.  A Framework for Recommending Relevant and Diverse Items , 2016, IJCAI.

[44]  Jure Leskovec,et al.  Graph Convolutional Neural Networks for Web-Scale Recommender Systems , 2018, KDD.

[45]  Heng-Tze Cheng,et al.  Wide & Deep Learning for Recommender Systems , 2016, DLRS@RecSys.

[46]  F. Maxwell Harper,et al.  Crowd-Based Personalized Natural Language Explanations for Recommendations , 2016, RecSys.

[47]  Mouzhi Ge,et al.  How should I explain? A comparison of different explanation types for recommender systems , 2014, Int. J. Hum. Comput. Stud..

[48]  Hong Yan,et al.  Recommender systems based on social networks , 2015, J. Syst. Softw..

[49]  A. Strauss,et al.  Grounded Theory in Practice , 1997 .

[50]  Jinyoung Han,et al.  Rumor Propagation is Amplified by Echo Chambers in Social Media , 2020, Scientific Reports.

[51]  N. Hoffart Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory , 2000 .

[52]  Eric Horvitz,et al.  Social Choice Theory and Recommender Systems: Analysis of the Axiomatic Foundations of Collaborative Filtering , 2000, AAAI/IAAI.

[53]  Hui Xiong,et al.  Learning to Recommend Accurate and Diverse Items , 2017, WWW.

[54]  Yuan He,et al.  Graph Neural Networks for Social Recommendation , 2019, WWW.

[55]  Jürgen Ziegler,et al.  Trust-related Effects of Expertise and Similarity Cues in Human-Generated Recommendations , 2018, IUI Workshops.

[56]  Saeideh Bakhshi,et al.  "I need to try this"?: a statistical overview of pinterest , 2013, CHI.

[57]  Andreas Krause,et al.  Explore-exploit in top-N recommender systems via Gaussian processes , 2014, RecSys '14.

[58]  Sean M. McNee,et al.  Improving recommendation lists through topic diversification , 2005, WWW '05.

[59]  Joseph A. Konstan,et al.  Who predicts better?: results from an online study comparing humans and an online recommender system , 2008, RecSys '08.

[60]  Alessandro Bessi,et al.  Personality traits and echo chambers on facebook , 2016, Comput. Hum. Behav..

[61]  Derek Bridge,et al.  Diversity, Serendipity, Novelty, and Coverage , 2016, ACM Trans. Interact. Intell. Syst..

[62]  BEN GREEN,et al.  The Principles and Limits of Algorithm-in-the-Loop Decision Making , 2019, Proc. ACM Hum. Comput. Interact..

[63]  Yi Tay,et al.  Deep Learning based Recommender System: A Survey and New Perspectives , 2018 .

[64]  Robin Burke,et al.  The Connection Between Popularity Bias, Calibration, and Fairness in Recommendation , 2020, RecSys.

[65]  Sheng Li,et al.  Deep Collaborative Filtering via Marginalized Denoising Auto-encoder , 2015, CIKM.

[66]  Eli Pariser FILTER BUBBLE: Wie wir im Internet entmündigt werden , 2012 .

[67]  Paul Covington,et al.  Deep Neural Networks for YouTube Recommendations , 2016, RecSys.

[68]  Daniel G. Goldstein,et al.  Manipulating and Measuring Model Interpretability , 2018, CHI.

[69]  Thorsten Joachims,et al.  Recommendations as Treatments: Debiasing Learning and Evaluation , 2016, ICML.

[70]  Guorui Zhou,et al.  Deep Interest Network for Click-Through Rate Prediction , 2017, KDD.

[71]  Guy Shani,et al.  An MDP-Based Recommender System , 2002, J. Mach. Learn. Res..

[72]  Matevz Kunaver,et al.  Diversity in recommender systems - A survey , 2017, Knowl. Based Syst..

[73]  Deborah Estrin,et al.  How Intention Informed Recommendations Modulate Choices: A Field Study of Spoken Word Content , 2019, WWW.

[74]  Junjun Li,et al.  Bundle recommendation in ecommerce , 2014, SIGIR.

[75]  Suzanne Keen Empathy and the Novel , 2007 .

[76]  Wei Chu,et al.  A contextual-bandit approach to personalized news article recommendation , 2010, WWW '10.

[77]  Karthik Ramani,et al.  Deconvolving Feedback Loops in Recommender Systems , 2016, NIPS.

[78]  Olfa Nasraoui,et al.  Iterated Algorithmic Bias in the Interactive Machine Learning Process of Information Filtering , 2018, KDIR.

[79]  Li Chen,et al.  A user-centric evaluation framework for recommender systems , 2011, RecSys '11.

[80]  Bart P. Knijnenburg,et al.  Explaining the user experience of recommender systems , 2012, User Modeling and User-Adapted Interaction.

[81]  Donald A. McBane Empathy and the salesperson: A multidimensional perspective , 1995 .

[82]  Lina Yao,et al.  Deep Learning Based Recommender System , 2017, ACM Comput. Surv..