Visualizing Unfair Ratings in Online Reputation Systems

Reputation systems provide a valuable method to measure the trustworthiness of sellers or the quality of products in an e-commerce environment. Due to their economic importance, reputation systems are subject to many attacks. A common problem are unfair ratings which are used to unfairly increase or decrease the reputation of an entity. Although being of high practical relevance, unfair rating attacks have only rarely been considered in literature. The few approaches that have been proposed are furthermore quite non-transparent to the user. In this work, we employ visual analytics to identify colluding digital identities. The ultimate benefit of our approach is the transparent revelation of the true reputation of an entity by interactively using both endogenous and exogenous discounting methods. We thereto introduce a generic conceptual design of a visual analytics component that is independent of the underlying reputation system. We then describe how this concept was implemented in a software prototype. Subsequently, we demonstrate its proper functioning by means of an empirical study based on two real-world datasets from eBay and Epinions. Overall, we show that our approach notably enhances transparency, bares an enormous potential and might thus lead to substantially more robust reputation systems and enhanced user experience.

[1]  Max Mühlhäuser,et al.  A Trust-Aware Framework for Evaluating Security Controls of Service Providers in Cloud Marketplaces , 2013, 2013 12th IEEE International Conference on Trust, Security and Privacy in Computing and Communications.

[2]  A. Jøsang,et al.  Challenges for Robust Trust and Reputation Systems , 2009 .

[3]  Dennis McLeod,et al.  Extracting and Visualizing Trust Relationships from Online Auction Feedback Comments , 2007, IJCAI.

[4]  Jie Gao,et al.  Quantifying Social Influence in Epinions , 2013, 2013 International Conference on Social Computing.

[5]  Lionel Médini,et al.  RED: a Rich Epinions Dataset for Recommender Systems , 2012 .

[6]  Samir Chatterjee,et al.  A Design Science Research Methodology for Information Systems Research , 2008 .

[7]  Paul Resnick,et al.  Trust among strangers in internet transactions: Empirical analysis of eBay' s reputation system , 2002, The Economics of the Internet and E-commerce.

[8]  Alan R. Hevner,et al.  Design Science in Information Systems Research , 2004, MIS Q..

[9]  Yan Sun,et al.  Security of Online Reputation Systems: The evolution of attacks and defenses , 2012, IEEE Signal Process. Mag..

[10]  D. Collard,et al.  Trust : making and breaking cooperative relations , 1989 .

[11]  Philippe Castagliola,et al.  A Comparison of the Readability of Graphs Using Node-Link and Matrix-Based Representations , 2004, IEEE Symposium on Information Visualization.

[12]  Christof Weinhardt,et al.  Trust Indicator Modeling for a Reputation Service in Virtual Organizations , 2007, ECIS.

[13]  Daniel A. Keim,et al.  Mastering the Information Age - Solving Problems with Visual Analytics , 2010 .

[14]  Hans-Peter Kriegel,et al.  A Density-Based Algorithm for Discovering Clusters in Large Spatial Databases with Noise , 1996, KDD.

[15]  Audun Jøsang,et al.  AIS Electronic Library (AISeL) , 2017 .

[16]  Arjan Kuijper,et al.  Visual Analysis of Large Graphs: State‐of‐the‐Art and Future Research Challenges , 2011, Eurographics.

[17]  Weichao Wang,et al.  Visualization assisted detection of sybil attacks in wireless networks , 2006, VizSEC '06.

[18]  A. Jøsang,et al.  Filtering Out Unfair Ratings in Bayesian Reputation Systems , 2004 .

[19]  Munindar P. Singh,et al.  Detecting deception in reputation management , 2003, AAMAS '03.

[20]  Diego Gambetta Trust : making and breaking cooperative relations , 1992 .

[21]  Andrew Lumsdaine,et al.  A comparison of vertex ordering algorithms for large graph visualization , 2007, 2007 6th International Asia-Pacific Symposium on Visualization.

[22]  Manfred K. Warmuth,et al.  The Weighted Majority Algorithm , 1994, Inf. Comput..

[23]  Yolanda Gil,et al.  A survey of trust in computer science and the Semantic Web , 2007, J. Web Semant..

[24]  Neel Sundaresan,et al.  eBay: an E-commerce marketplace as a complex network , 2011, WSDM '11.

[25]  Paul Resnick,et al.  The value of reputation on eBay: A controlled experiment , 2002 .

[26]  Ernesto Damiani,et al.  Choosing reputable servents in a P2P network , 2002, WWW.

[27]  Chrysanthos Dellarocas,et al.  Immunizing online reputation reporting systems against unfair ratings and discriminatory behavior , 2000, EC '00.

[28]  Günther Pernul,et al.  Visualizing Transaction Context in Trust and Reputation Systems , 2014, 2014 Ninth International Conference on Availability, Reliability and Security.

[29]  Ben Jann,et al.  Reputation Formation and the Evolution of Cooperation in Anonymous Online Markets , 2014 .

[30]  Haiying Shen,et al.  Collusion Detection in Reputation Systems for Peer-to-Peer Networks , 2012, 2012 41st International Conference on Parallel Processing.

[31]  Jie Zhang,et al.  A Detailed Comparison of Probabilistic Approaches for Coping with Unfair Ratings in Trust and Reputation Systems , 2008, 2008 Sixth Annual Conference on Privacy, Security and Trust.

[32]  Mostafa H. Ammar,et al.  A reputation system for peer-to-peer networks , 2003, NOSSDAV '03.

[33]  P. Massa,et al.  Trust-aware Bootstrapping of Recommender Systems , 2006 .

[34]  Kevin C. Almeroth,et al.  A Taxonomy to Express Open Challenges in Trust and Reputation Systems , 2012, J. Commun..

[35]  Elisabeth André,et al.  A User-Centric Study Of Reputation Metrics in Online Communities , 2013, UMAP Workshops.

[36]  Günther Pernul,et al.  Reusability for Trust and Reputation Systems , 2014, IFIPTM.

[37]  Steven Kay,et al.  Defending online reputation systems against collaborative unfair raters through signal modeling and trust , 2009, SAC '09.