Towards the design of robust incentive mechanisms to address subjectivity and dishonesty problems in agent reporting

Agent reporting systems, such as reputation systems and crowdsourcing platforms, provide opportunities for human users represented as agents to report their ratings or opinions via electronic channels. However, their reports could vary and are difficult to be aggregated (subjectivity problem) and they may provide untruthful reports (dishonesty problem). The two challenging problems have attracted considerable interests from the academia and industry. The first objective of this thesis is to address the subjectivity and dishonesty problems through designing three incentive mechanisms where the agents are assumed to be rational. Furthermore, considering the existence of bounded rational agents in real systems, the second objective is to evaluate the robustness of incentive mechanisms against bounded rational agents. Specifically, to address the subjectivity problem, a coalition formation game based reputation system (CONGRESS) is proposed for e-marketplaces. In CONGRESS, buyers with the same subjectivity are incentivized to form a separate club to build seller reputation based on the ratings collected from the buyers in the club. Consequently, the proposed model avoids suffering from the bad effect of the subjectivity problem. It has been theoretically proven that buyers with the same subjectivity have the incentive to form a same club if a certain condition is satisfied. Furthermore, a set of experiments have been conducted to validate the proposed reputation system. Secondly, to address the dishonesty problem, an incentive mechanism iMEMLI is proposed for e-marketplaces with limited inventory where the supply of sellers is less

[1]  George A. Akerlof The Market for “Lemons”: Quality Uncertainty and the Market Mechanism , 1970 .

[2]  M. A. Raghunandan,et al.  Sustaining cooperation on networks: an analytical study based on evolutionary game theory , 2012, AAMAS.

[3]  A. Jøsang,et al.  Challenges for Robust Trust and Reputation Systems , 2009 .

[4]  Boi Faltings,et al.  Eliciting Truthful Feedback for Binary Reputation Mechanisms , 2004, IEEE/WIC/ACM International Conference on Web Intelligence (WI'04).

[5]  Mark Voorneveld,et al.  A Scent of Lemon - Seller Meets Buyer with a Noisy Quality Observation , 2011, Games.

[6]  William S. Zwicker,et al.  Coalition formation games with separable preferences , 2003, Math. Soc. Sci..

[7]  Pascal Poupart,et al.  Bayesian Reputation Modeling in E-Marketplaces Sensitive to Subjectivity, Deception and Change , 2006, AAAI.

[8]  Sven Seuken,et al.  Incentive-Compatible Escrow Mechanisms , 2011, AAAI.

[9]  David C. Parkes,et al.  Dwelling on the Negative: Incentivizing Effort in Peer Prediction , 2013, HCOMP.

[10]  Julita Vassileva,et al.  Effective Web Service Selection via Communities Formed by Super-Agents , 2010, 2010 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology.

[11]  Bo An,et al.  A practical robustness measure of incentive mechanisms , 2014, AAMAS.

[12]  Jie Zhang,et al.  Evaluating the trustworthiness of advice about seller agents in e-marketplaces: A personalized approach , 2008, Electron. Commer. Res. Appl..

[13]  Robin Cohen,et al.  TRUST AS A TRADABLE COMMODITY: A FOUNDATION FOR SAFE ELECTRONIC MARKETPLACES , 2010, Comput. Intell..

[14]  Junghoon Moon,et al.  Effect of the food traceability system for building trust: Price premium and buying behavior , 2007, Inf. Syst. Frontiers.

[15]  Andrew B. Whinston,et al.  Proper scoring rules with arbitrary value functions , 2010 .

[16]  Boyang Li,et al.  Story Generation with Crowdsourced Plot Graphs , 2013, AAAI.

[17]  Xin Yang,et al.  An incentive mechanism to reinforce truthful reports in reputation systems , 2012, J. Netw. Comput. Appl..

[18]  Yuan Liu,et al.  Towards the design of a robust incentive mechanism for e-marketplaces with limited inventory , 2013, AAMAS.

[19]  J. Neumann,et al.  Theory of games and economic behavior , 1945, 100 Years of Math Milestones.

[20]  N. L. Chervany,et al.  THE MEANINGS OF TRUST , 2000 .

[21]  Nadia Magnenat-Thalmann,et al.  SARC: subjectivity alignment for reputation computation , 2012, AAMAS.

[22]  Jie Zhang,et al.  A framework for trust modeling in multiagent electronic marketplaces with buying advisors to consider varying seller behavior and the limiting of seller bids , 2013, TIST.

[23]  Sarvapali D. Ramchurn,et al.  Trust-based mechanism design , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[24]  Robin Cohen,et al.  Smart cheaters do prosper: defeating trust and reputation systems , 2009, AAMAS.

[25]  B. Faltings,et al.  Obtaining Reliable Feedback for Sanctioning Reputation Mechanisms , 2007, J. Artif. Intell. Res..

[26]  Suronapee Phoomvuthisarn,et al.  A Survey Study on Reputation-based Trust Mechanisms in Service-Oriented Computing , 2011 .

[27]  Boi Faltings,et al.  Towards Incentive-Compatible Reputation Management , 2002, Trust, Reputation, and Security.

[28]  Radu Jurca,et al.  TRUTHFUL REPUTATION MECHANISMS FOR ONLINE SYSTEMS , 2007 .

[29]  Chrysanthos Dellarocas,et al.  Immunizing online reputation reporting systems against unfair ratings and discriminatory behavior , 2000, EC '00.

[30]  Yaron Singer,et al.  Pricing mechanisms for crowdsourcing markets , 2013, WWW.

[31]  Boi Faltings,et al.  Mechanisms for Making Crowds Truthful , 2014, J. Artif. Intell. Res..

[32]  R. Jurca,et al.  "CONFESS" an incentive compatible reputation mechanism for the hotel booking industry , 2004, Proceedings. IEEE International Conference on e-Commerce Technology, 2004. CEC 2004..

[33]  D. Bergemann,et al.  Robust Mechanism Design: The Role of Private Information and Higher Order Beliefs , 2012 .

[34]  Munindar P. Singh,et al.  Developing trust in large-scale peer-to-peer systems , 2004, IEEE First Symposium onMulti-Agent Security and Survivability, 2004.

[35]  Boi Faltings,et al.  Eliminating Undesired Equilibrium Points from Incentive Compatible Reputation Mechanisms , 2005 .

[36]  Chunyan Miao,et al.  Reputation-Aware Continuous Double Auction , 2014, AAAI.

[37]  Qin Li,et al.  An Incentive Mechanism to Promote Honesty in E-marketplaces with Limited Inventory , 2012, IFIPTM.

[38]  Chunyan Miao,et al.  AN INTEGRATED CLUSTERING‐BASED APPROACH TO FILTERING UNFAIR MULTI‐NOMINAL TESTIMONIES , 2014, Comput. Intell..

[39]  George D. Stamoulis,et al.  An incentives' mechanism promoting truthful feedback in peer-to-peer systems , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[40]  K. Eliaz Fault Tolerant Implementation , 2002 .

[41]  Matteo Sereno,et al.  Distributed Coalition Formation in Energy-Aware Cloud Federations: A Game-Theoretic Approach (Extended Version) , 2013, ArXiv.

[42]  Boi Faltings,et al.  Minimum payments that reward honest reputation feedback , 2006, EC '06.

[43]  Boi Faltings,et al.  “CONFESS”. eliciting honest feedback without independent verification authorities , 2004, AAMAS'04.

[44]  L. Mui,et al.  A computational model of trust and reputation , 2002, Proceedings of the 35th Annual Hawaii International Conference on System Sciences.

[45]  Lik Mui,et al.  Notions of reputation in multi-agents systems: a review , 2002, AAMAS '02.

[46]  David C. Parkes,et al.  Peer prediction without a common prior , 2012, EC '12.

[47]  Bin Mai,et al.  No Free Lunch: Price Premium for Privacy Seal-Bearing Vendors , 2010, J. Manag. Inf. Syst..

[48]  Eric Horvitz,et al.  Incentives for truthful reporting in crowdsourcing , 2012, AAMAS.

[49]  Chunyan Miao,et al.  iCLUB: an integrated clustering-based approach to improve the robustness of reputation systems , 2011, AAMAS.

[50]  Sarit Kraus,et al.  Task Allocation Via Coalition Formation Among Autonomous Agents , 1995, IJCAI.

[51]  Jie Zhang,et al.  Misleading Opinions Provided by Advisors: Dishonesty or Subjectivity , 2013, IJCAI.

[52]  A. Copeland Review: John von Neumann and Oskar Morgenstern, Theory of games and economic behavior , 1945 .

[53]  Qin Li,et al.  Design of an incentive mechanism to promote honesty in e-marketplaces with limited inventory , 2012, ICEC '12.

[54]  Edith Elkind,et al.  Overlapping coalition formation games: charting the tractability frontier , 2012, AAMAS 2012.

[55]  Tuomas Sandholm,et al.  Contracting With Uncertain Level Of Trust , 2002, Comput. Intell..

[56]  Joseph Y. Halpern Beyond nash equilibrium: solution concepts for the 21st century , 2008, PODC '08.

[57]  L. Shapley A Value for n-person Games , 1988 .

[58]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[59]  Yuan Liu,et al.  An incentive mechanism designed for e-marketplaces with limited inventory , 2014, Electron. Commer. Res. Appl..

[60]  E. Horvitz,et al.  Incentives and Truthful Reporting in Consensus-centric Crowdsourcing , 2012 .

[61]  Munindar P. Singh,et al.  Trust Representation and Aggregation in a Distributed Agent System , 2006, AAAI.

[62]  Michael Dahlin,et al.  BAR fault tolerance for cooperative services , 2005, SOSP '05.

[63]  Julia Häring,et al.  Different Prices for Identical Products? Market Efficiency and the Virtual Location in B2C E-Commerce , 2003 .

[64]  P. Moran,et al.  The statistical processes of evolutionary theory. , 1963 .

[65]  Panagiotis G. Ipeirotis Analyzing the Amazon Mechanical Turk marketplace , 2010, XRDS.

[66]  Sulin Ba,et al.  Establishing Online Trust Through a Community Responsibility System , 2001, Decis. Support Syst..

[67]  Andreas Krause,et al.  Truthful incentives in crowdsourcing tasks using regret minimization mechanisms , 2013, WWW.

[68]  Dimitris Bertsimas,et al.  Robust game theory , 2006, Math. Program..

[69]  Yang Liu,et al.  On Robustness of Trust Systems , 2014, IFIPTM.

[70]  Angus Stevenson,et al.  Concise Oxford English Dictionary , 2009 .

[71]  Jie Zhang,et al.  Trusting advice from other buyers in e-marketplaces: the problem of unfair ratings , 2006, ICEC '06.

[72]  Glenn Shafer,et al.  A Mathematical Theory of Evidence , 2020, A Mathematical Theory of Evidence.

[73]  Laura A. Dabbish,et al.  Designing games with a purpose , 2008, CACM.

[74]  J. Wooders,et al.  Reputation in Auctions: Theory, and Evidence from Ebay , 2006 .

[75]  Audun Jøsang,et al.  Interpreting Belief Functions as Dirichlet Distributions , 2007, ECSQARU.

[76]  Peter A. N. Bosman,et al.  Adaptive Strategies for Dynamic Pricing Agents , 2011, 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology.

[77]  Karl Tuyls,et al.  An Evolutionary Dynamical Analysis of Multi-Agent Learning in Iterated Games , 2005, Autonomous Agents and Multi-Agent Systems.

[78]  Eric Horvitz,et al.  Combining human and machine intelligence in large-scale crowdsourcing , 2012, AAMAS.

[79]  D. Fudenberg,et al.  Emergence of cooperation and evolutionary stability in finite populations , 2004, Nature.

[80]  Jie Zhang,et al.  Design of a Mechanism for Promoting Honesty in E-Marketplaces , 2007, AAAI.

[81]  Julita Vassileva,et al.  A SUPER‐AGENT‐BASED FRAMEWORK FOR REPUTATION MANAGEMENT AND COMMUNITY FORMATION IN DECENTRALIZED SYSTEMS , 2014, Comput. Intell..

[82]  Stephen S. Standifird Reputation and e-commerce: eBay auctions and the asymmetrical impact of positive and negative ratings , 2001 .

[83]  Jie Zhang,et al.  An evolutionary model for constructing robust trust networks , 2013, AAMAS.

[84]  Suresh Mutuswami,et al.  Imperfect Competition and Efficiency in Lemons Markets , 2010 .

[85]  Joseph Y. Halpern,et al.  I'm Doing as Well as I Can: Modeling People as Rational Finite Automata , 2012, AAAI.

[86]  Paul Resnick,et al.  Eliciting Informative Feedback: The Peer-Prediction Method , 2005, Manag. Sci..

[87]  Jie Zhang,et al.  Promoting Honesty in Electronic Marketplaces: Combining Trust Modeling and Incentive Mechanism Design , 2009 .

[88]  Boi Faltings,et al.  An incentive compatible reputation mechanism , 2003, AAMAS '03.

[89]  Michael Fleming,et al.  Determining the Optimal Reporting Strategy in Competitive E-marketplaces , 2012, 2012 IEEE 11th International Conference on Trust, Security and Privacy in Computing and Communications.

[90]  Ben Carterette,et al.  An Analysis of Assessor Behavior in Crowdsourced Preference Judgments , 2010 .

[91]  Daniel Gómez,et al.  Polynomial calculation of the Shapley value based on sampling , 2009, Comput. Oper. Res..

[92]  M. Nowak Evolutionary Dynamics: Exploring the Equations of Life , 2006 .

[93]  Roger Collier,et al.  United States faces dentist shortage , 2009, Canadian Medical Association Journal.

[94]  Kwong-Sak Leung,et al.  A Survey of Crowdsourcing Systems , 2011, 2011 IEEE Third Int'l Conference on Privacy, Security, Risk and Trust and 2011 IEEE Third Int'l Conference on Social Computing.

[95]  Chunyan Miao,et al.  RepRev: Mitigating the Negative Effects of Misreported Ratings , 2014, AAAI.

[96]  Gjergji Kasneci,et al.  Crowd IQ: aggregating opinions to boost performance , 2012, AAMAS.

[97]  L. Shapley Cores of convex games , 1971 .

[98]  Lydia B. Chilton,et al.  The labor economics of paid crowdsourcing , 2010, EC '10.

[99]  Li Yang,et al.  A Dirichlet reputation system in reliable routing of wireless ad hoc network , 2010, Secur. Commun. Networks.

[100]  George D. Stamoulis,et al.  A mechanism that provides incentives for truthful feedback in peer-to-peer systems , 2010, Electron. Commer. Res..

[101]  Xia Zhou,et al.  TRUST: A General Framework for Truthful Double Spectrum Auctions , 2009, IEEE INFOCOM 2009.

[102]  Kevin Leyton-Brown,et al.  Behavioral game theoretic models: a Bayesian framework for parameter analysis , 2012, AAMAS.

[103]  Ariel Rubinstein,et al.  A Course in Game Theory , 1995 .

[104]  Yuan Liu,et al.  Robustness evaluation of incentive mechanisms , 2013, AAMAS.

[105]  Quanyan Zhu,et al.  Design of a Reputation System Based on Dynamic Coalition Formation , 2011, SocInfo.

[106]  D. Helbing,et al.  The outbreak of cooperation among success-driven individuals under noisy conditions , 2009, Proceedings of the National Academy of Sciences.

[107]  P. Klemperer Auction Theory: A Guide to the Literature , 1999 .

[108]  Munindar P. Singh,et al.  An evidential model of distributed reputation management , 2002, AAMAS '02.

[109]  Jie Zhang,et al.  A POMDP based approach to optimally select sellers in electronic marketplaces , 2014, AAMAS.

[110]  Yuan Liu,et al.  Trust-oriented buyer strategies for seller reporting and selection in competitive electronic marketplaces , 2014, Autonomous Agents and Multi-Agent Systems.