TREET: the Trust and Reputation Experimentation and Evaluation Testbed

To date, trust and reputation systems have often been evaluated using methods of their designers’ own devising. Recently, we demonstrated that a number of noteworthy trust and reputation systems could be readily defeated, revealing limitations in their original evaluations. Efforts in the trust and reputation community to develop a testbed have yielded a successful competition platform, ART. This testbed, however, is less suited to general experimentation and evaluation of individual trust and reputation technologies. In this paper, we present TREET, an experimentation and evaluation testbed based directly on that used in our investigations into security vulnerabilities in trust and reputation systems for marketplaces. We demonstrate the advantages of TREET, towards the development of more thorough, objective evaluations of trust and reputation systems.

[1]  Laurent Vercouter,et al.  A specification of the Agent Reputation and Trust (ART) testbed: experimentation and competition for trust in agent societies , 2005, AAMAS '05.

[2]  Robin Cohen,et al.  Modeling trust using transactional, numerical units , 2006, PST.

[3]  Thomas T. Tran,et al.  Improving user satisfaction in agent-based electronic marketplaces by reputation modelling and adjustable product quality , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[4]  Audun Jøsang,et al.  AIS Electronic Library (AISeL) , 2017 .

[5]  Elisa Bertino,et al.  Trust Management III, Third IFIP WG 11.11 International Conference, IFIPTM 2009 , West Lafayette, IN, USA, June 15-19, 2009. Proceedings , 2009, IFIPTM.

[6]  Robin Cohen,et al.  An Experimental Testbed for Evaluation of Trust and Reputation Systems , 2009, IFIPTM.

[7]  Nicholas R. Jennings,et al.  The ART of IAM: The Winning Strategy for the 2006 Competition , 2006 .

[8]  Munindar P. Singh,et al.  An adaptive probabilistic trust model and its evaluation , 2008, AAMAS.

[9]  Munindar P. Singh,et al.  Distributed Reputation Management for Electronic Commerce , 2002, Comput. Intell..

[10]  Carles Sierra,et al.  The Examination of an Information-Based Approach to Trust , 2007, COIN.

[11]  Nicholas R. Jennings,et al.  TRAVOS: Trust and Reputation in the Context of Inaccurate Information Sources , 2006, Autonomous Agents and Multi-Agent Systems.

[12]  Robin Cohen,et al.  Smart cheaters do prosper: defeating trust and reputation systems , 2009, AAMAS.

[13]  Nicholas R. Jennings,et al.  AAMAS '06: Proceedings of the Fifth International Joint Conference on Autonomous Agents and Multiagent Systems , 2006, AAMAS 2008.

[14]  Michael Luck,et al.  AAMAS '03: Proceedings of the Second International Joint Conference on Autonomous Agents and Multiagent Systems , 2003 .