A demonstration of the Agent Reputation and Trust (ART): testbed for experimentation and competition

The Agent Reputation and Trust (ART) Testbed [1] serves two roles: (1) as a competition forum for comparing technologies against objective metrics, and (2) as an environment for performing customizable, easily-repeatable experiments. In the testbed's art appraisal domain, agents valuate paintings for clients and gather opinions from other agents to produce accurate appraisals. In recent years, researchers [2--4] have recognized objective standards are necessary to justify successful trust modeling systems and provide a baseline for future work. For trust technologies to crossover into application [5,6], the public must obtain system evaluations based on transparent, recognizable standards. As a versatile, universal experimentation site, the ART Testbed scopes relevant trust research problems and unites researchers toward solutions via unified experimentation methods. Through objective, well-defined metrics, the testbed provides researchers with tools for comparing and validating their approaches. The testbed also serves as an objective means of presenting technology features---both advantages and disadvantages---to the community. In addition, the ART Testbed places trust research in the public spotlight, improving confidence in the technology and highlighting relevant applications.