Action-Based Environment Modeling for Maintaining Trust

In open multiagent systems, agents need to select whom to trust. Traditionally, this selection is done based on the models that are built for the agents in the system. After each interaction with others, agents update their models of others based on the outcome. However, building and maintaining accurate models is difficult especially before many interactions take place. Contrary to traditional modeling approaches, we propose to model the environment in terms of agents' actions and their effects, rather than building individual models for each agent. Based on the effects of its actions, each agent can modify its behavior appropriately. We evaluate our proposed approach in comparison to a traditional approach in the Agent Reputation and Trust (ART) Testbed simulation environment. The simulations compare the two approaches in terms of the accuracy of models, the effectiveness in finding trustworthy agents as well as the effort needed to build accurate models.

[1]  Laurent Vercouter,et al.  The Agent Reputation and Trust (ART) Testbed Architecture , 2005, CCIA.

[2]  Andrew W. Moore,et al.  Reinforcement Learning: A Survey , 1996, J. Artif. Intell. Res..

[3]  Nicholas R. Jennings,et al.  An integrated trust and reputation model for open multi-agent systems , 2006, Autonomous Agents and Multi-Agent Systems.

[4]  Mance E. Harmon,et al.  Reinforcement Learning: A Tutorial. , 1997 .

[5]  Munindar P. Singh,et al.  Service Graphs for Building Trust , 2004, CoopIS/DOA/ODBASE.

[6]  K. Suzanne Barber,et al.  Dynamically learning sources of trust information: experience vs. reputation , 2007, AAMAS '07.

[7]  Laurent Vercouter,et al.  A specification of the Agent Reputation and Trust (ART) testbed: experimentation and competition for trust in agent societies , 2005, AAMAS '05.

[8]  Nicholas R. Jennings,et al.  FIRE: An Integrated Trust and Reputation Model for Open Multi-Agent Systems , 2004, ECAI.

[9]  K. Suzanne Barber,et al.  Belief Revision Process Based on Trust: Agents Evaluating Reputation of Information Sources , 2000, Trust in Cyber-societies.

[10]  Munindar P. Singh,et al.  Emergent properties of referral systems , 2003, AAMAS '03.

[11]  Özgür Kafal,et al.  Trust strategies for ART Testbed , 2006 .

[12]  Sandip Sen,et al.  Expertise and Trust-based formation of effective coalitions: an evaluation of the ART testbed , 2006 .

[13]  Garrison W. Cottrell,et al.  Principled Methods for Advising Reinforcement Learning Agents , 2003, ICML.

[14]  Jordi Sabater-Mir,et al.  REGRET: reputation in gregarious societies , 2001, AGENTS '01.

[15]  Nicholas R. Jennings,et al.  Sequential decision making with untrustworthy service providers , 2008, AAMAS.

[16]  Barbara J. Grosz,et al.  Socially Conscious Decision-Making , 2000, AGENTS '00.

[17]  Yao-Hua Tan,et al.  Trust in Cyber-societies: Integrating the Human and Artificial Perspectives , 2000, Lecture Notes in Computer Science.

[18]  Rino Falcone,et al.  The Socio-cognitive Dynamics of Trust: Does Trust Create Trust? , 2000, Trust in Cyber-societies.

[19]  Robert Meersman,et al.  On the Move to Meaningful Internet Systems 2004: CoopIS, DOA, and ODBASE , 2004, Lecture Notes in Computer Science.

[20]  K. Suzanne Barber,et al.  Learning trust strategies in reputation exchange networks , 2006, AAMAS '06.

[21]  Giorgos Zacharia,et al.  Trust management through reputation mechanisms , 2000, Appl. Artif. Intell..