A novel trust architecture integrating differentiated trust and response strategies for a team of agents

Trust has been widely recognized as particularly significant among the factors influencing team performance. Trust directly impacts team performance as it plays a pivotal role in the decisions that each team member (each agent) makes regarding their own actions and their interactions with fellow team members (other agents). Hence, determining the appropriate actions of each agent in the team based on perceived trust information is critical to ensure optimal team performance. However, there is no generic mechanism dedicated to such a problem. This paper addresses this problem by proposing a novel trust architecture which integrates differentiated trust with response strategies. Differentiated trust is multidimensional trust with each trust dimension representing trust in an agent's abilities to perform the task associated with that dimension. With differentiated trust, an agent can differentiate the trustworthiness of another agent in performing different subtasks (a secondary task or a portion of the primary task). To further fulfill the transition from perceptual trust to practical actions, responses strategies are introduced. Each response strategy associates trust levels with the available actions through a distinct deterministic strategy. The high dimensional trust enabled by the differentiated trust is used as the input of a response strategy for more nuanced manipulation of the interactions. The impact of the proposed trust architecture is demonstrated through an experimental investigation. A platform simulating team performance is built based on a food foraging task. Scenarios embodying different types and proportions of a priori flawed agents are introduced to enable the system to distinguish between agents in terms of trust; thus, providing a potential to optimize team performance through the trust architecture. It is demonstrated that the proposed trust architecture enables optimized team performance in various scenarios involving agents with different trustworthiness by the appropriate determination of each agent's actions in the interactive teamwork.

[1]  J. Alberto Espinosa,et al.  Effective Coordination of Shared Leadership in Global Virtual Teams , 2019, J. Manag. Inf. Syst..

[2]  Benoit Gaudou,et al.  BDI agents in social simulations: a survey , 2016, The Knowledge Engineering Review.

[3]  Hussein A. Abbass,et al.  Trusted Autonomy and Cognitive Cyber Symbiosis: Open Challenges , 2015, Cognitive Computation.

[4]  Dana E. Sims,et al.  Is there a “Big Five” in Teamwork? , 2005 .

[5]  Edwin Hsing-Mean Sha,et al.  Trust prediction and trust-based source routing in mobile ad hoc networks , 2013, Ad Hoc Networks.

[6]  E. Salas,et al.  Games teams play: A method for investigating team coordination and performance , 1992 .

[7]  Ning Wang,et al.  The Impact of POMDP-Generated Explanations on Trust and Performance in Human-Robot Teams , 2016, AAMAS.

[8]  Robert E. Kraut,et al.  Communication and commitment in an online game team , 2012, CHI.

[9]  P. Faulkner The Trust Theory , 2011 .

[10]  Tiago Oliveira,et al.  Modelling and testing consumer trust dimensions in e-commerce , 2017, Comput. Hum. Behav..

[11]  Craig W. Reynolds Flocks, herds, and schools: a distributed behavioral model , 1987, SIGGRAPH.

[12]  D. H. Mills The Logic and Limits of Trust , 1983 .

[13]  Rutvij H. Jhaveri,et al.  Trust Based Approaches for Secure Routing in VANET: A Survey , 2015 .

[14]  Andrea Gasparri,et al.  Trust-based interactions in teams of mobile agents , 2016, 2016 American Control Conference (ACC).

[15]  Xin Sui,et al.  Agent trust evaluation and team formation in heterogeneous organizations , 2007, AAMAS '07.

[16]  Florian Jentsch,et al.  Building Appropriate Trust in Human-Robot Teams , 2013, AAAI Spring Symposium: Trust and Autonomous Systems.

[17]  Yi Wu,et al.  Multi-Agent Actor-Critic for Mixed Cooperative-Competitive Environments , 2017, NIPS.

[18]  Robert G. Lord,et al.  Leadership theory and research in the new millennium: Current theoretical trends and changing perspectives , 2014 .

[19]  G. Hertel,et al.  Trust in teams: A taxonomy of perceived trustworthiness factors and risk-taking behaviors in face-to-face and virtual teams , 2020, Human Relations.

[20]  Nathan Griffiths,et al.  Task delegation using experience-based multi-dimensional trust , 2005, AAMAS '05.

[21]  Levent Bayındır,et al.  A review of swarm robotics tasks , 2016, Neurocomputing.

[22]  Chris J. Mitchell,et al.  Security Vulnerabilities in Ad Hoc Networks , 2003 .

[23]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[24]  Jie Chen,et al.  Towards Energy Optimization: Emergent Task Allocation in a Swarm of Foraging Robots , 2007, Adapt. Behav..

[25]  Eduardo Salas,et al.  Team Performance Assessment and Measurement: Theory, Methods, and Applications. Series in Applied Psychology. , 1997 .

[26]  Sibel Adali,et al.  A Survey on Trust Modeling , 2015, ACM Comput. Surv..

[27]  Jan Wieghardt,et al.  Learning and Testing Resilience in Cooperative Multi-Agent Systems , 2020, AAMAS.

[28]  Francisco C. Santos,et al.  Social Norms of Cooperation in Small-Scale Societies , 2016, PLoS Comput. Biol..

[29]  Nicholas R. Jennings,et al.  An integrated trust and reputation model for open multi-agent systems , 2006, Autonomous Agents and Multi-Agent Systems.

[30]  Rui Liu,et al.  Trust-Aware Behavior Reflection for Robot Swarm Self-Healing , 2019, AAMAS.

[31]  C. Fulmer,et al.  Trust in work teams: An integrative review, multilevel model, and future directions , 2018 .

[32]  Rino Falcone,et al.  Trust Theory: A Socio-Cognitive and Computational Model , 2010 .

[33]  Giuseppe M. L. Sarnè,et al.  Integrating trust measures in multiagent systems , 2012, Int. J. Intell. Syst..

[34]  Audun Jøsang,et al.  A survey of trust and reputation systems for online service provision , 2007, Decis. Support Syst..

[35]  Timothy W. Finin,et al.  Coping with Node Misbehaviors in Ad Hoc Networks: A Multi-dimensional Trust Management Approach , 2010, 2010 Eleventh International Conference on Mobile Data Management.

[36]  Robert S. Gutzwiller,et al.  Human interactive machine learning for trust in teams of autonomous robots , 2017, 2017 IEEE Conference on Cognitive and Computational Aspects of Situation Management (CogSIMA).

[37]  Jordi Sabater,et al.  EVALUATING THE ReGreT SYSTEM , 2004 .

[38]  Chunyan Miao,et al.  A Survey of Multi-Agent Trust Management Systems , 2013, IEEE Access.

[39]  Yan Wang,et al.  CommTrust: Computing Multi-Dimensional Trust by Mining E-Commerce Feedback Comments , 2014, IEEE Transactions on Knowledge and Data Engineering.

[40]  S. G. Ponnambalam,et al.  An efficient trust estimation model for multi-agent systems using temporal difference learning , 2017, Neural Computing and Applications.

[41]  S. G. Cohen,et al.  What Makes Teams Work: Group Effectiveness Research from the Shop Floor to the Executive Suite , 1997 .

[42]  Jordi Sabater-Mir,et al.  Reputation and social network analysis in multi-agent systems , 2002, AAMAS '02.

[43]  Jordi Sabater-Mir,et al.  Reputation-based decisions for logic-based cognitive agents , 2010, Autonomous Agents and Multi-Agent Systems.

[44]  J. H. Davis,et al.  An Integrative Model Of Organizational Trust , 1995 .

[45]  D. Kauffmann,et al.  Knowledge Sharing of Virtual Teams: The Mediating Effect of Trust on Relationship Communication , 2018, ICICM '18.

[46]  John S. Baras,et al.  Using trust in distributed consensus with adversaries in sensor and other networks , 2014, 17th International Conference on Information Fusion (FUSION).

[47]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[48]  J. Katzenbach,et al.  The discipline of teams. , 1993, Harvard business review.

[49]  Lionel P. Robert,et al.  Monitoring and Trust in Virtual Teams , 2016, CSCW.

[50]  Gareth R. Jones,et al.  The experience and evolution of trust: Implications for cooperation and teamwork , 1998 .

[51]  Chun-Chia Lee,et al.  Does Trust Promote More Teamwork? Modeling Online Game Players' Teamwork Using Team Experience as a Moderator , 2013, Cyberpsychology Behav. Soc. Netw..

[52]  J. G. Holmes,et al.  Trust in close relationships. , 1985 .

[53]  Jordi Sabater-Mir,et al.  Computational trust and reputation models for open multi-agent systems: a review , 2013, Artificial Intelligence Review.

[54]  Jordi Sabater-Mir,et al.  REGRET: reputation in gregarious societies , 2001, AGENTS '01.

[55]  Masafumi Yamashita,et al.  Distributed memoryless point convergence algorithm for mobile robots with limited visibility , 1999, IEEE Trans. Robotics Autom..

[56]  Alan F. T. Winfield,et al.  Foraging Robots , 2009, Encyclopedia of Complexity and Systems Science.

[57]  C. Fulmer,et al.  At What Level (and in Whom) We Trust , 2012 .