Delegations guided by trust and autonomy

This paper explores delegation decisions predicated on models of trust and autonomy among agents. In socially rich environments, trust and autonomy of artificial agents are key attributes for rational delegation decisions. Social agents are affected by many social attributes such as benevolence, social exchanges, power, and norms. We present cognitively inspired working models of trust and autonomy for delegation among agents that accounts for these social attributes. These models are validated in a simulation of a group of agents who delegate tasks in order to locate the most socially well-suited individuals for performing that task. We define autonomy in such an objective manner that agents who have the highest autonomy with respect to a task will generally be the most socially well suited. Benevolence, social reciprocation, and norms most directly contribute to autonomy and proportionally to social suitability. Derived social power directly contributes to social suitability, whereas independently assigned social power ranking overrides the suitability. We show that trust and autonomy in an agent group changes under various social settings.

[1]  Peter Fankhauser,et al.  Agents, a broker, and lies , 1999, Proceedings Ninth International Workshop on Research Issues on Data Engineering: Information Technology for Virtual Enterprises. RIDE-VE'99.

[2]  Henricus Verhagen,et al.  Norm autonomous agents , 2000 .

[3]  Thomas E. Hill,et al.  Autonomy and Self-Respect , 1991 .

[4]  Tucker Balch.  Social Entropy: a New Metric for Learning Multi-Robot Teams , 1997 .

[5]  Stephen Marsh,et al.  Formalising Trust as a Computational Concept , 1994 .

[6]  Sandip Sen,et al.  Reciprocity: a foundational principle for promoting cooperative behavior among self-interested agents , 1996 .

[7]  Jacob O. Wobbrock,et al.  Liability for Autonomous Agent Design , 1998, AGENTS '98.

[8]  Henry Hexmoor,et al.  Stages of autonomy determination , 2001, IEEE Trans. Syst. Man Cybern. Part C.

[9]  Rafael H. Bordini,et al.  Moral Sentiments in Multi-Agent Systems , 1998, ATAL.

[10]  Harko Verhagen,et al.  On the Learning of Norms , 1999 .

[11]  Katia P. Sycara,et al.  Adding security and trust to multiagent systems , 2000, Appl. Artif. Intell..

[12]  C. Hardy,et al.  Distinguishing Trust and Power in Interorganizational Relations: Forms and Façades of Trust , 1998 .

[13]  Henry Hexmoor,et al.  In Search of Simple and Responsible Agents , 2002, WRAC.

[14]  Srinivasan Seshan,et al.  Analyzing stability in wide-area network performance , 1997, SIGMETRICS '97.

[15]  A. Lindbeck,et al.  Incentives and Social Norms in Household Behavior , 1997 .

[16]  Sarvapali D. Ramchurn,et al.  A computational trust model for multi-agent interactions based on confidence and reputation , 2003 .

[17]  Andreas Harrer,et al.  Simulating Norms, Social Inequality, and Functional Change in Artificial Societies , 1999, J. Artif. Soc. Soc. Simul..

[18]  J. H. Anderson,et al.  Autonomy and the Challenges to Liberalism: New Essays , 2009 .

[19]  Nicolae B. Szirbik,et al.  Stability of multi-agent systems , 2003, SMC'03 Conference Proceedings. 2003 IEEE International Conference on Systems, Man and Cybernetics. Conference Theme - System Security and Assurance (Cat. No.03CH37483).

[20]  A. Tomlinson.  POWER , 1998, The Palgrave Encyclopedia of Imperialism and Anti-Imperialism.

[21]  Kanagaraj Krishna,et al.  A Hybrid Trust Management Model for MAS Based Trading Society , 2003, Int. Arab J. Inf. Technol..

[22]  Marek J. Druzdzel,et al.  ESP: A Mixed-Initiative Decision-Theoretic Decision Modeling System , 1999 .

[23]  Ramon M. Lemos,et al.  The Invention of Autonomy: A History of Modern Moral Philosophy , 1997 .

[24]  Linda D. Molm.  Coercive power in social exchange , 1997 .

[25]  Liam Wagner,et al.  Dealing With Curious Players in Secure Networks , 2004, ArXiv.

[26]  Paul A. Pavlou,et al.  The transitional role of institutional trust in online interorganizational relationships , 2003, 36th Annual Hawaii International Conference on System Sciences, 2003. Proceedings of the.

[27]  Munindar P. Singh,et al.  A Social Mechanism of Reputation Management in Electronic Communities , 2000, CIA.

[28]  Stephen Hailes,et al.  Supporting trust in virtual communities , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[29]  Sam Joseph,et al.  Why Autonomy Makes the Agent , 2001 .

[30]  R. Trivers.  The Evolution of Reciprocal Altruism , 1971, The Quarterly Review of Biology.

[31]  Sarvapali D. Ramchurn,et al.  Trust in Multiagent Systems , 2004 .

[32]  G. Boella,et al.  Deliberate Normative Agents , 2001 .

[33]  MARY A. SMITH,et al.  REPUTATION , 1913, Encyclopedia of Database Systems.

[34]  Cristiano Castelfranchi,et al.  Engineering Social Order , 2000, ESAW.

[35]  ダーウィン チャールス,et al.  The descent of man and selection in relation to sex , 1907 .

[36]  Michael Luck,et al.  A Formal Framework for Agency and Autonomy , 1995, ICMAS.

[37]  R. Boyd,et al.  The evolution of altruistic punishment , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[38]  C. Badcock,et al.  Trust : making and breaking cooperative relations , 1989 .

[39]  Henry Hexmoor,et al.  Discovering Human Desired Norms of Interaction Improves Social Adeptness in Agents , 2003 .

[40]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[41]  Michael N. Huhns,et al.  Multiagent Benevolence as a Societal Norm , 2001 .

[42]  Michael J. Prietula,et al.  Boundedly rational and emotional agents cooperation, trust and rumor , 2001 .

[43]  Henry Hexmoor,et al.  Effects of Reciprocal Social Exchanges on Trust and Autonomy , 2003 .

[44]  Rino Falcone,et al.  Trust and control: A dialectic link , 2000, Appl. Artif. Intell..

[45]  Henry Hexmoor,et al.  Computational adjustable autonomy for NASA Personal Satellite Assistants , 2002, SAC '02.

[46]  Diego Gambetta.  Can We Trust Trust , 2000 .

[47]  Magnus Boman,et al.  Norms in artificial decision making , 1999, Artificial Intelligence and Law.

[48]  Jordi Sabater-Mir,et al.  Review on Computational Trust and Reputation Models , 2005, Artificial Intelligence Review.

[49]  Sverrir Olafsson,et al.  On the stability of strategies in competitive systems , 1995 .

[50]  Rino Falcone,et al.  Principles of trust for MAS: cognitive anatomy, social importance, and quantification , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[51]  Yuh-Jong Hu.  Some thoughts on agent trust and delegation , 2001, AGENTS '01.

[52]  Rino Falcone,et al.  Introduction: Agents and Norms: How to fill the gap? , 1999, Artificial Intelligence and Law.

[53]  K.E. Seamons,et al.  Automated trust negotiation , 2000, Proceedings DARPA Information Survivability Conference and Exposition. DISCEX'00.

[54]  Helen Nissenbaum,et al.  Software agents and user autonomy , 1997, AGENTS '97.