Norm-governed practical reasoning agents

This thesis describes a model of norm-governed practical reasoning agents and demonstrates the implementation of this model in the form of the NoA Normative Agent language and architecture. The introduction of normative concepts such as obligations, permissions and prohibitions into the practical reasoning of an agent is motivated by the need for effective coordination mechanisms in open systems. These are typically “multi-vendor” scenarios, where independently designed agents, as representatives of human organisations and individuals, form short to medium term coalitions and collaborate in the performance of specific tasks. Electronic commerce is one of the most prominent examples of such scenarios. The use of autonomous software agents provides the necessary flexibility in these scenarios, but the critical issues such as action coordination and trust remain. Agents joining a group, or society, of agents must undergo a process of socialisation – they are required to accept the “normative standard” of such a group that regulates the actions and interactions of members. Such a normative standard cannot be hard-coded into an agent, as this standard may not be known in advance to the designer of the agent. Agents need a form of “social awareness” – they must be able to adopt and, ideally, abide by societal norms. The importance of normative concepts as a regulatory mechanism can be seen by observing their analogue in human society. In fact, mature research exists in the understanding of how legal, or normative, systems are established within human societies and how they impact on the activities of social individuals. This thesis takes normative concepts from human societies as an inspiration for the development of norm-based artificial societies and norm-governed practical reasoning agents. The key contribution of the research presented in this thesis is a model of agents that are able to take normative positions into account during practical reasoning. With the ability to acquire new norms and the capacity to reconsider them as appropriate influences on its activities, the agent is enabled to not just apply norms, but to reason about whether to honour them – the agent becomes normautonomous. Salient Points of the Thesis • An abstract model of norm-governed agency that describes how agents choose their actions based on explicitly represented normative concepts such as obligations, permissions and prohibitions in a process of norm-governed practical reasoning • A language for the specification of normative concepts such as obligations, permissions and prohibitions and of realistic legally binding contracts as a set of such norms • A programming language for norm-governed agents that provides means for the declaration of plans as the agent’s pre-specified capabilities • The NoA Normative Agent Architecture, which is a reactive planning architecture based on this abstract model for the implementation of norm-governed practical reasoning agents • A detailed investigation of possible conflicts and inconsistencies in sets of norms adopted by a norm-governed agent and the presentation of detection and resolution strategies used during norm-governed practical reasoning • A specific form of interaction for norm-governed agents, called Supervised Interaction, to allow the execution of realistic legally binding contracts in a situation of trust

[1]  Michael Luck,et al.  Modelling norms for autonomous agents , 2003, Proceedings of the Fourth Mexican International Conference on Computer Science, 2003. ENC 2003..

[2]  Max J. Cresswell,et al.  A New Introduction to Modal Logic , 1998 .

[3]  Yao-Hua Tan,et al.  Trust and Deception in Virtual Societies , 2001, Springer Netherlands.

[4]  Mihai Barbuceanu,et al.  Agents That Work in Harmony by Knowing and Fulfilling Their Obligations , 1998, AAAI/IAAI.

[5]  Michael Fisher,et al.  A Survey of Concurrent METATEM - the Language and its Applications , 1994, ICTL.

[6]  Derek Long,et al.  Goal Creation in Motivated Agents , 1995, ECAI Workshop on Agent Theories, Architectures, and Languages.

[7]  Michael Wooldridge,et al.  Understanding the Emergence of Conventions in Multi-Agent Systems , 1995, ICMAS.

[8]  Munindar P. Singh,et al.  A Social Mechanism of Reputation Management in Electronic Communities , 2000, CIA.

[9]  Moshe Tennenholtz,et al.  Emergent Conventions in Multi-Agent Systems: Initial Experimental Results and Observations (Preliminary Report) , 1992, KR.

[10]  Moshe Tennenholtz,et al.  On Social Laws for Artificial Agent Societies: Off-Line Design , 1995, Artif. Intell..

[11]  Frank Dignum,et al.  Autonomous Norm Acceptance , 1998, ATAL.

[12]  Ingmar Pörn,et al.  The logic of power , 1970 .

[13]  Marek Sergot,et al.  On the characterization of law and computer systems: the normative systems perspective , 1994 .

[14]  Frank Dignum,et al.  Autonomous agents with norms , 1999, Artificial Intelligence and Law.

[15]  Eduardo E. Alonso Rights and coordination in Multi-Agent Systems , 1998 .

[16]  Morris Sloman,et al.  A survey of trust in internet applications , 2000, IEEE Communications Surveys & Tutorials.

[17]  Michael Luck,et al.  Engineering AgentSpeak(L): A Formal Computational Model , 1998, J. Log. Comput..

[18]  Rino Falcone,et al.  Introduction: Agents and Norms: How to fill the gap? , 1999, Artificial Intelligence and Law.

[19]  Robert Walter,et al.  Allgemeine Theorie der Normen , 1979 .

[20]  David Makinson On the formal representation of rights relations , 1986, J. Philos. Log..

[21]  James E. Kittock Emergent Conventions and the Structure of Multi--Agent Systems , 1995 .

[22]  Michael Luck,et al.  Motivated Behavior for Goal Adoption , 1998, DAI.

[23]  Jörg P. Müller,et al.  A Pragmatic BDI Architecture , 1997, ATAL.

[24]  Michael Wooldridge,et al.  A Formal Specification of dMARS , 1997, ATAL.

[25]  R. Conte,et al.  Cognitive and social action , 1995 .

[26]  Alun D. Preece,et al.  CONOISE: Agent-Based Formation of Virtual Organisations , 2003, SGAI Conf..

[27]  Martin J. Kollingbaum,et al.  Norm Adoption and Consistency in the NoA Agent Architecture , 2003, PROMAS.

[28]  Martin J. Kollingbaum,et al.  Norm Consistency in Practical Reasoning Agents , 2003 .

[29]  C. Bergmann,et al.  JASON Java-based AgentSpeak interpreter used with saci for multi-agent distribution over the net , 2006 .

[30]  Henricus Verhagen,et al.  Norm autonomous agents , 2000 .

[31]  Magnus Boman,et al.  Social Intelligence as Norm Adaptation , 1998 .

[32]  Pablo Noriega,et al.  Competitive scenarios for heterogeneous trading agents , 1998, AGENTS '98.

[33]  John-Jules Ch. Meyer,et al.  A different approach to deontic logic: deontic logic viewed as a variant of dynamic logic , 1987, Notre Dame J. Formal Log..

[34]  Michael Luck,et al.  Structuring a Z Specification to Provide a Formal Framework for Autonomous Agent Systems , 1995, ZUM.

[35]  Michael Luck,et al.  Empowered Situations of Autonomous Agents , 2002, IBERAMIA.

[36]  Nicholas R. Jennings,et al.  Commitments and conventions: The foundation of coordination in multi-agent systems , 1993, The Knowledge Engineering Review.

[37]  Chris Reed,et al.  Delegation and Responsibility , 2000, ATAL.

[38]  Anand S. Rao,et al.  An Abstract Architecture for Rational Agents , 1992, KR.

[39]  Mehdi Dastani,et al.  The BOID architecture: conflicts between beliefs, obligations, intentions and desires , 2001, AGENTS '01.

[40]  Chrysanthos Dellarocas Sloan Contractual Agent Societies : Negotiated shared context and social control in open multi-agent systems , 2000 .

[41]  Michael Luck,et al.  Constraining autonomy through norms , 2002, AAMAS '02.

[42]  A. P. Carrillo Newcomb Hohfeld, Wesley: Fundamental Legal Conceptions as Applied in Judicial Reasoning , 1965 .

[43]  Chris Reed,et al.  Implementing responsibility for states and events , 2003, AAMAS '03.

[44]  Martin J. Kollingbaum,et al.  Strategies for resolving Norm Conflicts in Practical Reasoning , 2004 .

[45]  Martin J. Kollingbaum,et al.  NoA - A Normative Agent Architecture , 2003, IJCAI.

[46]  A. S. Roa,et al.  AgentSpeak(L): BDI agents speak out in a logical computable language , 1996 .

[47]  Magnus Boman,et al.  Norms in artificial decision making , 1999, Artificial Intelligence and Law.

[48]  Moshe Tennenholtz,et al.  Artificial Social Systems , 1992, Lecture Notes in Computer Science.

[49]  Timo Steffens,et al.  Understanding Agent Systems , 2004, Künstliche Intell..

[50]  Nicholas R. Jennings,et al.  Rights and commitment in multi-agent agreements , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[51]  Rino Falcone,et al.  Principles of trust for MAS: cognitive anatomy, social importance, and quantification , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[52]  Pablo Noriega,et al.  Agent-mediated auctions: the fishmarket metaphor , 1997 .

[53]  Chris Reed,et al.  A Model of Delegation for Multi-agent Systems , 2002, Foundations and Applications of Multi-Agent Systems.

[54]  Mihai Barbuceanu,et al.  Role of Obligations in Multiagent Coordination , 1999, Appl. Artif. Intell..

[55]  Matthias Klusch,et al.  Brokering and Matchmaking for Coordination of Agent Societies: A Survey , 2001, Coordination of Internet Agents: Models, Technologies, and Applications.

[56]  Nicholas R. Jennings,et al.  Using Joint Responsibility to Coordinate Collaborative Problem Solving in Dynamic Environments , 1992, AAAI.

[57]  Jordi Sabater-Mir,et al.  Reputation and social network analysis in multi-agent systems , 2002, AAMAS '02.

[58]  Allen Newell,et al.  High-speed implementations of rule-based systems , 1989, TOCS.

[59]  Rafael H. Bordini,et al.  Running AgentSpeak(L) Agents on SIM_AGENT , 2001, ATAL.

[60]  James A. R. Marshall,et al.  The execution kernel of RC++: RETE*, a faster RETE with TREAT as a special case , 2003, Int. J. Intell. Games Simul..

[61]  Marcus J. Huber JAM: a BDI-theoretic mobile agent architecture , 1999, AGENTS '99.

[62]  Richard Fikes,et al.  Learning and Executing Generalized Robot Plans , 1993, Artif. Intell..

[63]  Allen Newell,et al.  Soar/PSM-E: investigating match parallelism in a learning production sytsem , 1988, PPEALS '88.

[64]  Edward Fredkin,et al.  Trie memory , 1960, Commun. ACM.

[65]  Les Gasser,et al.  Social Conceptions of Knowledge and Action: DAI Foundations and Open Systems Semantics , 1991, Artif. Intell..

[66]  Amy L. Lansky,et al.  Reactive Reasoning and Planning , 1987, AAAI.

[67]  Michael Luck,et al.  Understanding Agent Systems , 2001, Springer Series on Agent Technology.

[68]  Yao-Hua Tan,et al.  The Role of Trust and Deception in Virtual Societies , 2002, Int. J. Electron. Commer..

[69]  Alexander Artikis Executable specification of open norm-governed computational systems , 2003 .

[70]  Anoop Gupta,et al.  Comparison of the RETE and TREAT production matchers for soar (A summary) , 1988, AAAI 1988.

[71]  Mehdi Dastani,et al.  A Classification of Cognitive Agents , 2019, Proceedings of the Twenty-Fourth Annual Conference of the Cognitive Science Society.

[72]  Koen V. Hindriks,et al.  Agent Programming in 3APL , 1999, Autonomous Agents and Multi-Agent Systems.

[73]  Martin J. Kollingbaum,et al.  Norm adoption in the NoA agent architecture , 2003, AAMAS '03.

[74]  Kevin Crowston,et al.  The interdisciplinary study of coordination , 1994, CSUR.

[75]  Moshe Tennenholtz,et al.  Co-Learning and the Evolution of Social Acitivity , 1994 .

[76]  Marek J. Sergot,et al.  On the Representation of Action and Agency in the Theory of Normative Positions , 2001, Fundam. Informaticae.

[77]  Ghita Holmström-Hintikka,et al.  Rights and Parliamentarism , 2001 .

[78]  Jordi Sabater-Mir,et al.  Evolutionary computation and multiagent systems design , 2002, AAMAS 2002.

[79]  Amedeo Cesta,et al.  Recent Advances in AI Planning , 1997, Lecture Notes in Computer Science.

[80]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[81]  Daniel P. Miranker TREAT: a better match algorithm for AI production systems , 1987, AAAI 1987.

[82]  Katia P. Sycara,et al.  Middle-Agents for the Internet , 1997, IJCAI.

[83]  G. Boella,et al.  Deliberate Normative Agents , 2001 .

[84]  Walter A. Burkhard,et al.  Hashing and trie algorithms for partial match retrieval , 1976, TODS.

[85]  Anand S. Rao,et al.  Modeling Rational Agents within a BDI-Architecture , 1997, KR.

[86]  Frank Dignum,et al.  Towards socially sophisticated BDI agents , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[87]  Michael Luck,et al.  A Framework for Norm-based Inter-Agent Dependence , 2001 .

[88]  Chris Reed,et al.  Group delegation and responsibility , 2002, AAMAS '02.

[89]  Rino Falcone,et al.  Trust is much more than subjective probability: mental components and sources of trust , 2000, Proceedings of the 33rd Annual Hawaii International Conference on System Sciences.

[90]  Ingmar Pörn,et al.  POSITION AND CHANGE: A Study in Law and Logic , 1978 .

[91]  Christen Krogh,et al.  The Rights of Agents , 1995, ATAL.

[92]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[93]  Pablo Cayetano Noriega Blanco-Vigil Agent mediated auctions: the fishmarket metaphor , 1998 .

[94]  Barbara Messing,et al.  An Introduction to MultiAgent Systems , 2002, Künstliche Intell..

[95]  Craig A. Knoblock,et al.  PDDL-the planning domain definition language , 1998 .

[96]  David J. Israel,et al.  Plans and resource‐bounded practical reasoning , 1988, Comput. Intell..

[97]  M. Schillo,et al.  Who can you trust: Dealing with Deception , 1999 .

[98]  Nicholas R. Jennings,et al.  Agent Theories, Architectures, and Languages: A Survey , 1995, ECAI Workshop on Agent Theories, Architectures, and Languages.

[99]  Moshe Tennenholtz,et al.  On the Synthesis of Useful Social Laws for Artificial Agent Societies (Preliminary Report) , 1992, AAAI.

[100]  R. Conte,et al.  ARE INCENTIVES GOOD ENOUGH TO ACHIEVE (INFO) SOCIAL ORDER , 2001 .

[101]  Charles L. Forgy,et al.  Rete: a fast algorithm for the many pattern/many object pattern match problem , 1991 .

[102]  D. Dennett The Intentional Stance. , 1987 .

[103]  Michael Luck,et al.  Motivated Behaviour for Goal Adoption , 1998 .

[104]  Allen Newell,et al.  Soar/PSM-E: investigating match parallelism in a learning production sytsem , 1988, PPoPP 1988.

[105]  Marshall James,et al.  RC++: a rule-based language for game AI , 2000 .

[106]  Stephen Marsh,et al.  Formalising Trust as a Computational Concept , 1994 .

[107]  Martin J. Kollingbaum,et al.  A Contract Management Framework for Supervised Interaction , 2002 .

[108]  Timothy J. Norman,et al.  Motivation-based direction of planning attention in agents with goal autonomy , 1997 .

[109]  Frank Dignum,et al.  Agent-Mediated Electronic Commerce: Scientific and Technological Roadmap , 2001, AgentLink.

[110]  R. James Firby,et al.  An Investigation into Reactive Planning in Complex Domains , 1987, AAAI.

[111]  Michael Luck,et al.  A Model of Normative Multi-agent Systems and Dynamic Relationships , 2002, RASTA.

[112]  Marc Esteva,et al.  ISLANDER: an electronic institutions editor , 2002, AAMAS '02.

[113]  Edmund H. Durfee,et al.  UM-PRS: An implementation of the procedural reasoning system for multirobot applications , 1994 .

[114]  M. Brauer,et al.  Social power , 2006 .

[115]  S. Lindström,et al.  New Foundations for Ethical Theory , 2001 .

[116]  Michael Luck,et al.  A Conceptual Framework for Agent Definition and Development , 2001, Comput. J..

[117]  Martin J. Kollingbaum,et al.  Supervised interaction: creating a web of trust for contracting agents in electronic environments , 2002, AAMAS '02.

[118]  Pablo Noriega,et al.  FM96.5 A Java-based Electronic Auction House , 1997, PAAM.

[119]  Allen Newell,et al.  SOAR: An Architecture for General Intelligence , 1987, Artif. Intell..

[120]  Layman E. Allen,et al.  A-Hohfeld: a language for robust structural representation of knowledge in the legal domain to build interpretation-assistance expert systems , 1994 .

[121]  S. Brison The Intentional Stance , 1989 .

[122]  Cristiano Castelfranchi,et al.  Commitments: From Individual Intentions to Groups and Organizations , 1995, ICMAS.

[123]  Michael Wooldridge,et al.  Model checking agentspeak , 2003, AAMAS '03.

[124]  Michael Wooldridge,et al.  Reasoning about rational agents , 2000, Intelligent robots and autonomous agents.

[125]  Roel Wieringa,et al.  Deontic logic in computer science: normative system specification , 1994 .

[126]  Martin J. Kollingbaum,et al.  Supervised Interaction - A Form of Contract Management to Create Trust between Agents , 2002, Trust, Reputation, and Security.

[127]  David E. Smith,et al.  Conditional Effects in Graphplan , 1998, AIPS.

[128]  Mark Klein,et al.  Chapter 5 CONTRACTUAL AGENT SOCIETIES Negotiated shared context and social control in open multi-agent systems , 2001 .

[129]  Moshe Tennenholtz,et al.  On the Emergence of Social Conventions: Modeling, Analysis, and Simulations , 1997, Artif. Intell..

[130]  Nicholas R. Jennings,et al.  Controlling Cooperative Problem Solving in Industrial Multi-Agent Systems Using Joint Intentions , 1995, Artif. Intell..

[131]  Marek J. Sergot,et al.  A Formal Characterisation of Institutionalised Power , 1996, Log. J. IGPL.

[132]  Michael Luck,et al.  Towards a Model of the Dynamics of Normative Multi-Agent Systems , 2002 .

[133]  Olga Pacheco,et al.  A Role Based Model for the Normative Specification of Organized Collective Agency and Agents Interaction , 2003, Autonomous Agents and Multi-Agent Systems.

[134]  Marek Sergot,et al.  A computational theory of normative positions , 2001, ACM Trans. Comput. Log..

[135]  Frank Dignum Autonomous agents and social norms , 1996 .

[136]  Mehdi Dastani,et al.  What is a Normative Goal ? , 2002 .

[137]  Matthias Klusch,et al.  Matchmaking among Heterogeneous Agents on the Internet , 1999 .

[138]  Nicholas R. Jennings,et al.  Negotiating the Semantics of Agent Communication Languages , 2002, Comput. Intell..