Executable specification of adaptive open norm-governed computational systems

Ad hoc networks may be characterised as volatile systems of agents which collaborate to achieve a common goal, be that the fair use of a common pool resource, the minimisation of packet collisions or efficient data routing. Early approaches to these problems take inspiration from emergent systems, characterised in terms of a population governed by a fixed specification, and out of which arises a relatively sophisticated set of global properties. However, the features of open ad hoc networks necessitate an approach in which participating agents agree to conform to a mutable set of rules (permissions, powers and obligations), which are conventionally rather than physically binding. We are concerned with the development of open agent societies, in which a heterogeneous set of norm-aware agents with conflicting goals can produce similar emergent global properties by introspectively modelling system change. In this thesis we present norm-governed systems spaces, in which the ‘organised adaptation’ of a specification is defined in terms of a finite number of adaptations and environmental states. These two elements are unified in a statistical framework which models an agent’s motivation for system change as a set of Markov chains, mapped to a representation of utility. This arrangement allows participants to calculate the total expected utility of any deterministic adaptation strategy, wherein policy changes are chosen for the complete set of environmental fluctuations. We demonstrate this architecture in Matlab with a resource allocation example, in the context of which a norm-governed systems space is trained. Analytic models of agent societies are often idealised, and must be deployed in an experimental test bed to ensure the assumptions remain valid. We present the novel platform PreSage-NGS which constitutes a subsumption of the norm-governed systems space framework into a multi agent system simulation environment. We illustrate an application of this software in the same resource allocation scenario, identifying agent goal conflicts by inferring the alignment of private utility models through the evaluation of publicly expressed strategy proposals. This thesis explores how norm-governed systems spaces may be rapidly trained using lightweight approximations of agent populations in Matlab, which may be verified experimentally to ensure predictions translate to the reality of an open agent society. PreSage-NGS represents a means of exploring the strength of social models for system change in agent societies, in which bounded rationality may create unforeseen interaction dynamics.

[1]  A. E. Eiben,et al.  Introduction to Evolutionary Computing , 2003, Natural Computing Series.

[2]  Agnar Aamodt,et al.  Case-Based Reasoning: Foundational Issues, Methodological Variations, and System Approaches , 1994, AI Commun..

[3]  Roel Wieringa,et al.  Deontic logic in computer science: normative system specification , 1994 .

[4]  K. Suzanne Barber,et al.  Adaptive decision-making frameworks for dynamic multi-agent organizational change , 2006, Autonomous Agents and Multi-Agent Systems.

[5]  Jan M. Broersen,et al.  Issues in Designing Logical Models for Norm Change , 2009, AAMAS-OAMAS.

[6]  M. Olson,et al.  The Logic of Collective Action: Public Goods and the Theory of Groups. , 1973 .

[7]  Alexander Artikis,et al.  Formalization of a voting protocol for virtual organizations , 2005, AAMAS '05.

[8]  Alexander Artikis,et al.  Voting in Multi-Agent Systems , 2006, Comput. J..

[9]  Carles Sierra,et al.  A coherence-driven action selection in dynamic environments , 2010, AAMAS.

[10]  Wamberto Weber Vasconcelos,et al.  Norm-oriented programming of electronic institutions , 2006, AAMAS '06.

[11]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[12]  Thomas A. Henzinger,et al.  Formalisms for Specifying Markovian Population Models , 2009, Int. J. Found. Comput. Sci..

[13]  Maite López-Sánchez,et al.  Norm Adaptation of Autonomic Electronic Institutions with Multiple Goals , 2006, Int. Trans. Syst. Sci. Appl..

[14]  Marek Sergot,et al.  On the characterization of law and computer systems: the normative systems perspective , 1994 .

[15]  Maite López-Sánchez,et al.  Towards Self-configuration in Autonomic Electronic Institutions , 2006, COIN@AAMAS/ECAI.

[16]  Alexander Artikis,et al.  Animated specifications of computational societies , 2002, AAMAS '02.

[17]  Enrico Giunchiglia,et al.  An Action Language Based on Causal Explanation: Preliminary Report , 1998, AAAI/IAAI.

[18]  Jaime Simão Sichman,et al.  Adapting Autonomic Electronic Institutions to Heterogeneous Agent Societies , 2008, AAMAS-OAMAS.

[19]  Guido Boella,et al.  Delta: The Social Delegation Cycle , 2004, DEON.

[20]  Mehdi Dastani,et al.  Goal generation in the BOID architecture , 2002 .

[21]  K. Suzanne Barber,et al.  Dynamic reorganization of decision-making groups , 2001, AGENTS '01.

[22]  Alexander Artikis,et al.  Specifying Open Agent Systems: A Survey , 2009, ESAW.

[23]  Marek J. Sergot,et al.  A Formal Characterisation of Institutionalised Power , 1996, Log. J. IGPL.

[24]  B. Ripley,et al.  Pattern Recognition , 1968, Nature.

[25]  Marek J. Sergot,et al.  A logic-based calculus of events , 1989, New Generation Computing.

[26]  Scott A. DeLoach,et al.  Exploiting Reusable Organizations to Reduce Complexity in Multiagent System Design , 2009, AOSE.

[27]  Anand S. Rao,et al.  BDI Agents: From Theory to Practice , 1995, ICMAS.

[28]  Jeremy V. Pitt,et al.  PRESAGE: A Programming Environment for the Simulation of Agent Societies , 2009, ProMAS.

[29]  Olivier Boissier,et al.  MOISE: An Organizational Model for Multi-agent Systems , 2000, IBERAMIA-SBIA.

[30]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[31]  lawa Kanas,et al.  Metric Spaces , 2020, An Introduction to Functional Analysis.

[32]  Carl Hewitt,et al.  DAI betwixt and between: from 'intelligent agents' to open systems science , 1991, IEEE Trans. Syst. Man Cybern..

[33]  H. Tong,et al.  On Markov Chain Modeling to Some Weather Data , 1976 .

[34]  Virginia. Virginia Dignum . Dignum,et al.  Handbook of Research on Multi-Agent Systems - Semantics and Dynamics of Organizational Models , 2009, Handbook of Research on Multi-Agent Systems.

[35]  Olivier Boissier,et al.  A Model for the Structural, Functional, and Deontic Specification of Organizations in Multiagent Systems , 2002, SBIA.

[36]  Enrico Giunchiglia,et al.  Causal Laws and Multi-Valued Fluents , 2001 .

[37]  Anthony Kleerekoper,et al.  Energy Trade-Offs in Resource-Constrained Multi-Agent Systems , 2009, ESAW.

[38]  Murray Shanahan,et al.  The Event Calculus Explained , 1999, Artificial Intelligence Today.

[39]  Juan A. Rodríguez-Aguilar,et al.  Infection-based self-configuration in agent societies , 2008, GECCO '08.

[40]  Olivier Boissier,et al.  Developing organised multiagent systems using the MOISE+ model: programming issues at the system and agent levels , 2007, Int. J. Agent Oriented Softw. Eng..

[41]  Pablo Noriega,et al.  Towards a Test-Bed for Trading Agents in Electronic Auction Markets , 1998, AI Commun..

[42]  P. Thagard,et al.  Coherence in Thought and Action , 2000 .

[43]  Olivier Boissier,et al.  MOISE+: towards a structural, functional, and deontic model for MAS organization , 2002, AAMAS '02.

[44]  Alexander Artikis Formalising dynamic protocols for open agent systems , 2009, ICAIL.

[45]  Gerhard Brewka,et al.  Dynamic Argument Systems: A Formal Model of Argumentation Processes Based on Situation Calculus , 2001, J. Log. Comput..

[46]  Hugo Carr,et al.  Adaptation of Voting Rules in Agent Societies , 2009, AAMAS-OAMAS.

[47]  Mark Hoogendoorn,et al.  Adaptation of Organizational Models for Multi-Agent Systems Based on Max Flow Networks , 2007, IJCAI.

[48]  Carl Hewitt,et al.  Open Information Systems Semantics for Distributed Artificial Intelligence , 1991, Artif. Intell..

[49]  K. Lewin Field theory in social science , 1951 .

[50]  G. Brady Governing the Commons: The Evolution of Institutions for Collective Action , 1993 .

[51]  Rayleigh The Problem of the Random Walk , 1905, Nature.

[52]  Alexander Artikis Executable specification of open norm-governed computational systems , 2003 .

[53]  R. Axelrod An Evolutionary Approach to Norms , 1986, American Political Science Review.

[54]  Wamberto Weber Vasconcelos,et al.  A rule-based approach to norm-oriented programming of electronic institutions , 2006, SECO.

[55]  Marek J. Sergot,et al.  Modelling Unreliable and Untrustworthy Agent Behaviour , 2004, MSRAS.

[56]  Enrique H. Ruspini,et al.  On the semantics of fuzzy logic , 1991, Int. J. Approx. Reason..

[57]  Alexander Artikis Dynamic protocols for open agent systems , 2009, AAMAS.

[58]  R. Axtell What economic agents do: How cognition and interaction lead to emergence and complexity , 2007 .

[59]  Alexander Artikis,et al.  Evaluating dynamic protocols for open agent systems , 2009, AAMAS.

[60]  Juan A. Rodríguez-Aguilar,et al.  Robust coordination in large convention spaces , 2010, AI Commun..

[61]  Carles Sierra,et al.  A Coherence Based Framework for Institutional Agents , 2007, COIN.

[62]  Scott A. DeLoach,et al.  Omacs: A Framework for Adaptive, Complex Systems , 2009, Handbook of Research on Multi-Agent Systems.

[63]  Maite López-Sánchez,et al.  Adaptation of Autonomic Electronic Institutions Through Norms and Institutional Agents , 2006, ESAW.

[64]  Marek J. Sergot,et al.  The Deontic Component of Action Language nC+ , 2006, DEON.

[65]  Maite López-Sánchez,et al.  Using Case-Based Reasoning in Autonomic Electronic Institutions , 2007, COIN.

[66]  Angelo Montanari,et al.  EFFICIENT TEMPORAL REASONING IN THE CACHED EVENT CALCULUS , 1996, Comput. Intell..

[67]  Alexander Artikis,et al.  PreSage-MS: Metric Spaces in PreSage , 2009, ESAW.

[68]  Scott A. DeLoach,et al.  Leveraging Organizational Guidance Policies with Learning to Self-Tune Multiagent Systems , 2008, 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[69]  Abraham P. Punnen,et al.  The traveling salesman problem and its variations , 2007 .

[70]  Pablo Noriega,et al.  Implementing norms in electronic institutions , 2005, AAMAS '05.

[71]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[72]  Juan A. Rodríguez-Aguilar,et al.  An Infection-Based Mechanism in Large Convention Spaces , 2009, COIN@AAMAS&IJCAI&MALLOW.

[73]  Clara Vega,et al.  Market Microstructure , 2009, Encyclopedia of Complexity and Systems Science.

[74]  Enrico Giunchiglia,et al.  Nonmonotonic causal theories , 2004, Artif. Intell..

[75]  Carles Sierra,et al.  Formalizing Deductive Coherence: An Application to Norm Evaluation , 2008, NORMAS.

[76]  Scott A. DeLoach,et al.  Trace-Based Specification of Law and Guidance Policies for Multi-Agent Systems , 2007, ESAW.

[77]  A. S. Roa,et al.  AgentSpeak(L): BDI agents speak out in a logical computable language , 1996 .

[78]  Meir G. Kohn Value and Exchange , 2004 .

[79]  Javier Vázquez-Salceda,et al.  Norms in Multiagent Systems: some Implementation Guidelines , 2004 .

[80]  Jacques Ferber,et al.  A meta-model for the analysis and design of organizations in multi-agent systems , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[81]  Scott A. DeLoach,et al.  An Organizational Model and Dynamic Goal Model for Autonomous, Adaptive Systems , 2006 .

[82]  Juan A. Rodríguez-Aguilar,et al.  Infection-Based Norm Emergence in Multi-Agent Complex Networks , 2008, ECAI.

[83]  Robert L. Axtell,et al.  Non-cooperative dynamics of multi-agent teams , 2002, AAMAS '02.

[84]  C. Sierra,et al.  A PVM implementation of the fishmarket multiagent system , 2002, Proceedings Mexico-USA Collaboration in Intelligent Systems Technologies..

[85]  Alexander Artikis,et al.  A formal model of open agent societies , 2001, International Conference on Autonomous Agents.

[86]  Alexander Artikis,et al.  Software Support for Organised Adaptation , 2010, ProMAS.

[87]  Scott A. DeLoach,et al.  A capabilities-based model for adaptive organizations , 2008, Autonomous Agents and Multi-Agent Systems.

[88]  Alexander Artikis,et al.  Specifying norm-governed computational societies , 2009, TOCL.

[89]  Jeremy V. Pitt,et al.  Dynamic Specifications in Norm-Governed Open Computational Societies , 2006, ESAW.

[90]  Alexander Artikis,et al.  Executable specification of open multi-agent systems , 2010, Log. J. IGPL.

[91]  Alexander Artikis,et al.  Peer Pressure as a Driver of Adaptation in Agent Societies , 2009, ESAW.

[92]  Marc Esteva,et al.  On the Formal Specifications of Electronic Institutions , 2001, AgentLink.

[93]  Alexander Artikis,et al.  Specifying Electronic Societies with the Causal Calculator , 2002, AOSE.

[94]  Scott A. DeLoach,et al.  A service-oriented approach for integrating multiagent system designs , 2009, AAMAS.

[95]  Juan A. Rodríguez-Aguilar,et al.  An Infection-Based Mechanism for Self-Adaptation in Multi-agent Complex Networks , 2008, 2008 Second IEEE International Conference on Self-Adaptive and Self-Organizing Systems.

[96]  Carl Hewitt,et al.  Offices are open systems , 1986, TOIS.

[97]  Alexander Artikis,et al.  An executable specification of a formal argumentation protocol , 2007, Artif. Intell..

[98]  Henry Prakken,et al.  Coherence-driven argumentation to norm consensus , 2009, ICAIL.

[99]  Juan A. Rodríguez-Aguilar,et al.  Convention emergence through spreading mechanisms , 2010, AAMAS.

[100]  Pablo Noriega,et al.  FM96.5 A Java-based Electronic Auction House , 1997, PAAM.

[101]  Nicholas V. Findler Contributions to a Computer-Based Theory of Strategies , 1990, Springer Berlin Heidelberg.

[102]  Pablo Noriega,et al.  Towards a Formal Specification of Complex Social Structures in Multi-agent Systems , 1999, Collaboration between Human and Artificial Societies.

[103]  W. Hamilton,et al.  The evolution of cooperation. , 1984, Science.

[104]  Mark Hoogendoorn,et al.  Modeling centralized organization of organizational change , 2007, Comput. Math. Organ. Theory.

[105]  G. Hardin,et al.  The Tragedy of the Commons , 1968, Green Planet Blues.