Autonomy vs. Conformity: An Institutional Perspective on Norms and Protocols

The research presented in this thesis is part of the ToKeN project ANITA (Administrative Normative Information Transaction Agents). In this domain the main challenges concern both the shortage of information (not being able to find legally relevant data that should be available) as well as the abundance of information (for example violating privacy rights). These issues are of great consequence in the domain of police and judicial intelligence. In the ANITA scenario, where agents autonomously decide whether or not to share (privacy sensitive) information based on the applicability of (local) norms, a global frame for the enforcement of (global) norms was needed. Since all agents have to adhere to the global regulations as given by law, it has to be checked whether the information transactions are not in conflict with the laws that hold for the domain. In most software and agent methodologies, such regulations are seen only as extra requirements in the analysis phase, and are thus hard-coded into the software or agents themselves. If, however, the regulations change it becomes very hard to track all the norms (that is, all the design steps have to be checked and all the code verified to ensure compliance to the new regulations). The alternative is to have an explicit representation of the norms, but this approach requires some form of enforcement to ensure the compliance instead. This alternative can be found in the introduction of an electronic institution. Electronic institutions, similar to their human counterparts, provide a safe environment mediating the interaction of agents, where the expected behaviour of the agents is expressed by norms. The introduction of an electronic institution in a highly-regulated domain such as the ANITA scenario, requires us to solve issues related to the abstractness of human regulations, the lack of operational information and the implementation of norm enforcement from an institutional perspective. In this thesis we solve these problems by the introduction of a framework for making the connections between the norms and the agent practice explicit. An electronic institution is characterised by the normative specification and its procedures. Both the normative specification and the procedures, expressed in protocols that the agents can use to achieve common tasks, are derived from the law and regulations that govern the domain. To ensure that none of these laws are broken by any of the agents participating in the institution, some form of enforcement is required. This can either be done by restricting the agents to specific procedures (that are known to be norm-compliant) or by monitoring the behaviour of the agents and punishing them in the case they violate a norm. We argue that the latter holds many benefits, since restricting agents to pre-defined procedures severely reduces the autonomy of the agents participating in the institution. The implementation of norms, as presented in this work, by the creation of a mechanism of active norm enforcement ensures a good balance between autonomy and conformity of the agents participating in the electronic institution.

[1]  F. J. Wiesman,et al.  Information retrieval by graphically browsing meta-information , 1998 .

[2]  Boris Shishkov,et al.  Software Specification Based on Re-usable Business Components , 2005 .

[3]  Frank Dignum,et al.  Proving Norm Compliancy of Protocols in Electronic Institutions , 2005 .

[4]  Frank Dignum,et al.  The Role of Deontic Logic in the Specification of Information Systems , 1998, Logics for Databases and Information Systems.

[5]  N.J.E. Wijngaards,et al.  Re-design of compositional systems , 1999 .

[6]  Hendrik Blockeel,et al.  Multi-Relational Data Mining , 2005, Frontiers in Artificial Intelligence and Applications.

[7]  Wietske de Vries,et al.  Agent interaction: abstract approaches to modelling, programming and verifying multi-agent systems , 2002 .

[8]  Henry Prakken,et al.  Modelling reasoning about evidence in legal procedure , 2001, ICAIL '01.

[9]  Stijn Hoppenbrouwers,et al.  Freezing language : conceptualisation processes across ICT-supported organisations , 2003 .

[10]  Antonio Jimeno-Yepes,et al.  Applications of Ontologies and Text Mining in the Biomedical Domain , 2010, Ontology Theory, Management and Design.

[11]  Julian Padget,et al.  Formalizing a Language for Institutions and Norms , 2001, ATAL.

[12]  Wojciech Janusz Jamroga,et al.  Using multiple models of reality: on agents who know how to play safer , 2004 .

[13]  Anders Bouwer,et al.  Explaining behaviour: using qualitative simulation in interactive learning environments , 2005 .

[14]  Fabiola López y López,et al.  Social power and norms : impact on agent behaviour , 2003 .

[15]  Frank Dignum,et al.  Counts-as: Classification or Constitution? An Answer Using Modal Logic , 2006, DEON.

[16]  Grigoris Antoniou,et al.  Nonmonotonic reasoning , 1997 .

[17]  Eugueni Smirnov,et al.  Conjunctive and Disjunctive Version Spaces with Instance-based Boundary Sets , 2001 .

[18]  Stefan Manegold,et al.  Understanding, modeling, and improving main-memory database performance , 2002 .

[19]  Milind Tambe,et al.  Towards Flexible Teamwork , 1997, J. Artif. Intell. Res..

[20]  S. Renooij Qualitative approaches to quantifying probabilistic networks , 2001 .

[21]  Pablo Noriega,et al.  Implementing norms in electronic institutions , 2005, AAMAS '05.

[22]  Michael Wooldridge,et al.  Agent-based software engineering , 1997, IEE Proc. Softw. Eng..

[23]  Andreas Martin Thomas Lincke,et al.  Electronic business negotiation: some experimental studies on the interaction between medium, innovation context, and culture , 2003 .

[24]  M. A. Windhouwer,et al.  Feature grammar systems. Incremental maintenance of indexes to digital media warehouses , 2003 .

[25]  Trevor J. M. Bench-Capon,et al.  A method for the development of legal knowledge systems , 1997, ICAIL '97.

[26]  Marek J. Sergot,et al.  Deontic logic in the representation of law: Towards a methodology , 2004, Artificial Intelligence and Law.

[27]  Henk-Jan Lebbink Dialogue and Decision Games for Information Exchanging Agents , 2006 .

[28]  Börkur Sigurbjörnsson,et al.  Focused information access using XML element retrieval , 2006 .

[29]  Munindar P. Singh,et al.  Emergence of agent-based referral networks , 2002, AAMAS '02.

[30]  F. Divina Hybrid Genetic Relational Search for Inductive Learning , 2004 .

[31]  Neerincx,et al.  Human-computer interaction and presence in virtual reality exposure therapy , 2003 .

[32]  S. J. Karlsson Scalable distributed data structures for database management , 2000 .

[33]  Juan Antonio Rodriguez,et al.  On the Design and Construction of Agent-mediated Electronic Institutions , 2001 .

[34]  Sandra Simonsen-Anderson,et al.  Safe and sound. , 2002, Nursing management.

[35]  Vojkan Mihajlovic,et al.  Score region algebra : a flexible framework for structured information retrieval , 2006 .

[36]  Jeffrey M. Bradshaw,et al.  Designing conversation policies using joint intention theory , 1998, Proceedings International Conference on Multi Agent Systems (Cat. No.98EX160).

[37]  Salceda J. Vazquez Role of Norms and Electronic Institutions in Multi-Agent Systems: The Harmonia Framework , 2004 .

[38]  A. J. Lehmann Causation in artificial intelligence and law : a modelling approach , 2003 .

[39]  D. Mobach Agent-Based Mediated Service Negotiation , 2007 .

[40]  S. Bocconi,et al.  Vox Populi : generating video documentaries from semantically annotated media repositories , 2006 .

[41]  Henry Prakken,et al.  Contrary-to-duty obligations , 1996, Stud Logica.

[42]  van Joeri Ruth Flattening queries over nested data types , 2006 .

[43]  Michael Luck,et al.  Towards a Model of the Dynamics of Normative Multi-Agent Systems , 2002 .

[44]  Pablo Noriega,et al.  Operationalisation of norms for usage in electronic institutions , 2006, AAMAS '06.

[45]  Thomas R. Gruber,et al.  A translation approach to portable ontology specifications , 1993, Knowl. Acquis..

[46]  Peter J. F. Lucas,et al.  Meta-level Verification of the Quality of Medical Guidelines Using Interactive Theorem Proving , 2004, JELIA.

[47]  B. Sheppard Towards perfect play of Scrabble , 2002 .

[48]  Gerard Delanty The Foundations of Social Theory , 2009 .

[49]  D. Beal The nature of minimax search , 1999 .

[50]  Nicholas V. Findler,et al.  Social Structures and the Problem of Coordination in Intelligent Agent Societies , 2000 .

[51]  Hans Weigand,et al.  A Specification Language for Static, Dynamic and Deontic Integrity Constraints , 1989, MFDBS.

[52]  Henry Prakken,et al.  The Role of Logic in Computational Models of Legal Argument: A Critical Survey , 2002, Computational Logic: Logic Programming and Beyond.

[53]  Kevin D. Ashley,et al.  AI and Law: A fruitful synergy , 2003, Artif. Intell..

[54]  Dov M. Gabbay,et al.  Investigations in modal and tense logics with applications to problems in philosophy and linguistics , 1976 .

[55]  Carsten Riggelsen,et al.  Approximation Methods for Efficient Learning of Bayesian Networks , 2008, Frontiers in Artificial Intelligence and Applications.

[56]  M. V. Dignum,et al.  A Model for Organizational Interaction: based on Agents, founded in Logic , 2000 .

[57]  F. Dignum Abstract Norms and Electronic Institutions , 2002 .

[58]  J.S.J.H. Penders,et al.  The practical art of moving physical objects , 1999 .

[59]  Nicholas R. Jennings,et al.  Intelligent agents: theory and practice , 1995, The Knowledge Engineering Review.

[60]  M. Sabou,et al.  Building web service ontologies , 2006 .

[61]  H Hongjing Wu,et al.  A reference architecture for adaptive hypermedia applications , 2002 .

[62]  Rik Eshuis,et al.  Semantics and Verification of UML Activity Diagrams for Workflow Modelling , 2002 .

[63]  L. THORNE MCCARTY Ownership: A case study in the representation of legal concepts , 2004, Artificial Intelligence and Law.

[64]  Roel Wieringa,et al.  Requirements Engineering: Frameworks for Understanding , 1996 .

[65]  Willem-Jan van den Heuvel Integrating modern business applications with objectified legacy systems , 2002 .

[66]  Roeland Ordelman,et al.  Dutch speech recognition in multimedia information retrieval , 2003 .

[67]  Stacey Fusae Nagat User Assistance for Multitasking with Interruptions on a Mobile Device , 2006 .

[68]  Veerle Coupé,et al.  Sensitivity Analysis of Decision-Theoretic Networks , 2000 .

[69]  Flavius Frasincar,et al.  Hypermedia presentation generation for semantic web information systems , 2005 .

[70]  H. Stuckenschmidt,et al.  Ontology-Based Information Sharing in Weakly Structured Environments , 2003 .

[71]  F. Grootjen,et al.  A pragmatic approach to the conceptualisation of language , 2005 .

[72]  G. de Haan,et al.  ETAG, A Formal Model of Competence Knowledge for User Interface Design , 2000 .

[73]  Rainer Malik CONAN : Text Mining in the Biomedical Domain , 2006 .

[74]  M. B. van Riemsdijk,et al.  Cognitive agent programming : A semantic approach , 2006 .

[75]  Martin Wigbertus Antonius Caminada For the sake of the Argument : explorations into argument-based reasoning , 1997 .

[76]  PerOlof Bengtsson,et al.  Architecture-Level Modifiability Analysis , 2002 .

[77]  D. Sent,et al.  Test-selection Strategies for Probabilistic Networks , 2005 .

[78]  Paul McNamara,et al.  Deontic logic , 2006, Logic and the Modalities in the Twentieth Century.

[79]  Michael Luck,et al.  A Framework for Norm-based Inter-Agent Dependence , 2001 .

[80]  J. Broekstra,et al.  Storage, Querying and Inferencing for Semantic Web Languages , 2005 .

[81]  M. Sloof,et al.  Physiology of Quality Change Modelling. Automated modelling of quality change of agricultural products , 1999 .

[82]  S. Sieber On a decision method in restricted second-order arithmetic , 1960 .

[83]  M. van Welie,et al.  Task-based User Interface Design , 2001 .

[84]  Frank Dignum,et al.  Autonomous agents with norms , 1999, Artificial Intelligence and Law.

[85]  R. V. Kralingen Frame-Based Conceptual Models Of Statute Law , 1995 .

[86]  P.A.T. van Eck,et al.  A Compositional Semantic Structure for Multi-Agent Systems Dynamics , 2001 .

[87]  B. Omelayenko Web Service Configuration on the Semantic Web , 2005 .

[88]  Marina Velikova,et al.  Monotone models for prediction in data mining , 2006 .

[89]  Brahim Chaib-draa,et al.  An ontology of social control tools , 2006, AAMAS '06.

[90]  M. Petkovic,et al.  Content-based Video Retrieval Supported by Database Technology , 2003 .

[91]  Henry Prakken,et al.  Logical Models of Legal Argumentation , 1997 .

[92]  Z. S. Baida,et al.  Software-aided Service Bundling : Intelligent Methods and Tools for Graphical Service Modeling , 2006 .

[93]  Witold Lukaszewicz,et al.  Non-monotonic reasoning - formalization of commonsense reasoning , 1990 .

[94]  Javier Vázquez-Salceda,et al.  Organizing Multiagent Systems , 2005, Autonomous Agents and Multi-Agent Systems.

[95]  J. Verbeek Politie en de nieuwe internationale informatiemarkt : grensregionale politiele gegevensuitwisseling en digitale expertise , 2004 .

[96]  Philip R. Cohen,et al.  Toward A Formalism for Conversation Protocols Using Joint Intention Theory , 2002, Comput. Intell..

[97]  Mark Hoogendoorn,et al.  Modeling of Change in Multi-Agent Organizations , 2007 .

[98]  John-Jules Ch. Meyer,et al.  A different approach to deontic logic: deontic logic viewed as a variant of dynamic logic , 1987, Notre Dame J. Formal Log..

[99]  G. G. Infante Lopez,et al.  Two-level probabilistic grammars for natural language parsing , 2005 .

[100]  Madelon Evers Learning from Design: Facilitating Multidisciplinary Design Teams , 2004 .

[101]  Johan F. Hoorn,et al.  Software Requirements: Update, upgrade, redesign. towards a theory of requirements change , 2006 .

[102]  Vu,et al.  Review of the book Een computermodel voor het ondersteunen van euthanasiebeslissingen. , 2006 .

[103]  Alan Ross Anderson,et al.  A REDUCTION OF DEONTIC LOGIC TO ALETHIC MODAL LOGIC , 1958 .

[104]  Roelof van Zwol Modelling and searching web-based document collections , 2002 .

[105]  C. J. Leune Access control and service-oriented architectures , 2007 .

[106]  Thijs Westerveld,et al.  Using generative probabilistic models for multimedia retrieval , 2005, SIGF.

[107]  Robert A. Kowalski,et al.  The Semantics of Predicate Logic as a Programming Language , 1976, JACM.

[108]  Sarit Kraus,et al.  Collaborative Plans for Complex Group Action , 1996, Artif. Intell..

[109]  D. North Institutions, Institutional Change and Economic Performance: Economic performance , 1990 .

[110]  H.H.L.M. Donkers,et al.  NOSCE HOSTEM: Searching with Opponent Models , 1997 .

[111]  Erik van der Werf,et al.  AI techniques for the game of Go , 2001 .

[112]  F. Waas Principles of probabilistic query optimization , 2000 .

[113]  Jacob Lenting Informed gambling : conception and analysis of a multi-agent mechanism for discrete reallocation , 1999 .

[114]  T. D. Bui,et al.  Creating Emotions and Facial Expressions for Embodied Agents , 2004 .

[115]  A. Schmidt,et al.  Processing XML in Database Systems , 2002 .

[116]  Javier Vázquez-Salceda,et al.  Implementing Norms in Multiagent Systems , 2004, MATES.

[117]  Gilad Mishne,et al.  Applied text analytics for blogs , 2007 .

[118]  Trevor J. M. Bench-Capon,et al.  Isomorphism and legal knowledge based systems , 1992, Artificial Intelligence and Law.

[119]  V. Bessa Machado Supporting the Construction of Qualitative Knowledge models , 2004 .

[120]  acobus Adrianus van Eck A system of temporally relative modal and deontic predicate logic and its philosophical applications , 1981 .

[121]  Richard Fikes,et al.  STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving , 1971, IJCAI.

[122]  Henricus Verhagen,et al.  Norm autonomous agents , 2000 .

[123]  Gerard J. Holzmann,et al.  The Model Checker SPIN , 1997, IEEE Trans. Software Eng..

[124]  Dap Hartmann,et al.  Memory versus Search in Games , 1998, J. Int. Comput. Games Assoc..

[125]  Michel C. A. Klein,et al.  Change Management for Distributed Ontologies , 2004 .

[126]  Pierre Wolper,et al.  Constructing Automata from Temporal Logic Formulas: A Tutorial , 2002, European Educational Forum: School on Formal Methods and Performance Analysis.

[127]  Bart Willem Schermer,et al.  Software Agents, Surveillance and the right to privacy , 2007 .

[128]  Milan Petkovic,et al.  Content-Based Video Retrieval , 2004, The Springer International Series in Engineering and Computer Science.

[129]  L. J. Kortmann The resolution of visually guided behaviour , 2003 .

[130]  Pepijn R. S. Visser Knowledge specification for multiple legal tasks : a case studies of the interaction problem in the legal domain , 1995 .

[131]  Marek J. Sergot,et al.  The British Nationality Act as a logic program , 1986, CACM.

[132]  Jan Broersen Modal Action Logics for Reasoning about Reactive Systems , 2003 .

[133]  W. Teepe Reconciling Information Exchange and Confidentiality, A Formal Approach , 2007 .

[134]  Marc Esteva,et al.  AMELI: an agent-based middleware for electronic institutions , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[135]  F. Dignum,et al.  Deliberate Normative Agents: Principles and Architectures , 1999 .

[136]  Wamberto Weber Vasconcelos,et al.  A Distributed Architecture for Norm-Aware Agent Societies , 2005, DALT.

[137]  P. T. de Vrieze,et al.  Fundaments of Adaptive Personalisation , 2006 .

[138]  Jaap Gordijn,et al.  Value-based requirements engineering: exploring innovative e-commerce ideas , 2003, Requirements Engineering.

[139]  Frank Dignum,et al.  Classificatory Aspects of Counts-as: An Analysis in Modal Logic , 2006, J. Log. Comput..

[140]  Laura Hollink,et al.  Semantic annotation for retrieval of visual resources , 2006 .

[141]  L. J. Hommes The evaluation of business process modeling techniques , 2004 .

[142]  John McCarthy,et al.  Circumscription - A Form of Non-Monotonic Reasoning , 1980, Artif. Intell..

[143]  F. Dignum,et al.  From Desires, Obligations and Norms to Goals , 2002 .

[144]  L. Mommers,et al.  Applied legal epistemology. Building a knowledge-based ontology of the legal domain , 2002 .

[145]  Chris van Aart,et al.  Organizational Principles for Multi-Agent Architectures , 2004 .

[146]  P.H.G. van Langen,et al.  The Anatomy of Design: Foundations, Models and Applications , 2002 .

[147]  A. de Moor,et al.  Empowering communities: A method for the legitimate user-driven specification of network information systems , 1999 .

[148]  H. B. Verheij Rules, reasons, arguments : formal studies of argumentation and defeat , 1996 .

[149]  Frank van Harmelen,et al.  Ontology-based information sharing , 2005 .

[150]  Javier Vázquez-Salceda,et al.  Ontological aspects of the implementation of norms in agent-based electronic institutions , 2006, Comput. Math. Organ. Theory.

[151]  Hans Weigand,et al.  Formal Specification of Interaction in Agent Societies , 2002, FAABS.

[152]  Ion Juvina Development of cognitive model for navigating on the web , 2006 .

[153]  M. G. Jansen Formal explorations of knowledge intensive tasks , 2003 .

[154]  R. V. D. Pol Knowledge-based query formulation in information retrieval , 2000 .

[155]  Nuel D. Belnap,et al.  Seeing To it That: A Canonical Form for Agentives , 2008 .

[156]  Juan Roberto Castelo Valdueza,et al.  The Discrete Acyclic Digraph Markov Model in Data Mining , 2002 .

[157]  Joris Petrus Maria Graaumans,et al.  Usability of XML Query Languages , 2001 .

[158]  Frank Dignum,et al.  Enacting and Deacting Roles in Agent Programming , 2004, AOSE.

[159]  C. Pierik,et al.  Validation techniques for object-oriented proof outlines , 2006 .

[160]  Eitan M. Gurari,et al.  Introduction to the theory of computation , 1989 .

[161]  van Boris Wessel Schooten,et al.  Development and Specification of Virtual Environments , 2003 .

[162]  Frank Dignum,et al.  Modelling Agent Societies: Co-ordination Frameworks and Institutions , 2001, EPIA.

[163]  W.C.A. Wijngaards,et al.  Agent-Based Modelling of Dynamics: Biological and Organisational Applications , 2002 .

[164]  Peter Boncz,et al.  UvA-DARE ( Digital Academic Repository ) Monet ; a next-Generation DBMS Kernel For Query-Intensive Applications , 2007 .

[165]  Wilhelmus Lambertus Adrianus Derks Improving Concurrency and Recovery in Database Systems by Exploiting Application Semantics , 2005 .

[166]  Fred Kröger,et al.  Temporal Logic of Programs , 1987, EATCS Monographs on Theoretical Computer Science.

[167]  T. Bosse Analysis of the Dynamics of Cognitive Processes , 2005 .

[168]  James E. Tomberlin Contrary-to-Duty Imperatives and Conditional Obligation , 1981 .

[169]  Marko Smiljanic,et al.  XML schema matching : balancing efficiency and effectiveness by means of clustering , 2006 .

[170]  Frank Dignum,et al.  Towards socially sophisticated BDI agents , 2000, Proceedings Fourth International Conference on MultiAgent Systems.

[171]  John Fox,et al.  The Knowledge Engineering Review , 1984, The Knowledge Engineering Review.

[172]  M. M. De Weerdt,et al.  Plan Merging in Multi-Agent Systems , 2003 .

[173]  Frank Dignum,et al.  Contextual Taxonomies , 2004, CLIMA.

[174]  Henry Prakken,et al.  Modelling Defeasibility in Law: Logic or Procedure? , 2001, Fundam. Informaticae.

[175]  M. W. van Someren Learning as problem solving , 2001 .

[176]  Sten Jönsson Institutions and Organizations , 1997 .

[177]  S. C. Kabel,et al.  Knowledge-rich indexing of learning objects , 2004 .

[178]  Nirvana Meratnia,et al.  Towards database support for moving object data , 2005 .

[179]  Javier Vázquez-Salceda,et al.  Norms in multiagent systems: from theory to practice , 2005, Comput. Syst. Sci. Eng..

[180]  W. van der Hoek,et al.  Epistemic logic for AI and computer science , 1995, Cambridge tracts in theoretical computer science.

[181]  Diego Gambetta Can We Trust Trust , 2000 .

[182]  Henry Prakken,et al.  An argumentation framework in default logic , 1993, Annals of Mathematics and Artificial Intelligence.

[183]  E. G. Boltjes,et al.  Voorbeeldig onderwijs : voorbeeldgestuurd onderwijs, een opstap naar abstract denken, vooral voor meisjes , 2004 .

[184]  N. Peek Decision-theoretic planning of clinical patient management , 2000 .

[185]  Brahim Chaib-draa,et al.  Modelling Flexible Social Commitments and Their Enforcement , 2004, ESAW.

[186]  Pablo Noriega,et al.  Agent-mediated auctions: the fishmarket metaphor , 1997 .

[187]  John L. Pollock,et al.  Defeasible Reasoning , 2020, Synthese Library.

[188]  Jaap Hage,et al.  Dialectical models in artificial intelligence and law , 2000, Artificial Intelligence and Law.

[189]  David Spelt,et al.  Verification Support for Object Database Design , 1999 .

[190]  Frank Dignum,et al.  Meeting the Deadline: Why, When and How , 2004, FAABS.

[191]  F. Verdenius,et al.  Methodological aspects of designing induction -based applications , 2005 .

[192]  Ans A. G. Steuten A contribution to the linguistic analysis of business conversations within the language/action perspective , 1998 .

[193]  E.F.Y.L. Ogston,et al.  Agent Based Matchmaking and Clustering: A Decentralized Approach to Search , 2005 .

[194]  Julian Padget,et al.  Integrating the Organ and Tissue Allocation Processes through an Agent-Mediated Electronic Institution , 2002, CCIA.

[195]  Johan van den Akker,et al.  DEGAS: an active, temporal database of autonomous objects , 1998 .

[196]  Koen V. Hindriks,et al.  Agent programming languages: programming with mental models , 2001 .

[197]  C.M.T. Metselaar,et al.  Sociaal-organisatorische gevolgen van kennistechnologie : een procesbenadering en actorperspectief , 2000 .

[198]  L. H. Christoph The role of metacognitive skills in learning to solve problems , 2006 .

[199]  Simon Keizer,et al.  Reasoning under Uncertainty in Natural Language Dialogue using Bayesian Networks , 2003 .

[200]  Lai Xu Monitoring multi-party contracts for E-business , 2004 .

[201]  C. Sierra,et al.  Verifying Norm Consistency in Electronic Institutions , 2004 .

[202]  Andrew J. I. Jones Towards a formal theory of defeasible deontic conditionals , 2005, Annals of Mathematics and Artificial Intelligence.

[203]  Nicholas R. Jennings,et al.  Controlling Cooperative Problem Solving in Industrial Multi-Agent Systems Using Joint Intentions , 1995, Artif. Intell..

[204]  Andrea Omicini,et al.  Coordination artifacts: environment-based coordination for intelligent agents , 2004, Proceedings of the Third International Joint Conference on Autonomous Agents and Multiagent Systems, 2004. AAMAS 2004..

[205]  Jurriaan van Diggelen,et al.  Achieving semantic interoperability in multi-agent systems: A dialogue-based approach , 2007 .

[206]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[207]  Jacco van Ossenbruggen,et al.  Processing structured hypermedia - a matter of style , 2001, SIKS dissertation series.

[208]  Frank Dignum,et al.  Ubi Lex, Ibi Poena : Designing Norm Enforcement in E-Institutions , 2006, COIN@AAMAS/ECAI.

[209]  Leon van der Torre Violated Obligations in a Defeasible Deontic Logic , 1994, ECAI.

[210]  Frank Dignum,et al.  Designing a Deontic Logic of Deadlines , 2004, DEON.

[211]  Moshe Tennenholtz,et al.  Artificial Social Systems , 1992, Lecture Notes in Computer Science.

[212]  Moshe Y. Vardi An Automata-Theoretic Approach to Linear Temporal Logic , 1996, Banff Higher Order Workshop.