The computational complexity of scenario-based agent verification and design

Abstract We first advocate that the AUML (Agent Unified Modeling Language) notation, even in its new version, is not precise enough to adequately describe protocols. This problem was long identified by Harel and we propose to follow his solution: extend sequence diagrams with a “prechart”, i.e. single out the initiation sequence of the protocol. This new notation keeps readability and intuition, but is also technically adequate and is given a formal semantics. It actually is a form of simple temporal logics, equipped with a game-based semantics, which is appropriate for modeling agent-based systems. We then go on to study its complexity. Unsurprisingly, the version with protocol roles is undecidable. The main interesting problem is to synthesize agents that follow the protocol described. Surprisingly, it is undecidable even if we remove roles, alternatives, loops, asynchronous communication, conditions, constraints, negations (already removed in AUML). The complexity of checking whether a society of agents obeys a protocol given in this trivial notation is also surprisingly high: it is PSPACE-complete, like temporal logic, while we show that this simple language is strongly less expressive than temporal logic. Notations in-between have the expected increase in expressiveness, but no increase in complexity. This justifies the use of a language including alternatives, asynchronous communication and conditions, since it increases expressiveness with no cost in complexity.

[1]  P. Dangerfield Logic , 1996, Aristotle and the Stoics.

[2]  Daniel Amyot,et al.  An Evaluation of Scenario Notations for Telecommunication Systems Development , 2001 .

[3]  Patrick Heymans,et al.  Applying LSCs to the Specification of an Air Traffic Control System , 2003 .

[4]  Wolfgang Thomas,et al.  Automata on Infinite Objects , 1991, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[5]  Wolfgang Thomas,et al.  Languages, Automata, and Logic , 1997, Handbook of Formal Languages.

[6]  F. Dignum,et al.  Agent Mediated Electronic Commerce: The European AgentLink Perspective , 2001 .

[7]  Pierre Wolper,et al.  Automata theoretic techniques for modal logics of programs: (Extended abstract) , 1984, STOC '84.

[8]  S Leue,et al.  Deciding properties of message sequence charts , 2005 .

[9]  David Harel,et al.  Multiple instances and symbolic variables in executable sequence charts , 2002, OOPSLA '02.

[10]  Christos H. Papadimitriou,et al.  Computational complexity , 1993 .

[11]  David Harel,et al.  Come, let's play - scenario-based programming using LSCs and the play-engine , 2003 .

[12]  Michael Rovatsos,et al.  Capturing agent autonomy in roles and XML , 2003, AAMAS '03.

[13]  Stavros Tripakis Undecidable problems of decentralized observation and control on regular languages , 2004, Inf. Process. Lett..

[14]  Hector J. Levesque,et al.  ConGolog, a concurrent programming language based on the situation calculus , 2000, Artif. Intell..

[15]  Ganesh Gopalakrishnan,et al.  VERIFYING A VCI BUS INTERFACE MODEL USING AN LSC-BASED SPECIFICATION , 2002 .

[16]  Pierre Wolper Temporal Logic Can Be More Expressive , 1983, Inf. Control..

[17]  Devika Subramanian,et al.  Provably Bounded Optimal Agents , 1993, IJCAI.

[18]  Daniel Amyot,et al.  An Evaluation of Scenario Notations and Construction Approaches for Telecommunication Systems Development , 2003, Telecommun. Syst..

[19]  Nancy A. Lynch,et al.  An introduction to input/output automata , 1989 .

[20]  Yves Bontemps,et al.  Relating Inter-Agent and Intra-Agent Specifications (The Case of Live Sequence Charts) , 2005 .

[21]  Stephan Merz,et al.  Model Checking , 2000 .

[22]  Amir Pnueli,et al.  On the Synthesis of an Asynchronous Reactive Module , 1989, ICALP.

[23]  Marc Esteva,et al.  On the formal specification of electronic institutions , 2001 .

[24]  Martín Abadi,et al.  Realizable and Unrealizable Specifications of Reactive Systems , 1989, ICALP.

[25]  E. Allen Emerson,et al.  Temporal and Modal Logic , 1991, Handbook of Theoretical Computer Science, Volume B: Formal Models and Sematics.

[26]  A. S. Roa,et al.  AgentSpeak(L): BDI agents speak out in a logical computable language , 1996 .

[27]  Michael Wooldridge,et al.  Complexity Results for Agent Design Problems , 2003 .

[28]  Patrick Brézillon,et al.  Lecture Notes in Artificial Intelligence , 1999 .

[29]  David Harel,et al.  On the Complexity of Verifying Concurrent Transition Systems , 1997, Inf. Comput..

[30]  David Harel,et al.  Synthesizing State-Based Object Systems from LSC Specifications , 2000, Int. J. Found. Comput. Sci..

[31]  Fa A Comprare,et al.  Come , 1890, The Hospital.

[32]  Edmund M. Clarke,et al.  Model Checking , 1999, Handbook of Automated Reasoning.

[33]  Ludwig Staiger,et al.  Ω-languages , 1997 .

[34]  P. S. Thiagarajan,et al.  A Decidable Class of Asynchronous Distributed Controllers , 2002, CONCUR.

[35]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[36]  Gerard J. Holzmann,et al.  The Model Checker SPIN , 1997, IEEE Trans. Software Eng..

[37]  Werner Damm,et al.  Modeling and Validating Train System Applications Using Statemate and Live Sequence Charts , 2002 .

[38]  Koen V. Hindriks,et al.  Agent Programming in 3APL , 1999, Autonomous Agents and Multi-Agent Systems.

[39]  Monika Maidl,et al.  The Common Fragment of CTL and LTL , 2000, FOCS.

[40]  Rajeev Alur,et al.  Modular refinement of hierarchic reactive machines , 2004, TOPL.

[41]  Michael Wooldridge,et al.  The Computational Complexity of Agent Verification , 2001, ATAL.

[42]  David Harel,et al.  From Play-In Scenarios to Code: An Achievable Dream , 2000, Computer.

[43]  Iain A. Stewart,et al.  The complexity of achievement and maintenance problems in agent-based systems , 2003, Artif. Intell..

[44]  Amir Pnueli,et al.  On the synthesis of a reactive module , 1989, POPL '89.

[45]  O. Kupermann,et al.  Synthesizing distributed systems , 2001, Proceedings 16th Annual IEEE Symposium on Logic in Computer Science.

[46]  Yves Bontemps,et al.  Automated Verification of State-based specifications against scenarios (A step toward relating in , 2001 .

[47]  Amir Pnueli,et al.  Formal Modeling of C. elegans Development: A Scenario-Based Approach , 2003, CMSB.

[48]  Anand S. Rao,et al.  AgentSpeak(L): BDI Agents Speak Out in a Logical Computable Language , 1996, MAAMAW.

[49]  Alexander Knapp,et al.  UML 2 . 0 Interactions : Semantics and Refinement , 2004 .

[50]  Michael Wooldridge,et al.  Model checking agentspeak , 2003, AAMAS '03.

[51]  Thomas Wilke,et al.  Automata logics, and infinite games: a guide to current research , 2002 .

[52]  J. R. Büchi,et al.  Solving sequential conditions by finite-state strategies , 1969 .

[53]  Moshe Y. Vardi An Automata-Theoretic Approach to Fair Realizability and Synthesis , 1995, CAV.

[54]  Paul Gastin,et al.  Distributed Games and Distributed Control for Asynchronous Systems , 2004, LATIN.

[55]  Michael Wooldridge,et al.  Model Checking for ACL Compliance Verification , 2003, Workshop on Agent Communication Languages.

[56]  Lin Padgham,et al.  Fipa modeling: Interaction diagrams , 2003 .

[57]  Daniel Kirsten Alternating Tree Automata and Parity Games , 2001, Automata, Logics, and Infinite Games.

[58]  Christopher D. Walton,et al.  Multi-Agent Dialogue Protocols , 2004, AI&M.

[59]  David Harel,et al.  LSCs: Breathing Life into Message Sequence Charts , 1999, Formal Methods Syst. Des..

[60]  M. Maidi The common fragment of CTL and LTL , 2000, Proceedings 41st Annual Symposium on Foundations of Computer Science.

[61]  Michael Wooldridge,et al.  Model checking multi-agent systems with MABLE , 2002, AAMAS '02.

[62]  Y. Bontemps,et al.  As fast as sound lightweight formal scenario synthesis and verification , 2004, ICSE 2004.

[63]  Sebastián Uchitel,et al.  Scenarios and state machines: models, algorithms, and tools , 2002, ICSE '02.

[64]  Walter J. Savitch,et al.  Relationships Between Nondeterministic and Deterministic Tape Complexities , 1970, J. Comput. Syst. Sci..

[65]  Pierre-Yves Schobbens,et al.  Synthesis of open reactive systems from scenario-based specifications , 2003, Third International Conference on Application of Concurrency to System Design, 2003. Proceedings..