Approximate verification of strategic abilities under imperfect information

Abstract Model checking of strategic ability under imperfect information is known to be hard. The complexity results range from NP-completeness to undecidability, depending on the precise setup of the problem. No less importantly, the usual fixpoint equivalences do not hold for imperfect information strategies, which seriously hampers incremental synthesis of winning strategies. In this paper, we propose translations of AT L ir formulae that provide lower and upper bounds for their truth values, and are cheaper to verify than the original specifications. Most interestingly, the lower approximation is provided by a fixpoint expression that uses a nonstandard variant of the next-step ability operator. We show the correctness of the translations, establish their computational complexity, and validate the approach by experiments with several benchmarks, including a scalable scenario of Bridge play. We also demonstrate that the approximations leave much room for optimizations; in particular, optimizing the data structures can produce a significant speedup. Finally, we show that our fixpoint approximations of AT L ir formulae can be combined with under- and overapproximations of models in the vein of may/must abstractions, providing very promising experimental results.

[1]  Ron van der Meyden,et al.  MCK: Model Checking the Logic of Knowledge , 2004, CAV.

[2]  Antonio Fernández-Caballero,et al.  On the use of agent technology in intelligent, multisensory and distributed surveillance , 2011, Knowl. Eng. Rev..

[3]  Wojciech Jamroga,et al.  Synthesis and Verification of Uniform Strategies for Multi-agent Systems , 2014, CLIMA.

[4]  W. Jamroga Some Remarks on Alternating Temporal Epistemic Logic , 2003 .

[5]  Edmund M. Clarke,et al.  Model checking and abstraction , 1994, TOPL.

[6]  W. Jamroga,et al.  Modular Interpreted Systems : A Preliminary Report , 2006 .

[7]  Robert C. Moore Reasoning About Knowledge and Action , 1977, IJCAI.

[8]  David Z. Zhang,et al.  Agent-based hierarchical production planning and scheduling in make-to-order manufacturing system , 2014 .

[9]  Alessio Lomuscio,et al.  MCMAS: an open-source model checker for the verification of multi-agent systems , 2017, International Journal on Software Tools for Technology Transfer.

[10]  Thomas A. Henzinger,et al.  jMocha: a model checking tool that exploits design structure , 2001, Proceedings of the 23rd International Conference on Software Engineering. ICSE 2001.

[11]  Damian Kurpiewski,et al.  Fixpoint Approximation of Strategic Abilities under Imperfect Information , 2017, AAMAS.

[12]  Wojciech Jamroga,et al.  Alternating Epistemic Mu-Calculus , 2011, IJCAI.

[13]  Patrick Cousot,et al.  Abstract interpretation: a unified lattice model for static analysis of programs by construction or approximation of fixpoints , 1977, POPL.

[14]  Lukasz Kaiser,et al.  Information Tracking in Games on Graphs , 2010, J. Log. Lang. Inf..

[15]  Charles Pecheur,et al.  Reasoning about memoryless strategies under partial observability and unconditional fairness constraints , 2015, Inf. Comput..

[16]  Alessio Lomuscio,et al.  Verification of Multi-Agent Systems via Predicate Abstraction against ATLK Specifications , 2016, AAMAS.

[17]  Charles Pecheur,et al.  Improving the Model Checking of Strategies under Partial Observability and Fairness Constraints , 2014, ICFEM.

[18]  J. Dix,et al.  Model Checking Logics of Strategic Ability: Complexity* , 2010 .

[19]  Pierre-Yves Schobbens,et al.  Alternating-time logic with imperfect recall , 2004, LCMAS.

[20]  G. Ryle,et al.  The concept of mind. , 2004, The International journal of psycho-analysis.

[21]  Michael J. Fischer,et al.  An improved equivalence algorithm , 1964, CACM.

[22]  Alessio Lomuscio,et al.  Verification of Multi-agent Systems with Imperfect Information and Public Actions , 2017, AAMAS.

[23]  Dietmar Berwanger,et al.  Hierarchical Information Patterns and Distributed Strategy Synthesis , 2015, ATVA.

[24]  Catalin Dima,et al.  Epistemic ATL with Perfect Recall, Past and Strategy Contexts , 2012, CLIMA.

[25]  Xiaowei Huang,et al.  Symbolic Model Checking Epistemic Strategy Logic , 2014, AAAI.

[26]  Robert C. Moore A Formal Theory of Knowledge and Action , 1984 .

[27]  Jörg P. Müller,et al.  Application Impact of Multi-agent Systems and Technologies: A Survey , 2014, Agent-Oriented Software Engineering.

[28]  Constantin Enea,et al.  An alternating-time temporal logic with knowledge, perfect recall and past: axiomatisation and model-checking , 2011, J. Appl. Non Class. Logics.

[29]  Ioan Alfred Letia,et al.  Assuring safety in air traffic control systems with argumentation and model checking , 2016, Expert Syst. Appl..

[30]  Michael Wooldridge,et al.  Model checking agentspeak , 2003, AAMAS '03.

[31]  Vincenzo Iovino,et al.  Selene: Voting with Transparent Verifiability and Coercion-Mitigation , 2016, Financial Cryptography Workshops.

[32]  Alessio Lomuscio,et al.  MCMAS: A Model Checker for Multi-agent Systems , 2006, TACAS.

[33]  John H. Reif,et al.  Multiple-person alternation , 1979, 20th Annual Symposium on Foundations of Computer Science (sfcs 1979).

[34]  Jean-François Raskin,et al.  Games with imperfect information: theory and algorithms , 2011, Lectures in Game Theory for Computer Scientists.

[35]  Munindar P. Singh Cybersecurity as an Application Domain for Multiagent Systems , 2015, AAMAS.

[36]  Wojciech Penczek,et al.  Towards Partial Order Reductions for Strategic Ability , 2018, AAMAS.

[37]  Damian Kurpiewski,et al.  Model Checking the SELENE E-Voting Protocol in Multi-agent Logics , 2018, E-Vote-ID.

[38]  Thomas A. Henzinger,et al.  MOCHA: Modularity in Model Checking , 1998, CAV.

[39]  Alessio Lomuscio,et al.  Model checking knowledge, strategies, and games in multi-agent systems , 2006, AAMAS '06.

[40]  John McCarthy,et al.  SOME PHILOSOPHICAL PROBLEMS FROM THE STANDPOINT OF ARTI CIAL INTELLIGENCE , 1987 .

[41]  Ron van der Meyden Optimizing Epistemic Model Checking using Conditional Independence , 2016, ArXiv.

[42]  Orna Kupferman,et al.  An Abstraction-Refinement Framework for Multi-Agent Systems , 2006, 21st Annual IEEE Symposium on Logic in Computer Science (LICS'06).

[43]  Wojciech Jamroga,et al.  Knowledge and Ability , 2015 .

[44]  Constantin Enea,et al.  Model-Checking an Alternating-time Temporal Logic with Knowledge, Imperfect Information, Perfect Recall and Communicating Coalitions , 2010, GANDALF.

[45]  Stefan Edelkamp,et al.  Cyber-Physical Multiagent-Simulation in Production Logistics , 2015, MATES.

[46]  Sophie Pinchinat,et al.  Relating Paths in Transition Systems: the Fall of the Modal mu-Calculus , 2015, ICTCS.

[47]  Alessio Lomuscio,et al.  MCMAS: A Model Checker for the Verification of Multi-Agent Systems , 2009, CAV.

[48]  Saburo Muroga,et al.  Binary Decision Diagrams , 2000, The VLSI Handbook.

[49]  Thomas Ågotnes,et al.  A Note On Syntactic Characterization of Incomplete Information in ATEL , 2004 .

[50]  Ferucio Laurentiu Tiplea,et al.  Model-checking ATL under Imperfect Information and Perfect Recall Semantics is Undecidable , 2011, ArXiv.

[51]  Simon Busard Symbolic model checking of multi-modal logics: uniform strategies and rich explanations , 2017 .

[52]  Franco Raimondi,et al.  Model checking multi-agent systems , 2006 .

[53]  Radha Jagadeesan,et al.  Automatic Abstraction Using Generalized Model Checking , 2002, CAV.

[54]  Sophie Pinchinat,et al.  The Expressive Power of Epistemic $μ$-Calculus , 2014, ArXiv.

[55]  Michael Wooldridge,et al.  Tractable multiagent planning for epistemic goals , 2002, AAMAS '02.

[56]  Patrice Godefroid,et al.  Model Checking Partial State Spaces with 3-Valued Temporal Logics , 1999, CAV.

[57]  Alessio Lomuscio,et al.  Agent-based Abstractions for Verifying Alternating-time Temporal Logic with Imperfect Information , 2017, AAMAS.

[58]  Michael Wooldridge,et al.  On the complexity of practical ATL model checking , 2006, AAMAS '06.

[59]  Nuel D. Belnap,et al.  Seeing To it That: A Canonical Form for Agentives , 2008 .

[60]  Wojciech Jamroga,et al.  Agents that Know How to Play , 2004, Fundam. Informaticae.

[61]  Thomas A. Henzinger,et al.  Alternating-time temporal logic , 1997, Proceedings 38th Annual Symposium on Foundations of Computer Science.

[62]  Edmund M. Clarke,et al.  Symbolic Model Checking: 10^20 States and Beyond , 1990, Inf. Comput..

[63]  Wojciech Jamroga,et al.  SMC: synthesis of uniform strategies and verification of strategic ability for multi-agent systems , 2017, J. Log. Comput..

[64]  Wojciech Jamroga,et al.  Comparing variants of strategic ability: how uncertainty and memory influence general properties of games , 2014, Autonomous Agents and Multi-Agent Systems.

[65]  Kagan Tumer,et al.  Autonomous Multiagent Space Exploration with High-Level Human Feedback , 2016, J. Aerosp. Inf. Syst..