MC2MABS: A Monte Carlo Model Checker for Multiagent-Based Simulations

Agent-based simulation has shown great success for the study of complex adaptive systems and could in many areas show advantages over traditional analytical methods. Due to their internal complexity, however, agent-based simulations are notoriously difficult to verify and validate. This paper presents $$ \texttt {MC} ^ \texttt {2} \texttt {MABS} $$MC2MABS, a Monte Carlo Model Checker for Multiagent-Based Simulations. It incorporates the idea of statistical runtime verification, a combination of statistical model checking and runtime verification, and is tailored to the approximate verification of complex agent-based simulations. We provide a description of the underlying theory together with design decisions, an architectural overview, and implementation details. The performance of $$ \texttt {MC} ^ \texttt {2} \texttt {MABS} $$MC2MABS in terms of both runtime consumption and memory allocation is evaluated against a set of example properties.

[1]  Andrew B. Kahng,et al.  Cooperative Mobile Robotics: Antecedents and Directions , 1997, Auton. Robots.

[2]  Gnana Bharathy,et al.  Validating agent based social systems models , 2010, Proceedings of the 2010 Winter Simulation Conference.

[3]  Faculty of Computing, Engineering and Mathematical Sciences, , 2022 .

[4]  Alessio Lomuscio,et al.  Parallel Model Checking for Temporal Epistemic Logic , 2010, ECAI.

[5]  Nick Collier,et al.  Repast: An extensible framework for agent simulation , 2001 .

[6]  Jamal Bentahar,et al.  Model Checking Epistemic and Probabilistic Properties of Multi-agent Systems , 2011, IEA/AIE.

[7]  Michael Luck,et al.  Quantitative Analysis of Multiagent Systems Through Statistical Model Checking , 2015, EMAS@AAMAS.

[8]  Michael Wooldridge,et al.  Uncertain Agent Verification through Probabilistic Model-Checking , 2009, Safety and Security in Multiagent Systems.

[9]  Michael J. North,et al.  Tutorial on agent-based modelling and simulation , 2005, Proceedings of the Winter Simulation Conference, 2005..

[10]  Christel Baier,et al.  Principles of Model Checking (Representation and Mind Series) , 2008 .

[11]  Sjur K. Dyrkolbotn,et al.  Agents Homogeneous: A Procedurally Anonymous Semantics Characterizing the Homogeneous Fragment of ATL , 2013, PRIMA.

[12]  Wojciech Penczek,et al.  Partial Order Reductions for Model Checking Temporal-epistemic Logics over Interleaved Multi-agent Systems , 2010, Fundam. Informaticae.

[13]  Tom De Wolf,et al.  Development of Self-organising Emergent Applications with Simulation-Based Numerical Analysis , 2005, Engineering Self-Organising Systems.

[14]  Wojciech Penczek,et al.  Partial order reductions for model checking temporal epistemic logics over interleaved multi-agent systems , 2010, AAMAS.

[15]  Christel Baier,et al.  Principles of model checking , 2008 .

[16]  Phil McMinn,et al.  Towards the Automatic Identification of Faulty Multi-Agent Based Simulation Runs Using MASTER , 2012, MABS.

[17]  Wojciech Penczek,et al.  Bounded model checking for knowledge and real time , 2005, AAMAS '05.

[18]  Mario Kolberg,et al.  University of Stirling , 2018, The Grants Register 2019.

[19]  Gregory R. Madey,et al.  Agent-based simulation of cooperative hunting with UAVs , 2013, SpringSim.

[20]  Clare Dixon,et al.  Analysing robot swarm behaviour via probabilistic model checking , 2012, Robotics Auton. Syst..

[21]  Martin Leucker,et al.  A brief account of runtime verification , 2009, J. Log. Algebraic Methods Program..

[22]  Oguz Dikenelli,et al.  RatKit: Repeatable Automated Testing Toolkit for Agent-Based Modeling and Simulation , 2014, MABS.

[23]  Benjamin Herd,et al.  Statistical runtime verification of agent-based simulations , 2015 .

[24]  Alexandre Ja. Dikovsky,et al.  Temporal Verification of Probabilistic Multi-Agent Systems , 2008, Pillars of Computer Science.

[25]  Matthias Meyer,et al.  Opening the ‘black box’ of simulations: increased transparency and effective communication through the systematic design of experiments , 2011, Computational and Mathematical Organization Theory.

[26]  Stefano Sebastio,et al.  MultiVeStA: statistical model checking for discrete event simulators , 2013, VALUETOOLS.

[27]  Axel Legay,et al.  Statistical Model Checking: An Overview , 2010, RV.

[28]  Stamatis Karnouskos,et al.  Simulation of a Smart Grid City with Software Agents , 2009, 2009 Third UKSim European Symposium on Computer Modeling and Simulation.

[29]  Denis Phan,et al.  Agent-Based Models and Simulations in Economics and Social Sciences: From Conceptual Exploration to Distinct Ways of Experimenting , 2010, J. Artif. Soc. Soc. Simul..

[30]  Wojciech Penczek,et al.  Specification and Verification of Multi-Agent Systems , 2010, ESSLLI.

[31]  Jack P. C. Kleijnen,et al.  EUROPEAN JOURNAL OF OPERATIONAL , 1992 .

[32]  Tibor Bosse,et al.  Comparing Modelling Approaches in Aviation Safety , 2013 .

[33]  Clare Dixon,et al.  Formal Verification of Probabilistic Swarm Behaviours , 2010, ANTS Conference.

[34]  Jie Chen,et al.  Strategies for Energy Optimisation in a Swarm of Foraging Robots , 2006, Swarm Robotics.

[35]  Thomas Hérault,et al.  Approximate Probabilistic Model Checking , 2004, VMCAI.

[36]  Robert E. Marks,et al.  Validating Simulation Models: A General Framework and Four Applied Examples , 2007 .