Generating Hard Benchmark Problems for Weak Bisimulation

In this paper, we propose a method to automatically generate arbitrarily complex benchmark problems for bisimulation checking. Technically, this method is a variant of an incremental generation approach for model checking benchmarks where given benchmark scenarios of controllable size are expanded to arbitrarily complex benchmark problems. This expansion concerns both the number of parallel components and the component sizes. Whereas our property-preserving parallel decomposition is maintained in this variant, the alphabet extension is flexibilized as, in contrast to temporal logics, weak bisimulation is not sensitive to liveness properties.

[1]  Kim G. Larsen,et al.  Moving from Specifications to Contracts in Component-Based Design , 2012, FASE.

[2]  Helmut Veith,et al.  Progress on the State Explosion Problem in Model Checking , 2001, Informatics.

[3]  Radu Grosu,et al.  Monte Carlo Model Checking , 2005, TACAS.

[4]  Dirk Beyer,et al.  Rigorous examination of reactive systems , 2014, International Journal on Software Tools for Technology Transfer.

[5]  Bernhard Steffen,et al.  Synthesizing Subtle Bugs with Known Witnesses , 2018, ISoLA.

[6]  Fabrice Kordon,et al.  Report on the Model Checking Contest at Petri Nets 2011 , 2012, Trans. Petri Nets Other Model. Concurr..

[7]  Eyke Hüllermeier,et al.  Predicting rankings of software verification tools , 2017, SWAN@ESEC/SIGSOFT FSE.

[8]  Amir Pnueli,et al.  On the synthesis of a reactive module , 1989, POPL '89.

[9]  Dirk Beyer,et al.  Competition on Software Verification - (SV-COMP) , 2012, TACAS.

[10]  Bernhard Steffen,et al.  Compositional Minimization of Finite State Systems , 1990, CAV.

[11]  David Park,et al.  Concurrency and Automata on Infinite Sequences , 1981, Theoretical Computer Science.

[12]  Scott A. Smolka,et al.  CCS expressions, finite state processes, and three problems of equivalence , 1983, PODC '83.

[13]  Antti Valmari,et al.  The State Explosion Problem , 1996, Petri Nets.

[14]  Frits W. Vaandrager,et al.  RERS 2019: Combining Synthesis with Real-World Models , 2019, TACAS.

[15]  Bernhard Steffen,et al.  Property-Preserving Generation of Tailored Benchmark Petri Nets , 2017, 2017 17th International Conference on Application of Concurrency to System Design (ACSD).

[16]  Rance Cleaveland,et al.  The concurrency workbench: a semantics-based tool for the verification of concurrent systems , 1993, TOPL.

[17]  Bernhard Steffen,et al.  Compositional minimisation of finite state systems using interface specifications , 1996, Formal Aspects of Computing.

[18]  Bernhard Steffen,et al.  Property-Preserving Parallel Decomposition , 2017, Models, Algorithms, Logics and Tools.

[19]  Bernhard Steffen,et al.  Introduction to Active Automata Learning from a Practical Perspective , 2011, SFM.

[20]  Patrice Godefroid,et al.  Partial-Order Methods for the Verification of Concurrent Systems , 1996, Lecture Notes in Computer Science.

[21]  Bernhard Steffen,et al.  RERS 2018: CTL, LTL, and Reachability , 2018, ISoLA.

[22]  Edmund M. Clarke,et al.  Counterexample-Guided Abstraction Refinement , 2000, CAV.

[23]  Erik P. de Vink,et al.  The mCRL2 Toolset for Analysing Concurrent Systems - Improvements in Expressivity and Usability , 2019, TACAS.

[24]  Ezio Bartocci,et al.  First international Competition on Runtime Verification: rules, benchmarks, tools, and final results of CRV 2014 , 2017, International Journal on Software Tools for Technology Transfer.

[25]  Kim G. Larsen,et al.  The Use of Static Constructs in A Modal Process Logic , 1989, Logic at Botik.

[26]  Kim G. Larsen,et al.  Modal Specifications , 1989, Automatic Verification Methods for Finite State Systems.

[27]  Bernhard Steffen,et al.  RERS 2016: Parallel and Sequential Benchmarks with Focus on LTL Verification , 2016, ISoLA.

[28]  Benoît Caillaud,et al.  Synchronous Interfaces and Assume/Guarantee Contracts , 2017, Models, Algorithms, Logics and Tools.

[29]  Bernhard Steffen,et al.  Reactive, Generative and Stratified Models of Probabilistic Processes , 1995, Inf. Comput..

[30]  Radu Mateescu,et al.  CADP 2011: a toolbox for the construction and analysis of distributed processes , 2012, International Journal on Software Tools for Technology Transfer.

[31]  Vladimir Klebanov,et al.  VerifyThis 2012 , 2015, International Journal on Software Tools for Technology Transfer.

[32]  Orna Grumberg,et al.  Model checking and modular verification , 1994, TOPL.

[33]  C. A. R. Hoare,et al.  Communicating Sequential Processes (Reprint) , 1983, Commun. ACM.

[34]  Axel Legay,et al.  Statistical Model Checking: An Overview , 2010, RV.

[35]  Tiziana Margaria,et al.  Simplicity as a Driver for Agile Innovation , 2010, Computer.

[36]  Axel Legay,et al.  A Modal Interface Theory for Component-based Design , 2011, Fundam. Informaticae.

[37]  Tiziana Margaria,et al.  Property-driven benchmark generation: synthesizing programs of realistic structure , 2014, International Journal on Software Tools for Technology Transfer.

[38]  Rance Cleaveland,et al.  A Preorder for Partial Process Specifications , 1990, CONCUR.