Exact finite-state machine identification from scenarios and temporal properties

Finite-state models, such as finite-state machines (FSMs), aid software engineering in many ways. They are often used in formal verification and also can serve as visual software models. The latter application is associated with the problems of software synthesis and automatic derivation of software models from specification. Smaller synthesized models are more general and are easier to comprehend, yet the problem of minimum FSM identification has received little attention in previous research. This paper presents four exact methods to tackle the problem of minimum FSM identification from a set of test scenarios and a temporal specification represented in linear temporal logic. The methods are implemented as an open-source tool. Three of them are based on translations of the FSM identification problem to SAT or QSAT problem instances. Accounting for temporal properties is done via counterexample prohibition. Counterexamples are either obtained from previously identified FSMs, or based on bounded model checking. The fourth method uses backtracking. The proposed methods are evaluated on several case studies and on a larger number of randomly generated instances of increasing complexity. The results show that the Iterative SAT-based method is the leader among the proposed methods. The methods are also compared with existing inexact approaches, i.e., the ones which do not necessarily identify the minimum FSM, and these comparisons show encouraging results.

[1]  Bernd Finkbeiner,et al.  Lazy Synthesis , 2012, VMCAI.

[2]  Roderick Bloem,et al.  Optimizations for LTL Synthesis , 2006, 2006 Formal Methods in Computer Aided Design.

[3]  Chung-Hao Huang,et al.  G4LTL-ST: Automatic Generation of PLC Programs , 2014, CAV.

[4]  Manuel López-Ibáñez,et al.  Ant colony optimization , 2010, GECCO '10.

[5]  Armin Biere Yet another Local Search Solver and Lingeling and Friends Entering the SAT Competition 2014 , 2014 .

[6]  Rüdiger Ehlers,et al.  Unbeast: Symbolic Bounded Synthesis , 2011, TACAS.

[7]  Neil Walkinshaw,et al.  Inferring Finite-State Models with Temporal Constraints , 2008, 2008 23rd IEEE/ACM International Conference on Automated Software Engineering.

[8]  Bernd Finkbeiner,et al.  Bounded synthesis , 2012, International Journal on Software Tools for Technology Transfer.

[9]  Paul B. Jackson,et al.  A Compact Linear Translation for Bounded Model Checking , 2007, Electron. Notes Theor. Comput. Sci..

[10]  Robert P. Kurshan,et al.  An Analysis of SAT-Based Model Checking Techniques in an Industrial Environment , 2005, CHARME.

[11]  Prabhas Chongstitvatana,et al.  Improving correctness of finite-state machine synthesis from multiple partial input/output sequences , 1999, Proceedings of the First NASA/DoD Workshop on Evolvable Hardware.

[12]  Vladimir Ulyantsev,et al.  BFS-Based Symmetry Breaking Predicates for DFA Identification , 2015, LATA.

[13]  David Lo,et al.  Automatic steering of behavioral model inference , 2009, ESEC/SIGSOFT FSE.

[14]  Armin Biere,et al.  Enhancing Search-Based QBF Solving by Dynamic Blocked Clause Elimination , 2015, LPAR.

[15]  Fedor Tsarev,et al.  Finite state machine induction using genetic algorithm based on testing and model checking , 2011, GECCO '11.

[16]  Barak A. Pearlmutter,et al.  Results of the Abbadingo One DFA Learning Competition and a New Evidence-Driven State Merging Algorithm , 1998, ICGI.

[17]  Armin Biere,et al.  Bounded model checking , 2003, Adv. Comput..

[18]  Valeriy Vyatkin IEC 61499 Function Blocks for Embedded and Distributed Control Systems Design , 2007 .

[19]  Alexandre Duret-Lutz Manipulating LTL Formulas Using Spot 1.0 , 2013, ATVA.

[20]  Dorothea Heiss-Czedik,et al.  An Introduction to Genetic Algorithms. , 1997, Artificial Life.

[21]  Rüdiger Ehlers,et al.  Symbolic bounded synthesis , 2010, Formal Methods Syst. Des..

[22]  Marijn J. H. Heule,et al.  Software model synthesis using satisfiability solvers , 2012, Empirical Software Engineering.

[23]  Anna Philippou,et al.  Tools and Algorithms for the Construction and Analysis of Systems , 2018, Lecture Notes in Computer Science.

[24]  Fred Kröger,et al.  Temporal Logic of Programs , 1987, EATCS Monographs on Theoretical Computer Science.

[25]  Gerhard Goos,et al.  Automated Technology for Verification and Analysis , 2004, Lecture Notes in Computer Science.

[26]  Jean-François Raskin,et al.  An Antichain Algorithm for LTL Realizability , 2009, CAV.

[27]  E. Mark Gold,et al.  Complexity of Automaton Identification from Given Data , 1978, Inf. Control..

[28]  Yuriy Brun,et al.  Leveraging existing instrumentation to automatically infer invariant-constrained models , 2011, ESEC/FSE '11.

[29]  Marijn J. H. Heule,et al.  Exact DFA Identification Using SAT Solvers , 2010, ICGI.

[30]  Daniil Chivilikhin,et al.  MuACOsm: a new mutation-based ant colony optimization algorithm for learning finite-state machines , 2013, GECCO '13.

[31]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[32]  Manfred Broy,et al.  Model-Based Testing of Reactive Systems, Advanced Lectures , 2005 .

[33]  Rastislav Bodík,et al.  Algorithmic program synthesis: introduction , 2013, International Journal on Software Tools for Technology Transfer.

[34]  Rajeev Alur,et al.  Synthesizing Finite-State Protocols from Scenarios and Requirements , 2014, Haifa Verification Conference.

[35]  Daniil Chivilikhin,et al.  Combining Exact and Metaheuristic Techniques for Learning Extended Finite-State Machines from Test Scenarios and Temporal Properties , 2014, 2014 13th International Conference on Machine Learning and Applications.

[36]  Tiziana Margaria,et al.  Tools and algorithms for the construction and analysis of systems: a special issue for TACAS 2017 , 2001, International Journal on Software Tools for Technology Transfer.

[37]  John Derrick,et al.  Inferring extended finite state machine models from software executions , 2013, 2013 20th Working Conference on Reverse Engineering (WCRE).

[38]  Niklas Sörensson,et al.  Temporal induction by incremental SAT solving , 2003, BMC@CAV.

[39]  Vladimir Ulyantsev,et al.  Extended Finite-State Machine Induction Using SAT-Solver , 2011, 2011 10th International Conference on Machine Learning and Applications and Workshops.

[40]  Stephan Merz,et al.  Model Checking , 2000 .

[41]  Yuriy Brun,et al.  Behavioral resource-aware model inference , 2014, ASE.