Reconstructing timed symbolic traces from rtioco-based timed test sequences using backward-induction

As of today, model-based testing is considered as a leading-edge technology in the IT industry. In model-based testing, an implementation under test is tested for compliance with a model that describes the required behaviour of the implementation. Uppaal Tron is a popular tool for online model-based conformance testing of real-time systems; it uses the Uppaal verification engine to generate and convert on-the-fly timed symbolic traces into concrete test sequences. Among the advantages of online testing is the reduction of the symbolic state space needed for computing traces, better addressing non-determinism, as well as the possibility to execute longer-lasting test runs. However, analysing and debugging long test runs can be tedious and time-consuming especially when analysing root causes of failed tests. In game theory, backward-induction is a process to reason backwards in time, from the end of a problem or situation, in order to determine a sequence of optimal actions. In this paper, we propose an approach to reconstruct symbolic traces from test sequences generated by Uppaal Tron using backward-induction. The resulting symbolic traces can be imported in the Uppaal tool and visualised in the Uppaal simulator. The evaluation of the implementation of the approach shows that it has the potential to satisfy the needs of industrial level testing.

[1]  Kim G. Larsen,et al.  A Tutorial on Uppaal , 2004, SFM.

[2]  Jiangtao Li,et al.  Every random choice rule is backwards-induction rationalizable , 2017, Games Econ. Behav..

[3]  Bruno Legeard,et al.  A taxonomy of model‐based testing approaches , 2012, Softw. Test. Verification Reliab..

[4]  Miguel Felder,et al.  Testing Timing Behavior of Real-Time Software , 1997 .

[5]  Kim G. Larsen,et al.  Efficient On-the-Fly Algorithms for the Analysis of Timed Games , 2005, CONCUR.

[6]  Kim G. Larsen,et al.  Time-Optimal Real-Time Test Case Generation Using Uppaal , 2003, FATES.

[7]  Brian Nielsen.  Specification and Test of Real-Time Systems , 2000 .

[8]  Rachel Cardell-Oliver,et al.  A Practical and Complete Algorithm for Testing Real-Time Systems , 1998, FTRTFT.

[9]  Nicolae Goga,et al.  Formal Test Automation: A Simple Experiment , 1999, IWTCS.

[10]  E. Rowland.  Theory of Games and Economic Behavior , 1946, Nature.

[11]  Thierry Jéron.  Symbolic Model-based Test Selection , 2009, Electron. Notes Theor. Comput. Sci..

[12]  Thierry Jéron,et al.  Using On-The-Fly Verification Techniques for the Generation of test Suites , 1996, CAV.

[13]  Paula Herber,et al.  Automated conformance evaluation of SystemC designs using timed automata , 2010, 2010 15th IEEE European Test Symposium.

[14]  Kim G. Larsen,et al.  UPPAAL-Tiga: Time for Playing Games! , 2007, CAV.

[15]  Duncan Clarke,et al.  Automatic test generation for the analysis of a real-time system: Case study , 1997, Proceedings Third IEEE Real-Time Technology and Applications Symposium.

[16]  K. Larsen,et al.  Online Testing of Real-time Systems Using Uppaal , 2004, FATES.

[17]  Paula Herber.  Automated HW/SW Co-Verification of SystemC Designs Using Timed Automata , 2012, it Inf. Technol..

[18]  Wang Yi,et al.  Timed Automata: Semantics, Algorithms and Tools , 2003, Lectures on Concurrency and Petri Nets.

[19]  Johan Bengtsson,et al.  Clocks, DBMS and States in Timed Systems , 2002 .

[20]  Walter Bossert,et al.  Every Choice Function is Backwards-Induction Rationalizable , 2013 .

[21]  Danny Bøgsted Poulsen,et al.  Concrete Delays for Symbolic Traces , 2010 .

[22]  Kim G. Larsen,et al.  Testing Real-Time Systems Using UPPAAL , 2008, Formal Methods and Testing.

[23]  Dragos Truscan,et al.  A Practical Application of UPPAAL and DTRON for Runtime Verification , 2015, 2015 IEEE/ACM 2nd International Workshop on Software Engineering Research and Industrial Practice.

[24]  Thomas A. Henzinger,et al.  Hybrid systems III : verification and control , 1996 .

[25]  Ed Brinksma,et al.  A Test Generation Framework for quiescent Real-Time Systems , 2004, FATES.

[26]  Wang Yi,et al.  UPPAAL - a Tool Suite for Automatic Verification of Real-Time Systems , 1996, Hybrid Systems.