Automated generation of test suites from formal specifications of real-time reactive systems

Real-time reactive systems are among the most difficult systems to test because of their size and complex time-dependent functionality. The number of test experiments for such systems is very large, if not infinite. Often such systems arise in safety-critical contexts. Hence, such systems require a rigorous analysis and thorough testing before they are deployed. This paper addresses test case generation methods and a metric-based test case selection algorithm for sufficient testing of real-time reactive systems. The methods are rigorous, and based on the formal specifications of the system and its fault models. The test generation and execution of algorithms are implemented in TROMLAB, a formal framework for developing real-time reactive systems. The methods are applied to the formal specification of the Train-Gate-Controller (TGC) example, a bench-mark case study in the real-time systems community. A brief description of the experimental results obtained on the case study is given.

[1]  Amir Pnueli,et al.  On the Development of Reactive Systems , 1989, Logics and Models of Concurrent Systems.

[2]  Alexandre Petrenko,et al.  Test Generation for Specifications Modeled by Input/Output Automata , 1998, IWTCS.

[3]  Thierry Jéron,et al.  Automatic Verification and Conformance Testing for Validating Safety Properties of Reactive Systems , 2005, FM.

[4]  Vangalur S. Alagar,et al.  Incremental testing for self-evolving timed systems , 2003, Third International Conference on Quality Software, 2003. Proceedings..

[5]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[6]  Mao Zheng,et al.  Automated test generation from formal specifications of real-time reactive systems , 2002 .

[7]  David A. Carrington,et al.  A Framework for Specification-Based Testing , 1996, IEEE Trans. Software Eng..

[8]  Michael R. Donat Automating Formal Specification-Based Testing , 1997, TAPSOFT.

[9]  Michel Bidoit,et al.  TAPSOFT '97: Theory and Practice of Software Development , 1997, Lecture Notes in Computer Science.

[10]  Darmalingum Muthiayen,et al.  Real-time reactive system development: a formal approach based on uml and pvs , 2000 .

[11]  Thomas A. Henzinger,et al.  What Good Are Digital Clocks? , 1992, ICALP.

[12]  Frits W. Vaandrager,et al.  Testing timed automata , 1997, Theor. Comput. Sci..

[13]  Marius Mikucionis,et al.  Online On-the-Fly Testing of Real-time Systems , 2003 .

[14]  Tsong Yueh Chen,et al.  In black and white: an integrated approach to class-level testing of object-oriented programs , 1998, TSEM.

[15]  Dino Mandrioli,et al.  Formal Methods for Real-Time Computing , 1996 .

[16]  Teruo Higashino,et al.  Generating Test Cases for a Timed I/O Automaton Model , 1999, IWTCS.

[17]  Ferhat Khendek,et al.  Timed Wp-Method: Testing Real-Time Systems , 2002, IEEE Trans. Software Eng..

[18]  Olga Ormandjieva,et al.  Deriving new measurements for real-time reactive systems , 2002 .

[19]  Rachel Cardell-Oliver Conformance Tests for Real-Time Systems with Timed Automata Specifications , 2000, Formal Aspects of Computing.