Towards an Industrial Strength Process for Timed Testing

Timed model-based testing is a technique which allows for the  specification of timing in the model as well as in the test  cases. As such, it is well suited for the testing of embedded systems,  which usually puts a much higher demand on the amount of test cases  and quality of the test process than other software systems  do. While the theory of timed testing is well established over the  last years, industrial application is still rare. In this paper, we  report on our first step towards a industrial strength process for  timed testing. The paper describes how timed testing has been  applied within an industrial case study, where we focus on a smaller  part of the system, but have gone all the way through the model-based  test process adapted to the industrial environment. The timed  testing has been successfully carried out in the industrial  partner's test channel.  Our paper describes the set up we have been  using and our experiences and lessons learned, which will be of  interest for practitioners, but also for people working on the  theory of model-based methods.

[1]  Henrik C. Bohnenkamp,et al.  Timed Testing with TorX , 2005, FM.

[2]  Stavros Tripakis,et al.  Conformance testing for real-time systems , 2004, SPIN.

[3]  Hacène Fouchal,et al.  A realistic architecture for timed testing , 1999, Proceedings Fifth IEEE International Conference on Engineering of Complex Computer Systems (ICECCS'99) (Cat. No.PR00434).

[4]  Brian Nielsen,et al.  Automated test generation from timed automata , 2001, International Journal on Software Tools for Technology Transfer.

[5]  Walter Vogler,et al.  Timed Testing of Concurrent Systems , 1993, Inf. Comput..

[6]  C. A. R. Hoare,et al.  Communicating sequential processes , 1978, CACM.

[7]  Kim G. Larsen,et al.  Testing Real-Time Systems Using UPPAAL , 2008, Formal Methods and Testing.

[8]  Paul Clements,et al.  Software architecture in practice , 1999, SEI series in software engineering.

[9]  Kim G. Larsen,et al.  A Tutorial on Uppaal , 2004, SFM.

[10]  Jan Tretmans,et al.  Test Generation with Inputs, Outputs and Repetitive Quiescence , 1996, Softw. Concepts Tools.

[11]  Ed Brinksma,et al.  A Test Generation Framework for quiescent Real-Time Systems , 2004, FATES.

[12]  Kim G. Larsen,et al.  Testing real-time embedded software using UPPAAL-TRON: an industrial case study , 2005, EMSOFT.

[13]  Jan Tretmans,et al.  TorX: Automated Model-Based Testing , 2003 .

[14]  Robert C. Martin Agile Software Development, Principles, Patterns, and Practices , 2002 .

[15]  Thierry Jéron,et al.  Using On-The-Fly Verification Techniques for the Generation of test Suites , 1996, CAV.