Time Simulation Methods for Testing Protocol Software Embedded in Communicating Systems

This paper deals with time simulation methods that are applicable for testing protocol software embedded in communicating systems. The novelty of the presented approach is that simulation time is used to control the level of non-determinism caused by the environment of the software under test. The test system is controlled in such a manner that external non-determinism is allowed, reduced, or eliminated according to the instructions given by the tester. The described methods have been evaluated in and applied to testing protocols for several standards. A TETRA terminal test system has been outlined as an example, demonstrating how time simulation can be integrated with a TTCN tester and target implementation generated from the SDL model.

[1]  Gregor von Bochmann,et al.  Test result analysis and validation of test verdicts , 1999 .

[2]  Hamdy A. Taha Simulation Modeling And Simnet , 1988 .

[3]  Bernhard Thomé,et al.  Systems engineering: principles and practice of computer-based systems engineering , 1993 .

[4]  Richard H. Carver,et al.  Replay and testing for concurrent programs , 1991, IEEE Software.

[5]  B. Sarikaya Protocol test generation, trace analysis and verification techniques , 1988, [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis.

[6]  Stewart N. Weiss A formal framework for the study of concurrent program testing , 1988, [1988] Proceedings. Second Workshop on Software Testing, Verification, and Analysis.

[7]  Ana Cavalli,et al.  Protocol Test Systems VIII , 1996, IFIP — The International Federation for Information Processing.

[8]  Itu-T Specification and Description Language (SDL) , 1999 .

[9]  Richard H. Carver,et al.  Debugging Concurrent Ada Programs by Deterministic Execution , 1991, IEEE Trans. Software Eng..

[10]  Myungchul Kim,et al.  Design for testability of protocols based on formal specifications , 1996 .

[11]  K. Mani Chandy,et al.  Distributed Simulation: A Case Study in Design and Verification of Distributed Programs , 1979, IEEE Transactions on Software Engineering.

[12]  David R. Jefferson,et al.  Virtual time , 1985, ICPP.

[13]  Hannu Honka A simulation-based approach to testing embedded software , 1992 .

[14]  W. Schutz,et al.  A test strategy for the distributed real-time system MARS , 1990, COMPEURO'90: Proceedings of the 1990 IEEE International Conference on Computer Systems and Software Engineering@m_Systems Engineering Aspects of Complex Computerized Systems.

[15]  Leslie Lamport,et al.  Time, clocks, and the ordering of events in a distributed system , 1978, CACM.