Exploring alternatives for transition verification

When an implementation under test (IUT) is state-based, and its expected abstract behavior is given in terms of a finite state machine (FSM), a checking sequence generated from a specification FSM and applied to an IUT for testing can provide us with high-level confidence in the correct functional behavior of our implementation. One of the issues here is to generate efficient checking sequences in terms of their lengths. As a major characteristics, a checking sequence must contain all @b-sequences for transition verification. In this paper, we discuss the possibility of reducing the lengths of checking sequences by making use of the invertible transitions in the specification FSM to increase the choice of @b-sequences to be considered for checking sequence generation. We present a sufficient condition for adopting alternative @b-sequences and illustrate typical ways of incorporating these alternative @b-sequences into existing methods for checking sequence generation to reduce the lengths. Compared to the direct use of three existing methods, our experiments show that most of the time the saving gained by adopting alternative @b-sequences falls in the range of 10-40%.

[1]  Jim Gray,et al.  Notes on Data Base Operating Systems , 1978, Advanced Course: Operating Systems.

[2]  Robert M. Hierons,et al.  Optimizing the length of checking sequences , 2006, IEEE Transactions on Computers.

[3]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[4]  Jack Edmonds,et al.  Matching, Euler tours and the Chinese postman , 1973, Math. Program..

[5]  Sanjoy Paul,et al.  On the generation of minimal-length conformance tests for communication protocols , 1993, TNET.

[6]  Alfred V. Aho,et al.  An optimization technique for protocol conformance test generation based on UIO sequences and rural Chinese postman tours , 1991, IEEE Trans. Commun..

[7]  Jan Tretmans,et al.  Conformance Testing with Labelled Transition Systems: Implementation Relations and Test Generation , 1996, Comput. Networks ISDN Syst..

[8]  Robert M. Hierons,et al.  Eliminating Redundant Tests in a Checking Sequence , 2005, TestCom.

[9]  David Lee,et al.  Principles and methods of testing finite state machines-a survey , 1996, Proc. IEEE.

[10]  Jessica Chen,et al.  Alternative B-Sequences , 2007 .

[11]  Michel Gendreau,et al.  Arc Routing Problems, Part II: The Rural Postman Problem , 1995, Oper. Res..

[12]  Xiaolin Wu,et al.  On Minimizing the Lengths of Checking Sequences , 1997, IEEE Trans. Computers.

[13]  Robert M. Hierons,et al.  UIO sequence based checking sequences for distributed test architectures , 2003, Inf. Softw. Technol..

[14]  Brian Randell,et al.  Operating Systems, An Advanced Course , 1978 .

[15]  Robert M. Hierons,et al.  Extending Test Sequence Overlap by Invertibility , 1996, Comput. J..

[16]  Robert M. Hierons,et al.  Testing from a Finite-State Machine: Extending Invertibility to Sequences , 1997, Comput. J..

[17]  Richard Lai,et al.  A survey of communication protocol testing , 2002, J. Syst. Softw..

[18]  Hasan Ural,et al.  Generalizing Redundancy Elimination in Checking Sequences , 2005, ISCIS.

[19]  Alexandre Petrenko,et al.  Test Selection Based on Communicating Nondeterministic Finite-State Machines Using a Generalized WP-Method , 1994, IEEE Trans. Software Eng..

[20]  F. C. Hennine Fault detecting experiments for sequential circuits , 1964, SWCT 1964.

[21]  Güney Gönenç,et al.  A Method for the Design of Fault Detection Experiments , 1970 .

[22]  Hasan Ural,et al.  Reducing the Lengths of Checking Sequences by Overlapping , 2006, TestCom.

[23]  Krishan K. Sabnani,et al.  A Protocol Test Generation Procedure , 1988, Comput. Networks.

[24]  Robert M. Hierons,et al.  Reduced Length Checking Sequences , 2002, IEEE Trans. Computers.