Improving test quality using robust unique input/output circuit sequences (UIOCs)

Abstract In finite state machine (FSM) based testing, the problem of fault masking in the unique input/output (UIO) sequence may degrade the test performance of the UIO based methods. This paper investigates this problem and proposes the use of a new type of unique input/output circuit (UIOC) sequence for state verification, which may help to overcome the drawbacks that exist in the UIO based techniques. When constructing a UIOC, overlap and internal state observation schema are used to increase the robustness of a test sequence. Test quality is compared by using the forward UIO method (F-method), the backward UIO method (B-method) and the UIOC method (C-method) separately. Robustness of the UIOCs constructed by the algorithm given in this paper is also compared with those constructed by the algorithm given previously. Experimental results suggest that the C-method outperforms the F- and the B-methods and the UIOCs constructed by the algorithm given in this paper, are more robust than those constructed by other proposed algorithms.

[1]  Sanjoy Paul,et al.  On the generation of minimal-length conformance tests for communication protocols , 1993, TNET.

[2]  Guney Gonenc,et al.  A Method for the Design of Fault Detection Experiments , 1970, IEEE Transactions on Computers.

[3]  Bo Yang,et al.  Protocol conformance test generation using multiple UIO sequences with overlapping , 1990, SIGCOMM '90.

[4]  Fabrizio Lombardi,et al.  Protocol conformance testing using multiple UIO sequences , 1989, IEEE Trans. Commun..

[5]  F. C. Hennine Fault detecting experiments for sequential circuits , 1964, SWCT 1964.

[6]  Abdeslam En-Nouaary,et al.  Test development for communication protocols: towards automation , 1999, Comput. Networks.

[7]  Robert M. Hierons,et al.  Extending Test Sequence Overlap by Invertibility , 1996, Comput. J..

[8]  W. Eric Wong,et al.  Automatic test generation from communicating extended finite state machine (CEFSM)-based models , 2002, Proceedings Fifth IEEE International Symposium on Object-Oriented Real-Time Distributed Computing. ISIRC 2002.

[9]  Xiaojun Shen,et al.  A new protocol conformance test generation method and experimental results , 1992, SAC '92.

[10]  Mark Harman,et al.  Constructing multiple unique input/output sequences using metaheuristic optimisation techniques , 2005, IEE Proc. Softw..

[11]  Xiaojun Shen,et al.  An improved RCP-method for protocol test generation using backward UIO sequences , 1991, [Proceedings] 1991 Symposium on Applied Computing.

[12]  Mark Harman,et al.  Computing Unique Input/Output Sequences Using Genetic Algorithms , 2003, FATES.

[13]  Alei Liang,et al.  Study on UIO sequence generation for sequential machine's functional test , 2001, ASICON 2001. 2001 4th International Conference on ASIC Proceedings (Cat. No.01TH8549).

[14]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[15]  Kshirasagar Naik,et al.  Fault-tolerant UIO Sequences in Finite State Machines , 1996 .

[16]  Deepinder P. Sidhu,et al.  Formal Methods for Protocol Testing: A Detailed Study , 1989, IEEE Trans. Software Eng..

[17]  Fabrizio Lombardi,et al.  Evaluation and improvement of fault coverage of conformance testing by UIO sequences , 1992, IEEE Trans. Commun..

[18]  W. Y. L. Chan,et al.  An improved protocol test generation procedure based on UIOS , 1989, SIGCOMM '89.

[19]  Robert M. Hierons,et al.  Testing from a Finite-State Machine: Extending Invertibility to Sequences , 1997, Comput. J..

[20]  Robert M. Hierons,et al.  Reduced Length Checking Sequences , 2002, IEEE Trans. Computers.

[21]  Alfred V. Aho,et al.  An optimization technique for protocol conformance test generation based on UIO sequences and rural Chinese postman tours , 1991, IEEE Trans. Commun..

[22]  David Lee,et al.  Testing Finite-State Machines: State Identification and Verification , 1994, IEEE Trans. Computers.

[23]  Xiaolin Wu,et al.  On Minimizing the Lengths of Checking Sequences , 1997, IEEE Trans. Computers.

[24]  Hasan Ural,et al.  Construction of checking sequences based on characterization sets , 1995, Comput. Commun..

[25]  Imtiaz Ahmad,et al.  LANG - algorithm for constructing unique input/output sequences in finite-state machines , 2004 .