Formal Methods for Protocol Testing: A Detailed Study

The authors present a detailed study of four formal methods (T-, U-, D-, and W-methods) for generating test sequences for protocols. Applications of these methods to the NBS Class 4 Transport Protocol are discussed. An estimation of fault coverage of four protocol-test-sequence generation techniques using Monte Carlo simulation is also presented. The ability of a test sequence to decide whether a protocol implementation conforms to its specification heavily relies on the range of faults that it can capture. Conformance is defined at two levels, namely, weak and strong conformance. This study shows that a test sequence produced by T-method has a poor fault detection capability, whereas test sequences produced by U-, D-, and W-methods have comparable (superior to that for T-method) fault coverage on several classes of randomly generated machines used in this study. Also, some problems with a straightforward application of the four protocol-test-sequence generation methods to real-world communication protocols are pointed out. >

[1]  Krishan K. Sabnani,et al.  An experience in estimating fault coverage of a protocol test , 1988, IEEE INFOCOM '88,Seventh Annual Joint Conference of the IEEE Computer and Communcations Societies. Networks: Evolution or Revolution?.

[2]  Edward A. Feigenbaum,et al.  Switching and Finite Automata Theory: Computer Science Series , 1990 .

[3]  Deepinder P. Sidhu,et al.  Experience with test generation for real protocols , 1988, SIGCOMM 1988.

[4]  Deepinder P. Sidhu,et al.  Verification of NBS Class 4 Transport Protocol , 1986, IEEE Trans. Commun..

[5]  Richard J. Linn,et al.  Producing Tests for Implementations of OSI Protocols , 1983, Protocol Specification, Testing, and Verification.

[6]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[7]  Alfred V. Aho,et al.  The Design and Analysis of Computer Algorithms , 1974 .

[8]  Michael A. Harrison,et al.  On Asymptotic Estimates in Switching and Automata Theory , 1966, JACM.

[9]  Krishan K. Sabnani,et al.  A Protocol Test Generation Procedure , 1988, Comput. Networks.

[10]  Alfred V. Aho,et al.  Data Structures and Algorithms , 1983 .

[11]  Gregor von Bochmann,et al.  Synchronization and Specification Issues in Protocol Testing , 1984, IEEE Trans. Commun..

[12]  Deepinder P. Sidhu,et al.  Executable Logic Specifications for Protocol Service Interfaces , 1988, IEEE Trans. Software Eng..

[13]  Deepinder P. Sidhu.  Protocol Verification via Executable Logic Specifications , 1983, Protocol Specification, Testing, and Verification.

[14]  Güney Gönenç,et al.  A Method for the Design of Fault Detection Experiments , 1970 .

[15]  H. Zimmermann,et al.  OSI Reference Model - The ISO Model of Architecture for Open Systems Interconnection , 1980, IEEE Transactions on Communications.