Issues in conformance testing: multiple semicontrollable interfaces

In a testing environment, where an IUT communicates with multiple entities, a tester may have differing degrees of controllability on the interactions between these entities and the IUT: directly controllable, semicontrollable, or uncontrollable. In this paper, a graph conversion algorithm is introduced that offers the testability of both the directly and semicontrollable inputs, while avoiding race conditions. Although, for the most general case, the graph conversion results in an exponentially large number of nodes, practical considerations make the converted graph size feasible. Currently, this methodology is being applied to generate tests for MIL-STD 188–220B, which increases the number of testable state transitions from approximately 200 to over 700.

[1]  Sanjoy Paul,et al.  Structural analysis of protocol specifications and generation of maximal fault coverage conformance test sequences , 1994, TNET.

[2]  Jeffrey D. Ullman,et al.  Introduction to Automata Theory, Languages and Computation , 1979 .

[3]  Elaine J. Weyuker,et al.  Computability, complexity, and languages - fundamentals of theoretical computer science , 2014, Computer science and applied mathematics.

[4]  Krishan K. Sabnani,et al.  A Protocol Test Generation Procedure , 1988, Comput. Networks.

[5]  Robert Johnson,et al.  Structural Analysis , 2020, Multiphysics Modeling with Application to Biomedical Engineering.

[6]  Marc Phalippou.  The Limited Power of Testing , 1992, Protocol Test Systems.

[7]  Hasan Ural,et al.  Formal methods for test sequence generation , 1992, Comput. Commun..

[8]  Alfred V. Aho,et al.  An optimization technique for protocol conformance test generation based on UIO sequences and rural Chinese postman tours , 1991, IEEE Trans. Commun..

[9]  O. Rafiq.  From Conformance Testing to Interoperability Testing , 1990 .

[10]  H. C. Guênzburg.  Volksbüchereien und Politik , 1990 .

[11]  Samuel T. Chanson,et al.  On Ferry Clip Approaches in Protocol Testing , 1989, Comput. Networks.

[12]  David Spiegel,et al.  THE HEALING TRANCE , 1987 .

[13]  W. Y. L. Chan,et al.  An improved protocol test generation procedure based on UIOS , 1989, SIGCOMM '89.

[14]  Gregor von Bochmann,et al.  A Test Design Methodology for Protocol Testing , 1987, IEEE Transactions on Software Engineering.

[15]  Paul D. Amer,et al.  Minimum-cost solutions for testing protocols with timers , 1998, 1998 IEEE International Performance, Computing and Communications Conference. Proceedings (Cat. No.98CH36191).

[16]  P.D. Amer,et al.  Performance evaluation of MIL-STD 188-220 interoperability standard for digital message transfer device subsystems , 1995, Proceedings of MILCOM '95.

[17]  Jan Karel Lenstra,et al.  On general routing problems , 1976, Networks.

[18]  Ana R. Cavalli,et al.  Standardization of Formal Methods in Conformance Testing of Communication Protocols , 1996, Comput. Networks ISDN Syst..

[19]  Richard J. Linn,et al.  Conformance testing methodologies and architectures for OSI protocols , 1995 .

[20]  A.S. Sethi,et al.  Formal design and testing of MIL-STD 188-220A based on Estelle , 1997, MILCOM 97 MILCOM 97 Proceedings.

[21]  D. Rayner.  OSI Conformance Testing , 1987, Comput. Networks.

[22]  Jan Tretmans,et al.  Conformance Testing with Labelled Transition Systems: Implementation Relations and Test Generation , 1996, Comput. Networks ISDN Syst..