Fully automated interoperability test suite derivation for communication protocols

We propose an automatic test derivation method for testing interoperability of communication protocols. It first derives a skeleton test suite for control part through a sort of reachability analysis. Next, it parameterizes each test case. Finally, it completes the test suite by actualizing test cases by assigning values to their parameters. By constructing test case space based on stable states and by basing test case actualization step on orthogonal arrays used in experimental design techniques, state space explosion is avoided. In order to demonstrate the feasibility and effectiveness, out method is applied to the ATM/B-ISDN signaling protocol and TCP. The application results show that our method surpasses the conventional methods in terms of both test size and coverage.

[1]  Bernd Baumgarten,et al.  OSI Conformance Testing Methodology and TTCN , 1994 .

[2]  O. Rafiq.  From Conformance Testing to Interoperability Testing , 1990 .

[3]  W. Richard Stevens,et al.  TCP/IP Illustrated, Volume 2: The Implementation , 1995 .

[4]  Myungchul Kim,et al.  Interoperability test suite derivation for communication protocols , 2000, Comput. Networks.

[5]  Michael L. Fredman,et al.  The AETG System: An Approach to Testing Based on Combinatiorial Design , 1997, IEEE Trans. Software Eng..

[6]  W. Richard Stevens,et al.  Unix network programming , 1990, CCRV.

[7]  Terunao Soneoka,et al.  Combination of conformance and interoperability testing , 1992, FORTE.

[8]  S. Kang,et al.  Interoperability Test Suite Derivation for the ATM/B-ISDN Signaling Protocol , 1998, IWTCS.

[9]  Robert L. Probert,et al.  A practical strategy for testing pair-wise coverage of network interfaces , 1996, Proceedings of ISSRE '96: 7th International Symposium on Software Reliability Engineering.

[10]  Terunao Soneoka,et al.  A Test Case Generation Method for Concurrent Programs , 1991, Protocol Test Systems.

[11]  R. L. Erickson,et al.  Improved quality of protocol testing through techniques of experimental design , 1994, Proceedings of ICC/SUPERCOMM'94 - 1994 International Conference on Communications.

[12]  Dieter Hogrefe,et al.  Autolink-a tool for automatic test generation from SDL specifications , 1998, Proceedings. 2nd IEEE Workshop on Industrial Strength Formal Specification Techniques.

[13]  Myungchul Kim,et al.  Interoperability Test Suite Generation for the TCP Data Part Using Experimental Design Techniques , 2000, TestCom.

[14]  Myungchul Kim,et al.  Interoperability Test Suite Derivation for Symmetric Communication Protocols , 1997, FORTE.

[15]  C.A. Vissers,et al.  Formal description techniques , 1983, Proceedings of the IEEE.

[16]  Ruibing Hao,et al.  Integrated system interoperability testing with applications to VoIP , 2004, IEEE/ACM Transactions on Networking.

[17]  Myungchul Kim,et al.  Interoperability Test Generation for Communication Protocols based on Multiple Stimuli Principle , 2002, TestCom.

[18]  Robert L. Mason,et al.  Taguchi Methods: A Hands-On Approach , 1994 .

[19]  Margaret J. Robertson,et al.  Design and Analysis of Experiments , 2006, Handbook of statistics.