Applying Mutation Analysis to SDL Specifications

Mutation analysis is a fault based testing method used initially for code based software testing, and lately for specification based testing and validation as well. In this paper, the method is applied to SDL (Specification and Description Language) specifications. It is used to automate the process of conformance test generation and selection for telecommunications protocols. We present two algorithms for automatic test generation and selection. These provide the basis of the Test Selector tool developed at the Budapest University of Technology and Economics. We present the results of an empirical study using the tool.

[1]  Paulo César Masiero,et al.  Mutation testing applied to validate specifications based on statecharts , 1999, Proceedings 10th International Symposium on Software Reliability Engineering (Cat. No.PR00443).

[2]  Paul Ammann,et al.  A specification-based coverage metric to evaluate test sets , 1999, Proceedings 4th IEEE International Symposium on High-Assurance Systems Engineering.

[3]  Ming T. Liu,et al.  Generating test cases for EFSM with given fault models , 1993, IEEE INFOCOM '93 The Conference on Computer Communications, Proceedings.

[4]  D. Richard Kuhn.  A Technique for Analyzing the Effects of Changes in Formal Specifications , 1992, Comput. J..

[5]  David Lee,et al.  Principles and methods of testing finite state machines-a survey , 1996, Proc. IEEE.

[6]  Diego Latella,et al.  Formal methods for distributed system development : FORTE/PSTV 2000, IFIP TC6 WG6.1 Joint International Conference on Formal Description Techniques for Distributed Systems and Communication Protocols (FORTE XIII) and Protocol Specification, Testing and Verification (PSTV XX), October 10-13, 2000, Pi , 2000 .

[7]  T. Csondes,et al.  A mathematical programming method in test selection , 1997, Proceedings 23rd Euromicro Conference New Frontiers of Information Technology - Short Contributions -.

[8]  Paul Ammann,et al.  Using model checking to generate tests from specifications , 1998, Proceedings Second International Conference on Formal Engineering Methods (Cat.No.98EX241).

[9]  David R. Kuhn.  Fault Classes and Error Detection in Specification Based Testing | NIST , 1998 .

[10]  Elliot Berk,et al.  JLex: A lexical analyzer generator for Java , 2004 .

[11]  D. Richard Kuhn.  Fault classes and error detection capability of specification-based testing , 1999, TSEM.

[12]  Phyllis G. Frankl,et al.  All-uses vs mutation testing: An experimental comparison of effectiveness , 1997, J. Syst. Softw..

[13]  Vadim Okun,et al.  Mutation operators for specifications , 2000, Proceedings ASE 2000. Fifteenth IEEE International Conference on Automated Software Engineering.

[14]  Dieter Hogrefe,et al.  SDL : formal object-oriented language for communicating systems , 1997 .

[15]  A. Jefferson Offutt,et al.  Investigations of the software testing coupling effect , 1992, TSEM.

[16]  Márcio Eduardo Delamaro,et al.  Mutation analysis testing for finite state machines , 1994, Proceedings of 1994 IEEE International Symposium on Software Reliability Engineering.

[17]  Chunming Qiao,et al.  TCP implementations and false time out detection in OBS networks , 2004, IEEE INFOCOM 2004.

[18]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[19]  Nicolae Goga,et al.  Formal Test Automation: A Simple Experiment , 1999, IWTCS.

[20]  W. Eric Wong,et al.  Mutation Testing Applied to Validate Specifications Based on Petri Nets , 1995, FORTE.

[21]  Simone do Rocio Senger de Souza,et al.  Mutation Testing Applied to Estelle Specifications , 2004, Software Quality Journal.