Validation of SDL specifications using EFSM-based test generation

Existing methods for testing an SDL specification mainly allow for either black box simulation or conformance testing to verify that the behavior of an implementation matches its corresponding model. However, this relies on the potentially hazardous assumption that the model is completely correct. We propose a test generation method that can accomplish conformance verification as well as coverage criteria-driven white box testing of the specification itself. We first reformat a set of EFSMs equivalent to the processes in an SDL specification and identify ''hot spots'' - nodes or edges in the EFSM which should be prioritized during testing to effectively increase coverage. Then, we generate test sequences intended to cover selected hot spots; we address the possible infeasibility of such a test sequence by allowing for its rejection decided by a constraint solver and re-generation of an alternate test sequence to the hot spot. In this paper, we present our test generation method and tool, and provide case studies on five SDL processes demonstrating the effectiveness of our coverage-based test sequence selection.

[1]  Ferhat Khendek,et al.  Test Selection Based on Finite State Models , 1991, IEEE Trans. Software Eng..

[2]  Sandrine-Dominique Gouraud AuGuSTe : a Tool for Statistical Testing Experimental results , 2006 .

[3]  Hiralal Agrawal,et al.  Dominators, super blocks, and program coverage , 1994, POPL '94.

[4]  Russell W. Quong,et al.  ANTLR: A predicated‐LL(k) parser generator , 1995, Softw. Pract. Exp..

[5]  Rachida Dssouli,et al.  A test case generation approach for conformance testing of SDL systems , 2001, Comput. Commun..

[6]  M. Frey-Pucko,et al.  SDL-based feasible test generation for communication protocols , 2001, EUROCON'2001. International Conference on Trends in Communications. Technical Program, Proceedings (Cat. No.01EX439).

[7]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[8]  Nina Yevtushenko,et al.  Conformance Tests as Checking Experiments for Partial Nondeterministic FSM , 2005, FATES.

[9]  Emden R. Gansner,et al.  An open graph visualization system and its applications to software engineering , 2000 .

[10]  Yu Lei,et al.  Reachability Graph-Based Test Sequence Generation for Concurrent Programs , 2008, Int. J. Softw. Eng. Knowl. Eng..

[11]  Gregor von Bochmann,et al.  Software Testing Based on SDL Specifications with Save , 1994, IEEE Trans. Software Eng..

[12]  Alexandre Petrenko,et al.  Automating the process of test derivation from SDL specifications , 1997, SDL Forum.

[13]  W. Eric Wong,et al.  Coverage testing software architectural design in SDL , 2003, Comput. Networks.

[14]  David Lee,et al.  Principles and methods of testing finite state machines-a survey , 1996, Proc. IEEE.

[15]  Dieter Hogrefe,et al.  Tesdl: experience with generating test cases from sdl specifications , 1989 .

[16]  Emden R. Gansner,et al.  An open graph visualization system and its applications to software engineering , 2000, Softw. Pract. Exp..

[17]  Hasan Ural,et al.  Test generation based on control and data dependencies within system specifications in SDL , 2000, Comput. Commun..

[18]  David Lee,et al.  Testing Finite-State Machines: State Identification and Verification , 1994, IEEE Trans. Computers.

[19]  G. von Bochmann,et al.  A test generation tool for specifications in the form of state machines , 1996, Proceedings of ICC/SUPERCOMM '96 - International Conference on Communications.

[20]  Jian Zhang,et al.  A Constraint Solver and Its Application to Path Feasibility Analysis , 2001, Int. J. Softw. Eng. Knowl. Eng..

[21]  Louis Verhaard,et al.  Test derivation for SDL based on ACTs , 1992, FORTE.