Automatic Test Generation for EFSM-based Systems

The present work addresses the problem of conformance testing for EFSM-based systems and especially, the problem of automatically generating executable test cases. First, the most important description methods are presented. Then, the test generation methods for FSM (finite state machines)-based systems are described. However, since systems are more understood as extended finite state machines (EFSMs), existing test generation methods for EFSM-specified systems are also presented. These methods combine both control and data flow techniques and few effort has been spent in solving the executability problem. For this purpose, we propose a methodology which will solve, if not completely, partially the executability problem and mainly the problem of including all the influencing loops in the test sequences and finding how many times an unbounded loop must be executed.

[1]  Doron Drusinsky,et al.  Using statecharts for hardware description and synthesis , 1989, IEEE Trans. Comput. Aided Des. Integr. Circuits Syst..

[2]  Paul D. Amer,et al.  Test Case Generation for Protocols Specified in Estelle , 1990, FORTE.

[3]  C. V. Ramamoorthy,et al.  On the Automated Generation of Program Test Data , 1976, IEEE Transactions on Software Engineering.

[4]  Krishan K. Sabnani,et al.  A new technique for generating protocol test , 1985, SIGCOMM '85.

[5]  Alfred V. Aho,et al.  An optimization technique for protocol conformance test generation based on UIO sequences and rural Chinese postman tours , 1991, IEEE Trans. Commun..

[6]  Michael Yoeli Formal Verification of Hardware Design , 1990 .

[7]  David Hutchison,et al.  Protocol testing techniques , 1987, Comput. Commun..

[8]  Rina Dechter,et al.  Tree Clustering for Constraint Networks , 1989, Artif. Intell..

[9]  Deepinder Sidhu,et al.  Fault coverage of protocol test methods , 1988, IEEE INFOCOM '88,Seventh Annual Joint Conference of the IEEE Computer and Communcations Societies. Networks: Evolution or Revolution?.

[10]  Benjamin Charles Moszkowski Reasoning about Digital Circuits , 1983 .

[11]  Sanjoy Paul,et al.  Generating Conformance Test Sequences for Combined Control and Data Flow of Communication Protocols , 1992, PSTV.

[12]  Justin Zobel,et al.  Nu-prolog reference manual , 1990 .

[13]  Matthew Bush,et al.  Conformance testing methodologies for OSI protocols , 1990, AT&T Technical Journal.

[14]  Ugo Montanari,et al.  Networks of constraints: Fundamental properties and applications to picture processing , 1974, Inf. Sci..

[15]  M. Diaz,et al.  Modeling and Verification of Time Dependent Systems Using Time Petri Nets , 1991, IEEE Trans. Software Eng..

[16]  E. F. Moore Sequential Machines: Selected Papers , 1964 .

[17]  Teruo Higashino,et al.  Test System for a Restricted Class of LOTOS Expressions with Data Parameters , 1992, Protocol Test Systems.

[18]  Amir Pnueli,et al.  Temporal Logic in Specification , 1987, Lecture Notes in Computer Science.

[19]  Gregor von Bochmann,et al.  Some Experience with Test Sequence Generation for Protocols , 1982, PSTV.

[20]  B. Algayres,et al.  GOAL: Observing SDL behaviors with GEODE , 1995 .

[21]  Rick Reed,et al.  Telecommunications systems engineering using SDL , 1989 .

[22]  Deepinder P. Sidhu,et al.  Formal Methods for Protocol Testing: A Detailed Study , 1989, IEEE Trans. Software Eng..

[23]  K. Thulasiraman,et al.  A Unified Test Case Generation Method for the EFSM Model Using Context Independent Unique Sequences , 1996 .

[24]  Fabrizio Lombardi,et al.  Evaluation and improvement of fault coverage of conformance testing by UIO sequences , 1992, IEEE Trans. Commun..

[25]  Dieter Hogrefe,et al.  Tesdl: experience with generating test cases from sdl specifications , 1989 .

[26]  Guney Gonenc,et al.  A Method for the Design of Fault Detection Experiments , 1970, IEEE Transactions on Computers.

[27]  Dieter Hogrefe,et al.  SDL - with applications from protocol specification , 1991, BCS practitioner series.

[28]  Richard J. Linn Conformance Testing for OSI Protocols , 1989, Comput. Networks ISDN Syst..

[29]  Samuel T. Chanson,et al.  Automatic protocol test suite derivation , 1994, Proceedings of INFOCOM '94 Conference on Computer Communications.

[30]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[31]  Stanislaw Budkowski,et al.  An Introduction to Estelle: A Specification Language for Distributed Systems , 1987, Comput. Networks.

[32]  Roland Groz,et al.  Two approaches linking a test generation tool with verification techniques , 1996 .

[33]  Martin Peschke,et al.  Design and Validation of Computer Protocols , 2003 .

[34]  Ferhat Khendek,et al.  Test Selection Based on Finite State Models , 1991, IEEE Trans. Software Eng..

[35]  Robert L. Probert,et al.  A useful FSM representation for test suite design and development , 1995 .

[36]  Jens Grabowski,et al.  SDL and MSC Based Test Case Generation: An Overall View of the SaMsTaG Method , 1994 .

[37]  Akira Aiba,et al.  Constraint Logic Programming System: CAL, GDCC and Their Constraint Solvers , 1992, Fifth Generation Computer Systems.

[38]  Dieter Hogrefe,et al.  The CCITT-Specification and Description Language SDL , 1989, Comput. Networks.

[39]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[40]  Lori A. Clarke,et al.  Applications of symbolic evaluation , 1985, J. Syst. Softw..

[41]  Alexandre Petrenko Checking Experiments with Protocol Machines , 1991, Protocol Test Systems.

[42]  Chaochen Zhou Specifying Communicating Systems with Temporal Logic , 1987, Temporal Logic in Specification.

[43]  Limin Zhou A New approach to generating and selecting test sequences for conformance testing , 1992 .

[44]  Samuel T. Chanson,et al.  A unified approach to protocol test sequence generation , 1993, IEEE INFOCOM '93 The Conference on Computer Communications, Proceedings.

[45]  Bogdan Korel The Program Dependence Graph in Static Program Testing , 1987, Inf. Process. Lett..

[46]  David Harel,et al.  Statecharts: A Visual Formalism for Complex Systems , 1987, Sci. Comput. Program..

[47]  Janusz W. Laski,et al.  A Data Flow Oriented Program Testing Strategy , 1983, IEEE Transactions on Software Engineering.

[48]  Alexandre Petrenko,et al.  Test Selection Based on Communicating Nondeterministic Finite-State Machines Using a Generalized WP-Method , 1994, IEEE Trans. Software Eng..

[49]  James C. King,et al.  Symbolic execution and program testing , 1976, CACM.

[50]  Fabrizio Lombardi,et al.  Protocol conformance testing using multiple UIO sequences , 1989, IEEE Trans. Commun..

[51]  S. Seshu,et al.  Introduction to the theory of finite-state machines , 1963 .

[52]  Krishan K. Sabnani,et al.  A Protocol Test Generation Procedure , 1988, Comput. Networks.

[53]  A. Jefferson Offutt,et al.  Constraint-Based Automatic Test Data Generation , 1991, IEEE Trans. Software Eng..

[54]  Elaine J. Weyuker,et al.  Selecting Software Test Data Using Data Flow Information , 1985, IEEE Transactions on Software Engineering.

[55]  Gregor von Bochmann,et al.  Finite State Description of Communication Protocols , 1978, Comput. Networks.

[56]  William E. Howden,et al.  An evaluation of the effectiveness of symbolic testing , 1978, Softw. Pract. Exp..

[57]  Ana Cavalli,et al.  Guaranteeing full fault coverage for UIO-based testing methods , 1996 .

[58]  Ben C. Moszkowski,et al.  A Temporal Logic for Multi-Level Reasoning About Hardware, , 1982 .

[59]  Son T. Vuong,et al.  A novel approach to protocol test sequence generation , 1990, [Proceedings] GLOBECOM '90: IEEE Global Telecommunications Conference and Exhibition.

[60]  Alan K. Mackworth Consistency in Networks of Relations , 1977, Artif. Intell..

[61]  Stephen J. Andriole,et al.  Software validation, verification, testing, and documentation , 1986 .

[62]  Richard Fikes,et al.  REF-ARF: A System for Solving Problems Stated as Procedures , 1970, Artif. Intell..

[63]  Bo Yang,et al.  A test sequence selection method for protocol testing , 1991, IEEE Trans. Commun..

[64]  Sanjoy Paul,et al.  Generating minimal length test sequences for conformance testing of communication protocols , 1991, IEEE INFCOM '91. The conference on Computer Communications. Tenth Annual Joint Comference of the IEEE Computer and Communications Societies Proceedings.

[65]  Anthony Wiles,et al.  Experiences with Computer Aided Test Suite Generation , 1993, Protocol Test Systems.

[66]  D. Hogrefe,et al.  A Method for the Generation of Test Cases Based on SDL and MSCs , 1993 .