Fault coverage in testing real-time systems

Real-time systems interact with their environment, through time constrained input/output events. The misbehavior of real-time systems is generally caused by the violation of the specified time constraints. Validation of real-time system software is an important quality control activity in the software lifecycle. Among the validation processes, testing aims at assessing the conformance of an implementation against the reference specification. One of the important aspects in testing real-time software systems is the fault coverage measurement, which consists of studying the potential faults that can be detected by a test suite generated by a given test generation method. This paper addresses the fault coverage of the Tinted Wp-method we have introduced in (En-Nouaary et al., 1998). We present a timed fault model based on the TIOA model for real-time systems specification. We study the fault coverage of the timed Wp-method with respect to our fault model.

[1]  Joseph Sifakis,et al.  Compiling Real-Time Specifications into Extended Automata , 1992, IEEE Trans. Software Eng..

[2]  Conrado Daws,et al.  Reducing the number of clock variables of timed automata , 1996, RTSS.

[3]  Nancy A. Lynch,et al.  Using mappings to prove timing properties , 1990, PODC '90.

[4]  Krishan K. Sabnani,et al.  A Protocol Test Generation Procedure , 1988, Comput. Networks.

[5]  Elaine J. Weyuker,et al.  Selecting Software Test Data Using Data Flow Information , 1985, IEEE Transactions on Software Engineering.

[6]  Wang Yi,et al.  Time Abstracted Bisimiulation: Implicit Specifications and Decidability , 1993, MFPS.

[7]  I. Lee,et al.  Automatic generation of tests for timing constraints from requirements , 1997, Proceedings Third International Workshop on Object-Oriented Real-Time Dependable Systems.

[8]  Mingyu Yao.  On the development of conformance test suites in view of their fault coverage , 1998 .

[9]  Jan Tretmans,et al.  A Formal Approach to Conformance Testing , 1993, Protocol Test Systems.

[10]  O. Charles.  Application des hypothèses de test à une définition de la couverture. (Application of test hypotheses to a definition of test coverage) , 1997 .

[11]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[12]  G. J. Tretmans.  Testing labelled Transition Systems with Inputs and Outputs , 1995 .

[13]  Alexandre Petrenko,et al.  Test Selection Based on Communicating Nondeterministic Finite-State Machines Using a Generalized WP-Method , 1994, IEEE Trans. Software Eng..

[14]  Sandro Morasca,et al.  Generating test cases for real-time systems from logic specifications , 1995, TOCS.

[15]  Son T. Vuong,et al.  On Test Coverage Metrics for Communication Protocols , 1991, Protocol Test Systems.

[16]  Frits W. Vaandrager,et al.  Minimizable Timed Automata , 1996, FTRTFT.

[17]  Ferhat Khendek,et al.  Timed test cases generation based on state characterization technique , 1998, Proceedings 19th IEEE Real-Time Systems Symposium (Cat. No.98CB36279).

[18]  Krishan K. Sabnani,et al.  An experience in estimating fault coverage of a protocol test , 1988, IEEE INFOCOM '88,Seventh Annual Joint Conference of the IEEE Computer and Communcations Societies. Networks: Evolution or Revolution?.

[19]  Ferhat Khendek,et al.  Test Selection Based on Finite State Models , 1991, IEEE Trans. Software Eng..

[20]  Frits W. Vaandrager,et al.  Testing timed automata , 1997, Theor. Comput. Sci..

[21]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..