On-The-Fly Testing of Reactive Systems

On-the-fly testing is a technique in which test derivation from a model program and test execution are combined into a single algorithm. It can also be called online testing using a model program, to distinguish it from offline test generation as a separate process. We describe a practical on-the-fly testing algorithm that is implemented in the model-based testing tool developed at Microsoft Research called Spec Explorer. Spec Explorer is being used daily by several Microsoft product groups. Model programs in Spec Explorer are written in a high level specification language AsmL or Spec#. We view model programs as implicit definitions of interface automata. The conformance relation between a model and an implementation under test is formalized in terms of refinement between interface automata, and testing amounts to a game between the test tool and the implementation under test.

[1]  Jan Tretmans,et al.  Testing Transition Systems: An Annotated Bibliography , 2000, MOVEP.

[2]  Margus Veanes,et al.  Optimal strategies for testing nondeterministic systems , 2004, ISSTA '04.

[3]  Margus Veanes,et al.  Play to Test , 2005, FATES.

[4]  Wolfram Schulte,et al.  Semantic essence of AsmL , 2005, Theor. Comput. Sci..

[5]  Luca de Alfaro,et al.  Game Models for Open Systems , 2003, Verification: Theory and Practice.

[6]  Jan Tretmans,et al.  Automatic Testing with Formal Methods , 1999 .

[7]  Jan Tretmans,et al.  Test Generation Based on Symbolic Specifications , 2004, FATES.

[8]  Thomas A. Henzinger,et al.  Interface automata , 2001, ESEC/FSE-9.

[9]  Margus Veanes,et al.  Abstract communication model for distributed systems , 2004, IEEE Transactions on Software Engineering.

[10]  Zohar Manna,et al.  Verification : theory and practice : essays dedicated to Zohar Manna on the occasion of his 64th birthday , 2004 .

[11]  Thomas A. Henzinger,et al.  Alternating Refinement Relations , 1998, CONCUR.

[12]  Jan Tretmans,et al.  TorX: Automated Model-Based Testing , 2003 .

[13]  Margus Veanes,et al.  Towards a Tool Environment for Model-Based Testing with AsmL , 2003, FATES.

[14]  Yuri Gurevich,et al.  Evolving algebras 1993: Lipari guide , 1995, Specification and validation methods.

[15]  Margus Veanes,et al.  Instrumenting scenarios in a model-driven development environment , 2004, Inf. Softw. Technol..

[16]  Alan Hartman,et al.  Model Driven Testing – AGEDIS Architecture Interfaces and Tools , 2003 .

[17]  Arend Rensink,et al.  Compositional Testing with ioco , 2003, FATES.