Model-Based Testing

This paper provides a comprehensive introduction to a framework for formal testing using labelled transition systems, based on an extension and reformulation of the ioco theory introduced by Tretmans. We introduce the underlying models needed to specify the requirements, and formalise the notion of test cases. We discuss conformance, and in particular the conformance relation ioco. For this relation we prove several interesting properties, and we provide algorithms to derive test cases (either in batches, or on the fly).

[1]  Ed Brinksma,et al.  A Test Generation Framework for quiescent Real-Time Systems , 2004, FATES.

[2]  Chet Langin,et al.  Languages and Machines: An Introduction to the Theory of Computer Science , 2007 .

[3]  Robin Milner,et al.  Communication and concurrency , 1989, PHI Series in computer science.

[4]  Alan Hartman,et al.  Choosing a Test Modeling Language: A Survey , 2006, Haifa Verification Conference.

[5]  Michael Schmitt,et al.  Test Generation with Autolink and TestComposer , 2000 .

[6]  Jan Tretmans,et al.  Test Generation Based on Symbolic Specifications , 2004, FATES.

[7]  Michiel van Osch.  Hybrid Input-Output Conformance and Test Generation , 2006, FATES/RV.

[8]  Hasan Ural,et al.  Formal methods for test sequence generation , 1992, Comput. Commun..

[9]  Jan Tretmans,et al.  TorX: Automated Model-Based Testing , 2003 .

[10]  Virginia Papailiopoulou.  Automatic Test Generation for LUSTRE/SCADE Programs , 2008, 2008 23rd IEEE/ACM International Conference on Automated Software Engineering.

[11]  Axel Belinfante,et al.  Automated Testing in Practice: The Highway Tolling System , 2002, TestCom.

[12]  Kim G. Larsen,et al.  Testing Real-Time Systems Using UPPAAL , 2008, Formal Methods and Testing.

[13]  Erik Poll,et al.  Model-Based Testing of Electronic Passports , 2009, FMICS.

[14]  Mariëlle Stoelinga,et al.  Interpreting a Successful Testing Process: Risk and Actual Coverage , 2009, 2009 Third IEEE International Symposium on Theoretical Aspects of Software Engineering.

[15]  Boris Beizer,et al.  Black Box Testing: Techniques for Functional Testing of Software and Systems , 1996, IEEE Software.

[16]  Martin Peschke,et al.  Design and Validation of Computer Protocols , 2003 .

[17]  David Lee,et al.  Principles and methods of testing finite state machines-a survey , 1996, Proc. IEEE.

[18]  J. Michael Spivey,et al.  Understanding Z : A specification language and its formal semantics , 1985, Cambridge tracts in theoretical computer science.

[19]  Rocco De Nicola,et al.  Testing Equivalences for Processes , 1984, Theor. Comput. Sci..

[20]  Jan Tretmans,et al.  Test Generation with Inputs, Outputs and Repetitive Quiescence , 1996, Softw. Concepts Tools.

[21]  Henrik C. Bohnenkamp,et al.  Timed Testing with TorX , 2005, FM.

[22]  Marc Phalippou.  Relations d'implantation et hypothèses de test sur des automates à entrées et sorties , 1994 .

[23]  Arend Rensink,et al.  Compositional Testing with ioco , 2003, FATES.

[24]  Frits W. Vaandrager,et al.  Testing timed automata , 1997, Theor. Comput. Sci..

[25]  Cliff B. Jones,et al.  Systematic software development using VDM , 1986, Prentice Hall International Series in Computer Science.

[26]  Lydie du Bousquet,et al.  An overview of Lutess a specification-based tool for testing synchronous software , 1999, 14th IEEE International Conference on Automated Software Engineering.

[27]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[28]  Nicolae Goga,et al.  Formal Test Automation: A Simple Experiment , 1999, IWTCS.

[29]  C. A. R. Hoare,et al.  Communicating sequential processes , 1978, CACM.

[30]  Jan Tretmans,et al.  Model Based Testing with Labelled Transition Systems , 2008, Formal Methods and Testing.

[31]  Mariëlle Stoelinga,et al.  A Semantic Framework for Test Coverage , 2006, ATVA.

[32]  Axel Belinfante,et al.  JTorX: A Tool for On-Line Model-Driven Test Derivation and Execution , 2010, TACAS.

[33]  Alexandre Petrenko,et al.  Fault Model-Driven Test Derivation from Finite State Models: Annotated Bibliography , 2000, MOVEP.

[34]  Axel Belinfante.  Timed Testing with TorX: The Oosterschelde Storm Surge Barrier , 2002 .

[35]  Alan Hartman,et al.  The AGEDIS tools for model based testing , 2004, ISSTA '04.

[36]  Thierry Jéron,et al.  TGV : theory , principles and algorithms A tool for the automatic synthesis of conformance test cases for non-deterministic reactive systems , 2004 .

[37]  Margus Veanes,et al.  Optimal strategies for testing nondeterministic systems , 2004, ISSTA '04.

[38]  Lex Heerink,et al.  Ins and Outs in Refusal Testing , 1998 .