Model Based Testing with Constraint Logic Programming: First Results and Challenges

We summarize our continuing efiorts at model based testing of reactive systems on the grounds of Constraint Logic Programming. First experimental results give rise to optimism w.r.t. scalability of our approach, point at necessary improvements, and they help identify future areas of research. Among others, these include search strategies more powerful than backtracking alone, appropriate (graphical) input languages for test cases, and theoretical aspects such as the relationship between test cases (traces) and system speciflcations.

[1]  Bruno Marre,et al.  Test sequences generation from LUSTRE descriptions: GATEL , 2000, Proceedings ASE 2000. Fifteenth IEEE International Conference on Automated Software Engineering.

[2]  Joxan Jaffar,et al.  Constraint logic programming , 1987, POPL '87.

[3]  David L. Dill,et al.  Experience with Predicate Abstraction , 1999, CAV.

[4]  Thom W. Frühwirth,et al.  Theory and Practice of Constraint Handling Rules , 1998, J. Log. Program..

[5]  Laurent Fribourg,et al.  Constraint Logic Programming Applied to Model Checking , 1999, LOPSTR.

[6]  Pretschner,et al.  Testing Concurrent Reactive Systems with Constraint Logic Programming , 2000 .

[7]  E. Aiglstorfer,et al.  Model Based Testing for Real : The Inhouse Card Case , 2001 .

[8]  Bernhard Schätz,et al.  Consistent Graphical Specification of Distributed Systems , 1997, FME.

[9]  Pretschner,et al.  AutoFocus on Constraint Logic Programming , 2000 .

[10]  Alexander Pretschner,et al.  Developing Correct Safety Critical, Hybrid, Embedded Systems , 2000 .

[11]  Jan Tretmans,et al.  Automatic Testing with Formal Methods , 1999 .

[12]  C. R. Ramakrishnan,et al.  Logic Programming and Model Checking , 1998, PLILP/ALP.

[13]  Frank Tip,et al.  A survey of program slicing techniques , 1994, J. Program. Lang..

[14]  Jan Jürjens,et al.  Specification-Based Testing of Firewalls , 2001, Ershov Memorial Conference.

[15]  Jesse H. Poore,et al.  Cleanroom Software Engineering , 1996 .

[16]  Jan Tretmans,et al.  Test Generation with Inputs, Outputs and Repetitive Quiescence , 1996, Softw. Concepts Tools.

[17]  Armin Biere,et al.  Symbolic Model Checking without BDDs , 1999, TACAS.

[18]  Christophe Meudec.  ATGen: automatic test data generation using constraint logic programming and symbolic execution † , 2001, Softw. Test. Verification Reliab..

[19]  Alexander Pretschner,et al.  Specification based test sequence generation with propositional logic , 2000, Softw. Test. Verification Reliab..

[20]  Alexander Pretschner,et al.  Model Based Testing for Real: The Inhouse Card Case Study , 2001 .

[21]  Winfried Lamersdorf,et al.  Extreme modeling , 2001 .

[22]  David Scott Warren,et al.  Memoing for logic programs , 1992, CACM.

[23]  Patrick Cousot,et al.  Abstract interpretation: a unified lattice model for static analysis of programs by construction or approximation of fixpoints , 1977, POPL.

[24]  Marie-Claude Gaudel,et al.  Testing Can Be Formal, Too , 1995, TAPSOFT.

[25]  Thomas A. Henzinger,et al.  The Algorithmic Analysis of Hybrid Systems , 1995, Theor. Comput. Sci..

[26]  Luis Urbina,et al.  Analysis of Hybrid Systems in CLP(R) , 1996, CP.

[27]  Rachid Echahed,et al.  A needed narrowing strategy , 2000, JACM.

[28]  Patrick Cousot,et al.  Constructive design of a hierarchy of semantics of a transition system by abstract interpretation , 2002, MFPS.

[29]  Hassen Saïdi,et al.  Construction of Abstract State Graphs with PVS , 1997, CAV.

[30]  Alexander Pretschner,et al.  Model based testing in evolutionary software development , 2001, Proceedings 12th International Workshop on Rapid System Prototyping. RSP 2001.

[31]  Orna Grumberg,et al.  Abstract interpretation of reactive systems , 1997, TOPL.

[32]  Kent L. Beck,et al.  Extreme programming explained - embrace change , 1990 .