Contributions à la génération de tests à base de contraintes. (Contributions to Constraint-Based Testing)

Ces dernieres annees, les recherches en matiere de Test Logiciel ont conduit au developpement de techniques de resolution de contraintes dediees, dans ce qui est appele ''le test a base de contraintes''. Notre approche dans ce domaine vise a explorer l'apport de la Programmation par Contraintes a la generation automatique de test pour les programmes imperatifs. Nous nous sommes interesses a la resolution de problemes combinatoires difficiles issus de la generation de donnees de test, en developpant des techniques de propagation de contraintes et de filtrage, adaptees au traitement des constructions des langages de programmation. Notre habilitation tente de faire une premiere synthese de ce sujet au travers de cinq contributions: l'hybridation de techniques de resolution de contraintes pour la generation automatique de cas de test, la generation probabiliste de cas de test a l'aide d'operateurs a contrainte probabiliste, les contraintes sur un modele memoire pour les programmes manipulant les pointeurs, la resolution de contraintes sur les expressions portant sur les nombres a virgule flottante, et le test de programmes a contraintes. Nous illustrons egalement ces contributions par leur application a la verification de logiciels critiques, et dressons quelques perspectives a ces travaux.

[1]  Tsong Yueh Chen,et al.  Case studies on the selection of useful relations in metamorphic testing , 2004 .

[2]  Edmund M. Clarke,et al.  State space reduction using partial order techniques , 1999, International Journal on Software Tools for Technology Transfer.

[3]  Bev Littlewood,et al.  Validation of ultrahigh dependability for software-based systems , 1993, CACM.

[4]  Lori A. Clarke,et al.  A System to Generate Test Data and Symbolically Execute Programs , 1976, IEEE Transactions on Software Engineering.

[5]  Garth P. McCormick,et al.  Computability of global solutions to factorable nonconvex programs: Part I — Convex underestimating problems , 1976, Math. Program..

[6]  John F. Passafiume,et al.  Software testing and evaluation , 1987 .

[7]  Arnaud Gotlieb,et al.  Boosting the Interval Narrowing Algorithm , 1996, JICSLP.

[8]  Christian Schulte,et al.  Programming Deep Concurrent Constraint Combinators , 2000, PADL.

[9]  Patrick Baudin,et al.  Using formal methods to validate C programs , 1994, Proceedings of 1994 IEEE International Symposium on Software Reliability Engineering.

[10]  Daniel Hoffman,et al.  Prolog Testing of C Modules , 1991, ISLP.

[11]  Bruno Legeard,et al.  Generation of test sequences from formal specifications: GSM 11‐11 standard case study , 2004, Softw. Pract. Exp..

[12]  Dawson R. Engler,et al.  EXE: automatically generating inputs of death , 2006, CCS '06.

[13]  Bogdan Korel,et al.  Automated Software Test Data Generation , 1990, IEEE Trans. Software Eng..

[14]  Bernhard K. Aichernig,et al.  Generating Distinguishing Tests Using the Minion Constraint Solver , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[15]  James C. King,et al.  Symbolic execution and program testing , 1976, CACM.

[16]  Arnaud Gotlieb TCAS software verification using constraint programming , 2012, Knowl. Eng. Rev..

[17]  Elaine J. Weyuker,et al.  On Testing Non-Testable Programs , 1982, Comput. J..

[18]  Andrea Arcuri,et al.  Theoretical Analysis of Local Search in Software Testing , 2009, SAGA.

[19]  Margus Veanes,et al.  Generating finite state machines from abstract state machines , 2002, ISSTA '02.

[20]  Mary Lou Soffa,et al.  Generating test data for branch coverage , 2000, Proceedings ASE 2000. Fifteenth IEEE International Conference on Automated Software Engineering.

[21]  Arnaud Gotlieb Exploiting symmetries to test programs , 2003, 14th International Symposium on Software Reliability Engineering, 2003. ISSRE 2003..

[22]  Arnaud Gotlieb,et al.  Filtering by ULP Maximum , 2011, 2011 IEEE 23rd International Conference on Tools with Artificial Intelligence.

[23]  Henny B. Sipma,et al.  Efficient Strongly Relational Polyhedral Analysis , 2006, VMCAI.

[24]  Sarfraz Khurshid,et al.  Efficient solving of structural constraints , 2008, ISSTA '08.

[25]  Pretschner,et al.  Model Based Testing with Constraint Logic Programming: First Results and Challenges , 2001 .

[26]  Nikolai Tillmann,et al.  Pex-White Box Test Generation for .NET , 2008, TAP.

[27]  Sarfraz Khurshid,et al.  Software assurance by bounded exhaustive testing , 2004, IEEE Transactions on Software Engineering.

[28]  James M. Bieman,et al.  Generating input data structures for automated program testing , 2009, Softw. Test. Verification Reliab..

[29]  Thomas Ball,et al.  A Theory of Predicate-Complete Test Coverage and Generation , 2004, FMCO.

[30]  Hélène Collavizza,et al.  Exploring Different Constraint-Based Modelings for Program Verification , 2007, CP.

[31]  Arnaud Gotlieb,et al.  Constraint-Based Software Testing , 2008 .

[32]  Alex Groce,et al.  Modular verification of software components in C , 2003, 25th International Conference on Software Engineering, 2003. Proceedings..

[33]  Arnaud Gotlieb,et al.  Constraint-Based Test Input Generation for Java Bytecode , 2010, 2010 IEEE 21st International Symposium on Software Reliability Engineering.

[34]  Bruno Marre,et al.  Test sequences generation from LUSTRE descriptions: GATEL , 2000, Proceedings ASE 2000. Fifteenth IEEE International Conference on Automated Software Engineering.

[35]  Pretschner,et al.  AutoFocus on Constraint Logic Programming , 2000 .

[36]  Patrice Godefroid,et al.  Proving memory safety of floating-point computations by combining static and dynamic program analysis , 2010, ISSTA '10.

[37]  Dragan Bosnacki,et al.  Symmetric Spin , 2002, International Journal on Software Tools for Technology Transfer.

[38]  Arnaud Gotlieb,et al.  Proving or Disproving likely Invariants with Constraint Reasoning , 2005, WLPE.

[39]  Mary Lou Soffa,et al.  Automated test data generation using an iterative relaxation method , 1998, SIGSOFT '98/FSE-6.

[40]  Arnaud Gotlieb,et al.  Modelling Dynamic Memory Management in Constraint-Based Testing , 2007, Testing: Academic and Industrial Conference Practice and Research Techniques - MUTATION (TAICPART-MUTATION 2007).

[41]  Avi Ziv,et al.  Using a constraint satisfaction formulation and solution techniques for random test program generation , 2002, IBM Syst. J..

[42]  Arnaud Gotlieb,et al.  Goal-oriented test data generation for pointer programs , 2007, Inf. Softw. Technol..

[43]  Gilles Barthe,et al.  Jakarta: A Toolset for Reasoning about JavaCard , 2001, E-smart.

[44]  Ulrich Junker,et al.  QUICKXPLAIN: Preferred Explanations and Relaxations for Over-Constrained Problems , 2004, AAAI.

[45]  Arnold Neumaier,et al.  Safe bounds in linear and mixed-integer linear programming , 2004, Math. Program..

[46]  Koushik Sen,et al.  DART: directed automated random testing , 2005, PLDI '05.

[47]  Benjamin Monate,et al.  A Value Analysis for C Programs , 2009, 2009 Ninth IEEE International Working Conference on Source Code Analysis and Manipulation.

[48]  Yves Deville,et al.  Automatic test data generation for programs with integer and float variables , 2001, Proceedings 16th Annual International Conference on Automated Software Engineering (ASE 2001).

[49]  Mats Carlsson,et al.  An Open-Ended Finite Domain Constraint Solver , 1997, PLILP.

[50]  Ernest Davis,et al.  Constraint Propagation with Interval Labels , 1987, Artif. Intell..

[51]  Arnaud Gotlieb,et al.  On Testing Constraint Programs , 2010, CP.

[52]  Patrice Godefroid,et al.  Precise pointer reasoning for dynamic test generation , 2009, ISSTA.

[53]  Simão Melo de Sousa Outils et techniques pour la vérification formelle de la plate-forme JavaCard , 2003 .

[54]  Arnaud Gotlieb,et al.  Fault Localization in Constraint Programs , 2010, 2010 22nd IEEE International Conference on Tools with Artificial Intelligence.

[55]  Robert Sedgewick,et al.  Algorithms in C , 1990 .

[56]  Christophe Lecoutre,et al.  AbsCon: A Prototype to Solve CSPs with Abstraction , 2001, CP.

[57]  ralf. gerlich Generic and Extensible Automatic Test Data Generation for Safety Critical Software with CHR , 2010 .

[58]  Bogdan Korel,et al.  The chaining approach for software test data generation , 1996, TSEM.

[59]  Corina S. Pasareanu,et al.  JPF-SE: A Symbolic Execution Extension to Java PathFinder , 2007, TACAS.

[60]  Yves Deville,et al.  Consistency techniques for interprocedural test data generation , 2003, ESEC/FSE-11.

[61]  Arnaud Gotlieb,et al.  Uniform Selection of Feasible Paths as a Stochastic Constraint Problem , 2007, Seventh International Conference on Quality Software (QSIC 2007).

[62]  Gregg Rothermel,et al.  Supporting Controlled Experimentation with Testing Techniques: An Infrastructure and its Potential Impact , 2005, Empirical Software Engineering.

[63]  A. Gotlieb,et al.  Constraint solving on modular integers , 2010 .

[64]  Patrice Godefroid,et al.  Automated Whitebox Fuzz Testing , 2008, NDSS.

[65]  Michela Milano,et al.  The Role of Integer Programming Techniques in Constraint Programming's Global Constraints , 2002, INFORMS J. Comput..

[66]  Uwe Hansmann,et al.  Smart Card Application Development Using Java , 2000, Springer Berlin Heidelberg.

[67]  François Bobot,et al.  Why3: Shepherd Your Herd of Provers , 2011 .

[68]  Zhendong Su,et al.  Perturbing numerical calculations for statistical analysis of floating-point program (in)stability , 2010, ISSTA '10.

[69]  Bruno Marre,et al.  PathCrawler: Automatic Generation of Path Tests by Combining Static and Dynamic Analysis , 2005, EDCC.

[70]  Jeremy Dick,et al.  Automating the Generation and Sequencing of Test Cases from Model-Based Specifications , 1993, FME.

[71]  Koushik Sen,et al.  CUTE: a concolic unit testing engine for C , 2005, ESEC/FSE-13.

[72]  Tom Schrijvers,et al.  Under Consideration for Publication in Theory and Practice of Logic Programming as Time Goes By: Constraint Handling Rules , 2022 .

[73]  K. Rustan M. Leino,et al.  Specification and verification , 2011, Commun. ACM.

[74]  Arnaud Gotlieb,et al.  PACOGEN: Automatic Generation of Pairwise Test Configurations from Feature Models , 2011, 2011 IEEE 22nd International Symposium on Software Reliability Engineering.

[75]  Lydie du Bousquet,et al.  Automatic Test Generation for Java-Card Applets , 2000, Java Card Workshop.

[76]  Arnaud Gotlieb,et al.  Goal-oriented test data generation for programs with pointer variables , 2005, 29th Annual International Computer Software and Applications Conference (COMPSAC'05).

[77]  Corina S. Pasareanu,et al.  A survey of new trends in symbolic execution for software testing and analysis , 2009, International Journal on Software Tools for Technology Transfer.

[78]  David Detlefs,et al.  Simplify: a theorem prover for program checking , 2005, JACM.

[79]  Daniel Jackson,et al.  Finding bugs with a constraint solver , 2000, ISSTA '00.

[80]  John A. Clark,et al.  FORTEST: formal methods and testing , 2002, Proceedings 26th Annual International Computer Software and Applications.

[81]  Neelam Gupta,et al.  Generating test data for functions with pointer inputs , 2002, Proceedings 17th IEEE International Conference on Automated Software Engineering,.

[82]  Philippe Herrmann,et al.  Structural Testing of Executables , 2008, 2008 1st International Conference on Software Testing, Verification, and Validation.

[83]  Slim Abdennadher,et al.  Essentials of Constraint Programming , 2010, Cognitive Technologies.

[84]  Bruno Marre,et al.  Improving the Floating Point Addition and Subtraction Constraints , 2010, CP.

[85]  Bruno Marre,et al.  Toward Automatic Test Data Set Selection Using Algebraic Specifications and Logic Programming , 1991, ICLP.

[86]  Greg Nelson,et al.  Extended static checking for Java , 2002, PLDI '02.

[87]  Guillaume Dufay,et al.  Vérification formelle de la plate-forme Java Card , 2003 .

[88]  Hélène Collavizza,et al.  Exploration of the Capabilities of Constraint Programming for Software Verification , 2006, TACAS.

[89]  Nikolaj Bjørner,et al.  Z3: An Efficient SMT Solver , 2008, TACAS.

[90]  Vi Andrew Jefferson Offutt,et al.  Automatic test data generation , 1988 .

[91]  Matthieu Petit Test statistique structurel par résolution par contraintes de choix probabiliste , 2008 .

[92]  Arnaud Gotlieb,et al.  INKA: TEN YEARS AFTER THE FIRST IDEAS , 2006 .

[93]  Laurent Fribourg,et al.  Test sets generation from algebraic specifications using logic programming , 1986, J. Syst. Softw..

[94]  Duncan Clarke,et al.  Automated Test and Oracle Generation for Smart-Card Applications , 2001, E-smart.

[95]  Patrick Cousot,et al.  Abstract Interpretation Frameworks , 1992, J. Log. Comput..

[96]  Wim Vanhoof,et al.  Towards a Framework for Constraint-Based Test Case Generation , 2009, LOPSTR.

[97]  L. Fournier,et al.  Constraint satisfaction for test program generation , 1995, Proceedings International Phoenix Conference on Computers and Communications.

[98]  M. Petit,et al.  An ongoing work on statistical structural testing via probabilistic concurrent constraint programming , 2004, Proceedings. 2004 First International Workshop on Model, Design and Validation, 2004..

[99]  Alain Denise,et al.  A new way of automating statistical testing methods , 2001, Proceedings 16th Annual International Conference on Automated Software Engineering (ASE 2001).

[100]  S. Rajamani,et al.  A decade of software model checking with SLAM , 2011, Commun. ACM.

[101]  Bernard Botella,et al.  A CLP Framework for Computing Structural Test Data , 2000, Computational Logic.

[102]  Arnaud Gotlieb,et al.  Constraint-based test data generation in the presence of stack-directed pointers , 2005, ASE '05.

[103]  Sarfraz Khurshid,et al.  TestEra: a novel framework for automated testing of Java programs , 2001, Proceedings 16th Annual International Conference on Automated Software Engineering (ASE 2001).

[104]  Arnaud Gotlieb,et al.  Utilisation des CHRs pour générer des cas de test fonctionnel pour la Machine Virtuelle Java Card , 2005 .

[105]  Michael M. Gorlick,et al.  Mockingbird: A Logical Methodology for Testing , 1990, J. Log. Program..

[106]  Antoine Miné,et al.  Relational Abstract Domains for the Detection of Floating-Point Run-Time Errors , 2004, ESOP.

[107]  Todd Millstein,et al.  Automatic predicate abstraction of C programs , 2001, PLDI '01.

[108]  Thomas A. Henzinger,et al.  Software Verification with BLAST , 2003, SPIN.

[109]  Arnaud Gotlieb,et al.  A uniform random test data generator for path testing , 2010, J. Syst. Softw..

[110]  Christophe Meudec ATGen: automatic test data generation using constraint logic programming and symbolic execution † , 2001, Softw. Test. Verification Reliab..

[111]  Barry O'Sullivan,et al.  Robust solutions for combinatorial auctions , 2005, EC '05.

[112]  Arnaud Gotlieb,et al.  Explanation-Based Generalization of Infeasible Path , 2010, 2010 Third International Conference on Software Testing, Verification and Validation.

[113]  Gilles Barthe,et al.  A Formal Executable Semantics of the JavaCard Platform , 2001, ESOP.

[114]  Patrick Cousot,et al.  Abstract interpretation: a unified lattice model for static analysis of programs by construction or approximation of fixpoints , 1977, POPL.

[115]  Felix T.S. Chan,et al.  Application of metamorphic testing in numerical analysis , 1998, ICSE 1998.

[116]  Richard H. Carver,et al.  Testing abstract distributed programs and their implementations: A constraint-based approach , 1996, J. Syst. Softw..

[117]  Alan K. Mackworth Consistency in Networks of Relations , 1977, Artif. Intell..

[118]  Florence Charreteur Modélisation par contraintes de programmes en bytecode Java pour la génération automatique de tests , 2010 .

[119]  Eric Goubault,et al.  Static Analyses of the Precision of Floating-Point Operations , 2001, SAS.

[120]  Daniel Kroening,et al.  Hardware verification using ANSI-C programs as a reference , 2003, ASP-DAC '03.

[121]  J. Filliâtre,et al.  ACSL: ANSI/ISO C Specification Language , 2008 .

[122]  David L. Spooner,et al.  Automatic Generation of Floating-Point Test Data , 1976, IEEE Transactions on Software Engineering.

[123]  John N. Hooker,et al.  Optimization and , 2000 .

[124]  Sarfraz Khurshid,et al.  Korat: automated testing based on Java predicates , 2002, ISSTA '02.

[125]  Peter J. Stuckey,et al.  Extending arbitrary solvers with constraint handling rules , 2003, PPDP '03.

[126]  Nikolai Tillmann,et al.  Automating Software Testing Using Program Analysis , 2008, IEEE Software.

[127]  Alain Denise,et al.  A generic method for statistical testing , 2004, 15th International Symposium on Software Reliability Engineering.

[128]  Patrice Godefroid Software Model Checking Improving Security of a Billion Computers , 2009, SPIN.

[129]  Giorgio Delzanno,et al.  Constraint-based deductive model checking , 2001, International Journal on Software Tools for Technology Transfer.

[130]  Hélène Waeselynck,et al.  An investigation of statistical software testing , 1991, Softw. Test. Verification Reliab..

[131]  Gregor Snelting,et al.  Efficient path conditions in dependence graphs for software safety analysis , 2006, TSEM.

[132]  Claude Michel Exact Projection Functions for Floating Point Number Constraints , 2002, ISAIM.

[133]  Arnaud Gotlieb,et al.  Automated metamorphic testing , 2003, Proceedings 27th Annual International Computer Software and Applications Conference. COMPAC 2003.

[134]  Gert Smolka,et al.  Situated Simplification , 1995, CP.

[135]  Arnaud Gotlieb,et al.  A Framework for the Automatic Correction of Constraint Programs , 2011, 2011 Fourth IEEE International Conference on Software Testing, Verification and Validation.

[136]  E. Balas Disjunctive programming and a hierarchy of relaxations for discrete optimization problems , 1985 .

[137]  Pascal Van Hentenryck,et al.  Constraint Satisfaction Using Constraint Logic Programming , 1992, Artif. Intell..

[138]  Francis C. M. Lau,et al.  Testing object-oriented industrial software without precise oracles or results , 2007, CACM.

[139]  Arnaud Gotlieb,et al.  Raisonnement ? contraintes pour le test de bytecode Java , 2008 .

[140]  Tsong Yueh Chen,et al.  Fault-based testing in the absence of an oracle , 2001, 25th Annual International Computer Software and Applications Conference. COMPSAC 2001.

[141]  Arnaud Gotlieb,et al.  Symbolic execution of floating‐point computations , 2006, Softw. Test. Verification Reliab..

[142]  Bruno Legeard,et al.  Generation of functional test sequences from B formal specifications presentation and industrial case-study , 2001, Proceedings 16th Annual International Conference on Automated Software Engineering (ASE 2001).

[143]  Bruno Legeard,et al.  Automated Boundary Testing from Z and B , 2002, FME.

[144]  A. Jefferson Offutt,et al.  An experimental mutation system for Java , 2004, SOEN.

[145]  Koushik Sen,et al.  Heuristics for Scalable Dynamic Test Generation , 2008, 2008 23rd IEEE/ACM International Conference on Automated Software Engineering.

[146]  Daniel Hoffman,et al.  Automated Module Testing in Prolog , 1991, IEEE Trans. Software Eng..

[147]  Arnaud Gotlieb,et al.  Automatic test data generation using constraint solving techniques , 1998, ISSTA '98.

[148]  A. Prasad Sistla,et al.  Symmetry and model checking , 1993, Formal Methods Syst. Des..

[149]  Pascal Van Hentenryck,et al.  Design, Implementation, and Evaluation of the Constraint Language cc(FD) , 1994, Constraint Programming.

[150]  Nikolai Tillmann,et al.  Fitness-guided path exploration in dynamic symbolic execution , 2009, 2009 IEEE/IFIP International Conference on Dependable Systems & Networks.

[151]  Carlo Ghezzi,et al.  Using symbolic execution for verifying safety-critical systems , 2001, ESEC/FSE-9.

[152]  Arnaud Gotlieb,et al.  Boosting Probabilistic Choice Operators , 2007, CP.

[153]  Yahia Lebbah,et al.  A Rigorous Global Filtering Algorithm for Quadratic Constraints* , 2004, Constraints.

[154]  Yahia Lebbah,et al.  Solving Constraints over Floating-Point Numbers , 2001, CP.

[155]  Arnaud Gotlieb,et al.  A Semi-empirical Model of Test Quality in Symmetric Testing: Application to Testing Java Card APIs , 2006, 2006 Sixth International Conference on Quality Software (QSIC'06).

[156]  A. Jefferson Offutt,et al.  The dynamic domain reduction procedure for test data generation , 1999, Softw. Pract. Exp..

[157]  A. Jefferson Offutt,et al.  Constraint-Based Automatic Test Data Generation , 1991, IEEE Trans. Software Eng..

[158]  Andris Zarins,et al.  SMOTL - A System to Construct Samples for Data Processing Program Debugging , 1979, IEEE Trans. Software Eng..

[159]  Keith W. Miller,et al.  Local exhaustive testing: a software reliability tool , 1992, ACM-SE 30.

[160]  David L. Dill,et al.  Better verification through symmetry , 1996, Formal Methods Syst. Des..

[161]  Ansi Ieee,et al.  IEEE Standard for Binary Floating Point Arithmetic , 1985 .

[162]  Bruno Legeard,et al.  The V3F project , 2006 .

[163]  Nicos Malevris,et al.  Reducing the Effects of Infeasible Paths in Branch Testing , 1989, Symposium on Testing, Analysis, and Verification.

[164]  Erik Poll,et al.  Towards a Full Formal Specification of the JavaCard API , 2001, E-smart.

[165]  Nancy A. Lynch,et al.  High-level modeling and analysis of TCAS , 1999, Proceedings 20th IEEE Real-Time Systems Symposium (Cat. No.99CB37054).

[166]  Pierre Flener,et al.  Air-Traffic Complexity Resolution in Multi-Sector Planning , 2007 .

[167]  John A. Clark,et al.  Automated program flaw finding using simulated annealing , 1998, ISSTA '98.

[168]  Peter J. Stuckey,et al.  Programming with Constraints: An Introduction , 1998 .

[169]  Philippe Flajolet,et al.  A Calculus for the Random Generation of Labelled Combinatorial Structures , 1994, Theor. Comput. Sci..

[170]  Koushik Sen,et al.  CUTE and jCUTE: Concolic Unit Testing and Explicit Path Model-Checking Tools , 2006, CAV.

[171]  James M. Bieman,et al.  Software reliability growth with test coverage , 2002, IEEE Trans. Reliab..

[172]  Simeon C. Ntafos,et al.  An Evaluation of Random Testing , 1984, IEEE Transactions on Software Engineering.

[173]  Dawson R. Engler,et al.  RWset: Attacking Path Explosion in Constraint-Based Test Generation , 2008, TACAS.

[174]  Sarfraz Khurshid,et al.  Test input generation with java PathFinder , 2004, ISSTA '04.

[175]  Tsong Yueh Chen,et al.  Proportional sampling strategy: a compendium and some insights , 2001, J. Syst. Softw..

[176]  Arnaud Gotlieb Generation automatique de cas de test structurel avec la programmation logique par contraintes , 2000 .

[177]  Pascal Van Hentenryck,et al.  CPBPV: a constraint-programming framework for bounded program verification , 2009, Constraints.

[178]  Thom W. Frühwirth,et al.  Theory and Practice of Constraint Handling Rules , 1998, J. Log. Program..

[179]  Arnaud Gotlieb,et al.  Towards a Theory for Testing Non-terminating Programs , 2009, 2009 33rd Annual IEEE International Computer Software and Applications Conference.

[180]  Matthew B. Dwyer,et al.  Finding feasible abstract counter-examples , 2003, International Journal on Software Tools for Technology Transfer.

[181]  Nikolaj Bjørner,et al.  Model-based Theory Combination , 2008, SMT@CAV.

[182]  Tsong Yueh Chen,et al.  Semi-proving: an integrated method based on global symbolic evaluation and metamorphic testing , 2002, ISSTA '02.

[183]  Arnaud Gotlieb,et al.  Improving Constraint-Based Testing with Dynamic Linear Relaxations , 2007, The 18th IEEE International Symposium on Software Reliability (ISSRE '07).

[184]  Bruno Marre,et al.  Test Selection Strategies for Lustre Descriptions in GATeL , 2005, Electron. Notes Theor. Comput. Sci..

[185]  Peter Schnupp,et al.  Test case generation using Prolog , 1985, ICSE '85.

[186]  Cormac Flanagan,et al.  Automatic software model checking via constraint logic , 2004, Sci. Comput. Program..

[187]  Marie-Claude Gaudel,et al.  Software testing based on formal specifications: a theory and a tool , 1991, Softw. Eng. J..

[188]  Andreas Podelski Model Checking as Constraint Solving , 2000, SAS.

[189]  Simeon C. Ntafos,et al.  On random and partition testing , 1998, ISSTA.