The application of iterative interval arithmetic in path-wise test data generation

Research of path-wise test data generation is crucial and challenging in the area of software testing, which can be formulated as a constraint satisfaction problem. In our previous research, a look-ahead search method has been proposed as the constraint solver for path-wise test data generation. This paper analytically studies interval arithmetic of the search method in detail, which enforces arc consistency, and introduces the iterative operator to improve it, aiming at detecting infeasible paths as well as shortening generation time. Experiments were conducted to compare the iterative operator with the classical look-ahead operator AC-3, and to compare the test data generation method using the iterative operator with some currently existing methods. Experimental results validate the effectiveness and practical deployment of the proposed iterative method, and demonstrate that it is applicable in engineering.

[1]  Dawson R. Engler,et al.  KLEE: Unassisted and Automatic Generation of High-Coverage Tests for Complex Systems Programs , 2008, OSDI.

[2]  Patrick Cousot,et al.  Abstract Interpretation Based Formal Methods and Future Challenges , 2001, Informatics.

[3]  Mark Harman,et al.  Empirical Study on the Efficiency of Search Based Test Generation for EFSM Models , 2010, 2010 Third International Conference on Software Testing, Verification, and Validation Workshops.

[4]  Krzysztof Leśniak,et al.  Central European Journal of Mathematics Invariant sets and Knaster – Tarski principle Review Article , 2012 .

[5]  Bernhard K. Aichernig,et al.  Survey on test data generation tools , 2013, International Journal on Software Tools for Technology Transfer.

[6]  宫云战,et al.  A Method of Test Case Generation Based on Necessary Interval Set , 2013 .

[7]  Patrick Prosser,et al.  Maintaining Singleton Arc-Consistency , 2006 .

[8]  A. Jefferson Offutt,et al.  Constraint-Based Automatic Test Data Generation , 1991, IEEE Trans. Software Eng..

[9]  Alfredo Vaccaro,et al.  A Novel Affine Arithmetic Method to Solve Optimal Power Flow Problems With Uncertainties , 2014, IEEE Transactions on Power Systems.

[10]  V. Lakshmi Narasimhan,et al.  ADTEST: A Test Data Generation Suite for Ada Software Systems , 1997, IEEE Trans. Software Eng..

[11]  Mary Lou Soffa,et al.  UNA based iterative test data generation and its evaluation , 1999, 14th IEEE International Conference on Automated Software Engineering.

[12]  Alan K. Mackworth Consistency in Networks of Relations , 1977, Artif. Intell..

[13]  R. Baker Kearfott,et al.  Introduction to Interval Analysis , 2009 .

[14]  Ying Xing,et al.  A Hybrid Intelligent Search Algorithm for Automatic Test Data Generation , 2015 .

[15]  Irman Hermadi,et al.  Dynamic stopping criteria for search-based test data generation for path testing , 2014, Inf. Softw. Technol..

[16]  Chengying Mao,et al.  Swarm Intelligence-Based Test Data Generation for Structural Testing , 2012, 2012 IEEE/ACIS 11th International Conference on Computer and Information Science.

[17]  Volker Gruhn,et al.  BINTEST - Binary Search-based Test Case Generation , 2003 .

[18]  Rina Dechter,et al.  Look-Ahead Value Ordering for Constraint Satisfaction Problems , 1995, IJCAI.

[19]  Shan Jin Survey on Path-Wise Automatic Generation of Test Data , 2004 .

[20]  Elsayed A. Elsayed,et al.  Overview of Reliability Testing , 2012, IEEE Transactions on Reliability.

[21]  Thomas Eiter,et al.  Hex Semantics via Approximation Fixpoint Theory , 2013, LPNMR.

[22]  Martin C. Cooper,et al.  Soft arc consistency revisited , 2010, Artif. Intell..

[23]  Elaine J. Weyuker,et al.  Evaluation techniques for improving the quality of very large software systems in a cost-effective way , 1999, J. Syst. Softw..

[24]  Ying Xing,et al.  Path-Wise Test Data Generation Based on Heuristic Look-Ahead Methods , 2014 .

[25]  Phil McMinn,et al.  Search‐based software test data generation: a survey , 2004, Softw. Test. Verification Reliab..

[26]  Gregor Snelting,et al.  Efficient path conditions in dependence graphs , 2002, ICSE '02.

[27]  Andrea Schaerf,et al.  Combining Local Search and Look-Ahead for Scheduling and Constraint Satisfaction Problems , 1997, IJCAI.

[28]  Teresa Zielinska,et al.  A hierarchical CSP search for path planning of cooperating self-reconfigurable mobile fixtures , 2014, Eng. Appl. Artif. Intell..

[29]  Richard J. Wallace,et al.  Why AC-3 is Almost Always Better than AC4 for Establishing Arc Consistency in CSPs , 1993, IJCAI.

[30]  Antonia Bertolino,et al.  Software Testing Research: Achievements, Challenges, Dreams , 2007, Future of Software Engineering (FOSE '07).

[31]  Ramon E. Moore Methods and applications of interval analysis , 1979, SIAM studies in applied mathematics.

[32]  Gwan-Hwan Hwang,et al.  Statement-Coverage Testing for Concurrent Programs in Reachability Testing , 2014, J. Inf. Sci. Eng..

[33]  Ajitha Rajan,et al.  The effect of program and model structure on mc/dc test adequacy coverage , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[34]  Gordon Fraser,et al.  EvoSuite: automatic test suite generation for object-oriented software , 2011, ESEC/FSE '11.

[35]  Patrick Cousot,et al.  Static determination of dynamic properties of programs , 1976 .