Cost Reduction through Combining Test Sequences with Input Data

Nowadays computer applications mainly depend on input data that bear additional constraints to be considered and evaluated carefully. Very often, this invokes test sequences that describe the path to the place where input data is to be entered, e.g., while testing graphical user interactions. Model based testing allows deriving those test sequences from a model, for example, based on event sequence graphs (ESGs) where the nodes represent events. Unfortunately, combining ESG with the great variety of input data considerably inflates them with respect to the number of their nodes. To avoid this event inflation, previous work extended ESGs by decision tables to take this variety and constraints on input data into account. This paper extends the previous work and shows how to derive input data-supplemented test sequences and, at the same time, to considerably reduce effort for test generation and test execution. A case study drawn from a large commercial web portal evaluates the approach and analyzes its characteristics.

[1]  Dániel Marx,et al.  Constraint satisfaction problems and global cardinality constraints , 2010, Commun. ACM.

[2]  Jon Edvardsson,et al.  A Survey on Automatic Test Data Generation , 2002 .

[3]  A. Jefferson Offutt,et al.  Testing Web applications by modeling with FSMs , 2005, Software & Systems Modeling.

[4]  Arnaud Gotlieb,et al.  Automatic test data generation using constraint solving techniques , 1998, ISSTA '98.

[5]  Theo Tryfonas,et al.  Frontiers in Artificial Intelligence and Applications , 2009 .

[6]  Arne-Michael Torsel Automated Test Case Generation for Web Applications from a Domain Specific Model , 2011, COMPSAC 2011.

[7]  V. Lakshmi Narasimhan,et al.  ADTEST: A Test Data Generation Suite for Ada Software Systems , 1997, IEEE Trans. Software Eng..

[8]  Marc J. Balcer,et al.  The category-partition method for specifying and generating fuctional tests , 1988, CACM.

[9]  Fevzi Belli,et al.  Event‐based modelling, analysis and testing of user interactions: approach and case study , 2006, Softw. Test. Verification Reliab..

[10]  Harold W. Thimbleby,et al.  The directed Chinese Postman Problem , 2003, Softw. Pract. Exp..

[11]  Bogdan Korel,et al.  The chaining approach for software test data generation , 1996, TSEM.

[12]  Inês Lynce,et al.  CSP2SAT4J: A Simple CSP to SAT translator , 2007 .

[13]  Peter Norvig,et al.  Artificial Intelligence: A Modern Approach , 1995 .

[14]  Fevzi Belli,et al.  Finite state testing and analysis of graphical user interfaces , 2001, Proceedings 12th International Symposium on Software Reliability Engineering.

[15]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[16]  Khaled Ghédira,et al.  Constraint Satisfaction Problems: Ghédira/Constraint Satisfaction Problems , 2013 .

[17]  Lee J. White,et al.  Generating test cases for GUI responsibilities using complete interaction sequences , 2000, Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000.

[18]  F. Belli,et al.  On “ Negative ” Tests of Web Applications , 2007 .

[19]  Peter Norvig,et al.  Artificial intelligence - a modern approach, 2nd Edition , 2003, Prentice Hall series in artificial intelligence.

[20]  David L. Parnas,et al.  On the use of transition diagrams in the design of a user interface for an interactive computer system , 1969, ACM '69.

[21]  A. Jefferson Offutt,et al.  Combination testing strategies: a survey , 2005, Softw. Test. Verification Reliab..

[22]  D. West Introduction to Graph Theory , 1995 .

[23]  A. Jefferson Offutt,et al.  Constraint-Based Automatic Test Data Generation , 1991, IEEE Trans. Software Eng..

[24]  Matthias Grochtmann,et al.  Classification trees for partition testing , 1993, Softw. Test. Verification Reliab..

[25]  Robert V. Binder,et al.  Testing Object-Oriented Systems: Models, Patterns, and Tools , 1999 .

[26]  Fevzi Belli,et al.  Test minimization for human-computer interaction , 2006, Applied Intelligence.

[27]  Jian Zhang Specification analysis and test data generation by solving Boolean combinations of numeric constraints , 2000, Proceedings First Asia-Pacific Conference on Quality Software.