Combining behavior and data modeling in automated test case generation

Software testing plays a critical role in the process of creating and delivering high-quality software products. Manual software testing can be an expensive, tedious and error-prone process, therefore testing is often automated in an attempt to reduce its cost and improve its defect detection capability. Model-based testing, a technique used in automated test case generation, is an important topic because it addresses the need for test suites that are of high-quality and yet, maintainable. Current model-based techniques often use a single model to represent system behavior. Using a single model may restrict the number and type of test cases that may be generated. In this paper, system-level test case generation is accomplished using two models to represent system behavior. The results of case studies used to evaluate this technique indicate that for the systems studied a larger percentage of the required test cases can be generated using the combined modeling approach.

[1]  Tsun S. Chow,et al.  Testing Software Design Modeled by Finite-State Machines , 1978, IEEE Transactions on Software Engineering.

[2]  Sean McDonald,et al.  Software Test Automation , 1999 .

[3]  Claude Caci,et al.  Testing object-oriented systems , 2000, SOEN.

[4]  Bogdan Korel,et al.  Generating expected results for automated black-box testing , 2002, Proceedings 17th IEEE International Conference on Automated Software Engineering,.

[5]  Thomas J. Ostrand,et al.  Black‐Box Testing , 2002 .

[6]  D. M. Hutton,et al.  Software Test Automation: Effective Use of Test Execution Tools , 2000 .

[7]  K. Burr,et al.  Combinatorial Test Techniques : Table-based Automation , Test Generation and Code Coverage , 1998 .

[8]  Jim Clarke.  Automated test generation from a behavioral model , 1998 .

[9]  John Paul,et al.  Automated Software Testing: Introduction, Management, and Performance , 1999 .

[10]  James A. Whittaker,et al.  Model‐Based Software Testing , 2002 .

[11]  Mark Blackburn,et al.  Automatic generation of test vectors for SCR-style specifications , 1997, Proceedings of COMPASS '97: 12th Annual Conference on Computer Assurance.

[12]  L. Apfelbaum.  Spec-based tests make sure telecom software works , 1997 .

[13]  John D. Musa,et al.  Operational profiles in software-reliability engineering , 1993, IEEE Software.

[14]  Michael L. Fredman,et al.  The AETG System: An Approach to Testing Based on Combinatiorial Design , 1997, IEEE Trans. Software Eng..

[15]  D.M. Cohen,et al.  The Combinatorial Design Approach to Automatic Test Generation , 1996, IEEE Softw..

[16]  Ashish Jain,et al.  Model-based testing of a highly programmable system , 1998, Proceedings Ninth International Symposium on Software Reliability Engineering (Cat. No.98TB100257).

[17]  Cem Kaner,et al.  Testing Computer Software , 1988 .

[18]  Bogdan Korel,et al.  Black-box test reduction using input-output analysis , 2000, ISSTA '00.

[19]  Stefan P. Jaskiel,et al.  Systematic Software Testing , 2002 .

[20]  Bogdan Korel.  The Program Dependence Graph in Static Program Testing , 1987, Inf. Process. Lett..

[21]  Siddhartha R. Dalal,et al.  The Automatic Efficient Test Generator (AETG) system , 1994, Proceedings of 1994 IEEE International Symposium on Software Reliability Engineering.

[22]  Siddhartha R. Dalal,et al.  Model-based testing in practice , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[23]  C. J. Burgess,et al.  Software testing using an automatic generator of test data , 1970 .

[24]  Amit M. Paradkar.  SALT-an integrated environment to automate generation of function tests for APIs , 2000, Proceedings 11th International Symposium on Software Reliability Engineering. ISSRE 2000.