Complexity of Equivalence Class and Boundary Value Testing Methods

There are two groups of domain testing methods – equivalence class testing (ECT) methods and boundary value testing (BVT) methods reviewed in this paper. This paper surveys 17 domain testing methods applicable to domains of independent input parameters of a program. This survey describes the basic algorithms used by domain testing methods for test case generation. The paper focuses on the theoretical bounds of the size of test suites or the complexity of domain testing methods. This paper also includes a subsumption hierarchy that attempts to relate various coverage criteria associated with the identified domain testing methods.

[1]  Cem Kaner,et al.  Lessons learned in software testing ; a context - driven approach , 2002 .

[2]  William E. Perry,et al.  Effective methods for software testing , 1995 .

[3]  Thomas J. Ostrand,et al.  Black‐Box Testing , 2002 .

[4]  Richard G. Hamlet,et al.  Partition Testing Does Not Inspire Confidence , 1990, IEEE Trans. Software Eng..

[5]  Elaine J. Weyuker,et al.  A simplified domain-testing strategy , 1994, TSEM.

[6]  Ye Wu,et al.  Testing and Quality Assurance for Component-Based Software , 2003 .

[7]  Lori A. Clarke,et al.  Partition Analysis: A Method Combining Testing and Verification , 1985, IEEE Transactions on Software Engineering.

[8]  Audris Kalnins,et al.  Construction of Complete Sample System for Correctness Testing , 1975, MFCS.

[9]  William E. Howden,et al.  Methodology for the Generation of Program Test Data , 1975, IEEE Transactions on Computers.

[10]  Robert Culbertson,et al.  Rapid Testing , 2002 .

[11]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[12]  van E.P.W.M. Veenendaal,et al.  The Testing Practitioner , 2007 .

[13]  Shaoying Liu,et al.  An approach to detecting domain errors using formal specification-based testing , 2004, 11th Asia-Pacific Software Engineering Conference.

[14]  Elaine J. Weyuker,et al.  Some observations on partition testing , 1989, TAV3.

[15]  John Watkins,et al.  Testing IT: An Off-the-Shelf Software Testing Process , 2001 .

[16]  John F. Passafiume,et al.  Software testing and evaluation , 1987 .

[17]  Hong Zhu,et al.  Software unit test coverage and adequacy , 1997, ACM Comput. Surv..

[18]  Elaine J. Weyuker,et al.  Comparison of program testing strategies , 1991, TAV4.

[19]  Paul Jorgensen,et al.  Software Testing: A Craftman's Approach , 2001 .

[20]  Ákos Hajnal,et al.  An applicable test data generation algorithm for domain errors , 1998, ISSTA '98.

[21]  Bruce Elliott,et al.  Testing Computer Software , 1994 .

[22]  Lori A. Clarke,et al.  A System to Generate Test Data and Symbolically Execute Programs , 1976, IEEE Transactions on Software Engineering.

[23]  Lori A. Clarke,et al.  A comparison of data flow path selection criteria , 1985, ICSE '85.

[24]  Simeon C. Ntafos,et al.  A Comparison of Some Structural Testing Strategies , 1988, IEEE Trans. Software Eng..

[25]  Raymond McLeod,et al.  Software Testing: Testing Across the Entire Software Development Life Cycle , 2007 .

[26]  Mark Weiser,et al.  Comparison of Structural Test Coverage Metrics , 1985, IEEE Software.

[27]  A. Jefferson Offutt,et al.  Combination testing strategies: a survey , 2005, Softw. Test. Verification Reliab..

[28]  Richard G. Hamlet,et al.  Theoretical comparison of testing methods , 1989, TAV3.

[29]  Michael Hackett,et al.  Testing Applications on the Web: Test Planning for Mobile and Internet-Based Systems , 2003 .

[30]  Stefan P. Jaskiel,et al.  Systematic Software Testing , 2002 .

[31]  Lee J. White,et al.  Testing for linear errors in nonlinear computer programs , 1992, International Conference on Software Engineering.

[32]  Lee J. White,et al.  Detection of linear errors via domain testing , 1992, TSEM.

[33]  John D. McGregor,et al.  A Practical Guide to Testing Object-Oriented Software , 2001, Addison Wesley object technology series.

[34]  Elfriede Dustin.  Effective Software Testing: 50 Ways to Improve Your Software Testing , 2002 .

[35]  Elaine J. Weyuker,et al.  Analyzing Partition Testing Strategies , 1991, IEEE Trans. Software Eng..

[36]  Elaine J. Weyuker,et al.  Selecting Software Test Data Using Data Flow Information , 1985, IEEE Transactions on Software Engineering.

[37]  Lori A. Clarke,et al.  A partition analysis method to increase program reliability , 1981, ICSE '81.

[38]  S. N. Weiss.  Comparing test data adequacy criteria , 1989, SOEN.

[39]  Elaine J. Weyuker,et al.  An Applicable Family of Data Flow Testing Criteria , 1988, IEEE Trans. Software Eng..

[40]  Lee J. White,et al.  A Domain Strategy for Computer Program Testing , 1980, IEEE Transactions on Software Engineering.

[41]  Lori A. Clarke,et al.  A Close Look at Domain Testing , 1982, IEEE Transactions on Software Engineering.

[42]  Lee Copeland,et al.  A Practitioner's Guide to Software Test Design , 2003 .

[43]  Sigrid Eldh.  Software Testing Techniques , 2007 .

[44]  Johannes Link,et al.  Unit Testing in Java: How Tests Drive the Code , 2003 .

[45]  William E. Howden,et al.  Reliability of the Path Analysis Testing Strategy , 1976, IEEE Transactions on Software Engineering.

[46]  Andris Zarins,et al.  SMOTL - A System to Construct Samples for Data Processing Program Debugging , 1979, IEEE Trans. Software Eng..