Fault-based testing in the absence of an oracle

Although testing is the most popular method for assuring software quality, there are two recognized limitations, known as the reliable test set problem and the oracle problem. Fault-based testing is an attempt by Morell to alleviate the reliable test set problem. In this paper, we propose to enhance fault-based testing to address the oracle problem as well. We present an integrated method that combines metamorphic testing with fault-based testing using real and symbolic inputs.

[1]  William E. Howden,et al.  Symbolic Testing and the DISSECT Symbolic Evaluation System , 1977, IEEE Transactions on Software Engineering.

[2]  Larry J Morell,et al.  A Theory of Fault-Based Testing , 1990, IEEE Trans. Software Eng..

[3]  Lindsay Groves,et al.  Program analysis by symbolic execution and generalization , 1992 .

[4]  William E. Howden,et al.  Reliability of the Path Analysis Testing Strategy , 1976, IEEE Transactions on Software Engineering.

[5]  Kireeti Kompella,et al.  Efficient Checkers for Number-Theoretic Computations , 1995, Inf. Comput..

[6]  A.J. Offutt,et al.  Using symbolic execution to aid automatic test data generation , 1990, Fifth Annual Conference on Computer Assurance, Systems Integrity, Software Safety and Process Security..

[7]  Manuel Blum,et al.  Self-testing/correcting with applications to numerical problems , 1990, STOC '90.

[8]  Elaine J. Weyuker,et al.  On Testing Non-Testable Programs , 1982, Comput. J..

[9]  Jian Zhang.  Specification analysis and test data generation by solving Boolean combinations of numeric constraints , 2000, Proceedings First Asia-Pacific Conference on Quality Software.

[10]  Gregg Rothermel,et al.  An experimental determination of sufficient mutant operators , 1996, TSEM.

[11]  Glenford J. Myers,et al.  Art of Software Testing , 1979 .

[12]  A. Jefferson Offutt,et al.  Investigations of the software testing coupling effect , 1992, TSEM.

[13]  Manuel Blum,et al.  Designing programs that check their work , 1989, STOC '89.

[14]  K. S. How Tai Wah,et al.  A theoretical study of fault coupling , 2000, Softw. Test. Verification Reliab..

[15]  A. Jefferson Offutt,et al.  An Empirical Evaluation of Weak Mutation , 1994, IEEE Trans. Software Eng..

[16]  K. S. How Tai Wah.  A Theoretical Study of Fault Coupling , 2000, Softw. Test. Verification Reliab..

[17]  P. David Coward,et al.  The symbolic execution of software - the SYM-BOL system , 1994, Chapman and Hall computer science : research and practice.

[18]  William Stallings,et al.  Cryptography and Network Security: Principles and Practice , 1998 .

[19]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[20]  Felix T.S. Chan,et al.  Application of metamorphic testing in numerical analysis , 1998, ICSE 1998.

[21]  Gary McGraw,et al.  Software fault injection: inoculating programs against errors , 1997 .

[22]  A. Jefferson Offutt,et al.  Constraint-Based Automatic Test Data Generation , 1991, IEEE Trans. Software Eng..

[23]  Marie-Claude Gaudel,et al.  Testing Can Be Formal, Too , 1995, TAPSOFT.