Metamorphic Testing: Applications and Integration with Other Methods: Tutorial Synopsis

In software testing, an oracle refers to a mechanism against which testers can decide whether or not outcomes of test case executions are correct. The oracle problem refers to situations when either an oracle is not available, or it is too expensive to apply. Metamorphic testing has emerged as an effective and efficient approach to alleviating the oracle problem. This article introduces the basic concepts and procedures of metamorphic testing, and gives examples to show its applications, and integration with other methods.

[1]  Elaine J. Weyuker,et al.  On Testing Non-Testable Programs , 1982, Comput. J..

[2]  Sergio Segura,et al.  Automated metamorphic testing on the analyses of feature models , 2011, Inf. Softw. Technol..

[3]  Tsong Yueh Chen,et al.  Semi-proving: an integrated method based on global symbolic evaluation and metamorphic testing , 2002, ISSTA '02.

[4]  Tsong Yueh Chen,et al.  Semi-Proving: An Integrated Method for Program Proving, Testing, and Debugging , 2011, IEEE Transactions on Software Engineering.

[5]  Tsong Yueh Chen,et al.  Automatic Verification of Optimization Algorithms: a Case Study of a Quadratic Assignment Problem Solver , 2008, Int. J. Softw. Eng. Knowl. Eng..

[6]  Larry J Morell,et al.  A Theory of Fault-Based Testing , 1990, IEEE Trans. Software Eng..

[7]  Baowen Xu,et al.  Spectrum-Based Fault Localization: Testing Oracles are No Longer Mandatory , 2011, 2011 11th International Conference on Quality Software.

[8]  Gail E. Kaiser,et al.  Properties of Machine Learning Applications for Use in Metamorphic Testing , 2008, SEKE.

[9]  Tsong Yueh Chen,et al.  Case studies on the selection of useful relations in metamorphic testing , 2004 .

[10]  Tsong Yueh Chen,et al.  Automated functional testing of online search services , 2012, Softw. Test. Verification Reliab..

[11]  Tsong Yueh Chen,et al.  Testing embedded software by metamorphic testing: A wireless metering system case study , 2011, 2011 IEEE 36th Conference on Local Computer Networks.

[12]  Tsong Yueh Chen,et al.  Fault-based testing without the need of oracles , 2003, Inf. Softw. Technol..

[13]  Dianxiang Xu,et al.  Metamorphic testing of a Monte Carlo modeling program , 2011, AST '11.