Evaluating Testing Strategies for Imaging Software by Means of Mutation Analysis

The oracle problem is a crucial part in current research on software testing. In many situations available solutions like partial oracles can be used, however the suitability of a specific oracle depends on the application to be tested. Moreover, the inputs have a considerable impact on the effectiveness of the testing strategy. Therefore selecting an appropriate oracle as well as adequate inputs is essential in order to yield satisfying results.    In the present paper an approach is described that uses Mutation Analysis to assess testing strategies, which implies the determination of suitable inputs and the evaluation of partial oracles. The approach is illustrated using Metamorphic Relations as partial oracles for imaging software.

[1]  Tsong Yueh Chen,et al.  Fault-based testing without the need of oracles , 2003, Inf. Softw. Technol..

[2]  Ying Liu,et al.  Metamorphic Testing and Testing with Special Values , 2004, SNPD.

[3]  Elaine J. Weyuker,et al.  On Testing Non-Testable Programs , 1982, Comput. J..

[4]  Joan L. Mitchell,et al.  JPEG: Still Image Data Compression Standard , 1992 .

[5]  Ralph Guderlei,et al.  Towards Automatic Testing of Imaging Software by Means of Random and Metamorphic Testing , 2007, Int. J. Softw. Eng. Knowl. Eng..

[6]  Richard J. Lipton,et al.  Hints on Test Data Selection: Help for the Practicing Programmer , 1978, Computer.

[7]  Touradj Ebrahimi,et al.  The JPEG 2000 still image compression standard , 2001, IEEE Signal Process. Mag..

[8]  Timothy Alan Budd,et al.  Mutation analysis of program test data , 1980 .

[9]  A. Jefferson Offutt,et al.  MuJava: an automated class mutation system , 2005, Softw. Test. Verification Reliab..

[10]  Tsong Yueh Chen,et al.  Fault-based testing in the absence of an oracle , 2001, 25th Annual International Computer Software and Applications Conference. COMPSAC 2001.

[11]  A. Jefferson Offutt,et al.  Inter-class mutation operators for Java , 2002, 13th International Symposium on Software Reliability Engineering, 2002. Proceedings..

[12]  A. Jefferson Offutt,et al.  Detecting equivalent mutants and the feasible path problem , 1996, Proceedings of 11th Annual Conference on Computer Assurance. COMPASS '96.

[13]  Tsong Yueh Chen,et al.  Metamorphic testing and beyond , 2003, Eleventh Annual International Workshop on Software Technology and Engineering Practice.

[14]  René Just,et al.  Benchmarking Testing Strategies with Tools from Mutation Analysis , 2008, 2008 IEEE International Conference on Software Testing Verification and Validation Workshop.

[15]  Robert V. Binder,et al.  Testing Object-Oriented Systems: Models, Patterns, and Tools , 1999 .

[16]  H. Rice.  Classes of recursively enumerable sets and their decision problems , 1953 .

[17]  Zongyuan Yang,et al.  Metamorphic Testing and Its Applications , 2004 .

[18]  Touradj Ebrahimi,et al.  The JPEG2000 still image coding system: an overview , 2000, IEEE Trans. Consumer Electron..

[19]  K. N. King,et al.  A fortran language system for mutation‐based software testing , 1991, Softw. Pract. Exp..

[20]  Lionel C. Briand,et al.  Is mutation an appropriate tool for testing experiments? , 2005, ICSE.

[21]  Majid Rabbani,et al.  An overview of the JPEG 2000 still image compression standard , 2002, Signal Process. Image Commun..