Search-enhanced testing: NIER track

The prime obstacle to automated defect testing has always been the generation of "correct" results against which to judge the behavior of the system under test - the "oracle problem". So called "back-to-back" testing techniques that exploit the availability of multiple versions of a system to solve the oracle problem have mainly been restricted to very special, safety critical domains such as military and space applications since it is so expensive to manually develop the additional versions. However, a new generation of software search engines that can find multiple copies of software components at virtually zero cost promise to change this situation. They make it economically feasible to use the knowledge locked in reusable software components to dramatically improve the efficiency of the software testing process. In this paper we outline the basic ingredients of such an approach.

[1]  Algirdas A. Avi The Methodology of N-Version Programming , 1995 .

[2]  M.A. Vouk,et al.  On back-to-back testing , 1988, Computer Assurance, 1988. COMPASS '88.

[3]  Colin Atkinson,et al.  Code Conjurer: Pulling Reusable Software out of Thin Air , 2008, IEEE Software.

[4]  Nancy G. Leveson,et al.  An experimental evaluation of the assumption of independence in multiversion programming , 1986, IEEE Transactions on Software Engineering.

[5]  Luciano Baresi,et al.  An Introduction to Software Testing , 2006, FoVMT.

[6]  Colin Atkinson,et al.  Automated Creation and Assessment of Component Adapters with Test Cases , 2010, CBSE.

[7]  Steven P. Reiss,et al.  Semantics-based code search , 2009, 2009 IEEE 31st International Conference on Software Engineering.