An Application of Software Fault Injection for Assessment of Quality of Test Sets for Business Processes Orchestrating Web-Services

The paper presents an experiment of the application of software fault injection to assess quality of test sets for business processes orchestrating web-services. The mutation testing, usually used to this end, suffers from high computational costs of generating and running mutants. In contrast to mutation testing, faults injection can be performed at a run-time. Run-time changes are introduced by a Software Fault Injector for BPEL Processes (SFIBP). SFIBP is implemented as a special service that manipulates invocations of webservices and values of their internal variables. As for time requirements, the experiment proved high superiority of the application of the SFIBP over the mutation testing.

[1]  Schahram Dustdar,et al.  Programmable Fault Injection Testbeds for Complex SOA , 2010, ICSOC.

[2]  Morgan B Kaufmann,et al.  Mutation Testing for the New Century , 2002, Computer.

[3]  Hang Yu,et al.  Testing BPEL-based Web Service Composition Using High-level Petri Nets , 2006, 2006 10th IEEE International Enterprise Distributed Object Computing Conference (EDOC'06).

[4]  Krzysztof Sapiecha,et al.  Automating Test Case Generation for Requirements Specification for Processes Orchestrating Web Services , 2008, ICEIS.

[5]  Yaron Goland,et al.  Web Services Business Process Execution Language , 2009, Encyclopedia of Database Systems.

[6]  Alfredo Benso,et al.  Fault Injection Techniques and Tools for Embedded Systems , 2003 .

[7]  Wei Sun,et al.  A Graph-Search Based Approach to BPEL4WS Test Generation , 2006, 2006 International Conference on Software Engineering Advances (ICSEA'06).

[8]  Wei Sun,et al.  BPEL4WS Unit Testing: Test Case Generation Using a Concurrent Path Analysis Approach , 2006, 2006 17th International Symposium on Software Reliability Engineering.

[9]  Philip Mayer,et al.  Towards a BPEL unit testing framework , 2006, TAV-WEB '06.

[10]  M. R. Woodward,et al.  Mutation testing - its origin and evolution , 1993, Inf. Softw. Technol..

[11]  Stefan Wagner,et al.  Multi-Dimensional Measures for Test Case Quality , 2008, 2008 IEEE International Conference on Software Testing Verification and Validation Workshop.

[12]  Chiou Peng Lam,et al.  Evolving the Quality of a Model Based Test Suite , 2009, 2009 International Conference on Software Testing, Verification, and Validation Workshops.