Fault Injection for Performance Testing of Composite Web Services

Fault injection has already been used to access the dependability of web services. However, most of the existing work focuses on how to inject faults. Problems such as where to inject faults and what faults should be injected still have not been systematically studied in literature, especially for the testing of performance related issues in composite web services. This paper presents an approach that defines coverage criteria to guide fault injection testing of performance related issues in composite web services. We generate fault injection configurations that follows the defined test criteria for systematic fault injection. The configurations specify where to inject faults and what faults should be injected, and the injected faults (e.g. message delays) are generated according to the characteristics of each individual sub-service in order to make the faults more realistic. With the fault injection configurations, the fault injection process can be automatically conducted and the performance of a composite service can be effectively evaluated.

[1]  Nuno Laranjeiro,et al.  Assessing Robustness of Web-Services Infrastructures , 2007, 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks (DSN'07).

[2]  Mark Harman,et al.  Testing and verification in service‐oriented architecture: a survey , 2013, Softw. Test. Verification Reliab..

[3]  Ravishankar K. Iyer,et al.  Failure Diagnosis for Distributed Systems Using Targeted Fault Injection , 2017, IEEE Transactions on Parallel and Distributed Systems.

[4]  Krzysztof Sapiecha,et al.  A Fault Injection Based Approach to Assessment of Quality of Test Sets for BPEL Processes , 2013, ENASE.

[5]  Nuno Laranjeiro,et al.  A robustness testing approach for SOAP Web services , 2012, Journal of Internet Services and Applications.

[6]  Ahmed E. Hassan,et al.  A Survey on Load Testing of Large-Scale Software Systems , 2015, IEEE Transactions on Software Engineering.

[7]  Dessislava Petrova-Antonova,et al.  faultInjector: A Tool for Injection of Faults in Synchronous WS-BPEL Processes , 2011, 2011 Second Eastern European Regional Conference on the Engineering of Computer Based Systems.

[8]  Philipp Reinecke,et al.  The Fast and the Fair: A Fault-Injection-Driven Comparison of Restart Oracles for Reliable Web Services , 2006, Third International Conference on the Quantitative Evaluation of Systems - (QEST'06).

[9]  Schahram Dustdar,et al.  Programmable Fault Injection Testbeds for Complex SOA , 2010, ICSOC.

[10]  Ana R. Cavalli,et al.  A Fault Injection Tool for Testing Web Services Composition , 2010, TAIC PART.

[11]  Jie Xu,et al.  Assessing the Dependability of SOAP RPC-Based Web Services by Fault Injection , 2003, 2003 The Ninth IEEE International Workshop on Object-Oriented Real-Time Dependable Systems.

[12]  Lu Zhang,et al.  A framework for testing Web services and its supporting tool , 2005, IEEE International Workshop on Service-Oriented System Engineering (SOSE'05).

[13]  Jie Xu,et al.  Evaluating the Dependability of Dynamic Binding in Web Services , 2012, 2012 IEEE 14th International Symposium on High-Assurance Systems Engineering.

[14]  Guido Wirtz,et al.  Towards a Robustness Evaluation Framework for BPEL Engines , 2014, 2014 IEEE 7th International Conference on Service-Oriented Computing and Applications.

[15]  Roberto Passerone,et al.  Dependability Assessment of SOA-Based CPS With Contracts and Model-Based Fault Injection , 2018, IEEE Transactions on Industrial Informatics.

[16]  W. Chan,et al.  Preemptive Regression Testing of Workflow-based Web Services , 2014 .

[17]  Valentin Pavlov,et al.  An Automated Approach for Fault Injection Testing of BPEL Orchestrations , 2013, EuroSPI.

[18]  Hyeon Soo Kim,et al.  Robustness testing framework for Web services composition , 2009, 2009 IEEE Asia-Pacific Services Computing Conference (APSCC).

[19]  Domenico Cotroneo,et al.  Assessing Dependability with Software Fault Injection , 2016, ACM Comput. Surv..

[20]  Schahram Dustdar,et al.  Testbeds for Emulating Dependability Issues of Mobile Web Services , 2010, 2010 6th World Congress on Services.

[21]  Maria Grazia Fugini,et al.  Quality analysis of composed services through fault injection , 2009, Inf. Syst. Frontiers.

[22]  Fuyuki Ishikawa,et al.  Business Semantics Centric Reliability Testing for Web Services in BPEL , 2010, 2010 6th World Congress on Services.