Cost-aware pareto optimal test suite minimisation for service-centric systems

Runtime testing cost caused by service invocations is considered as one of the major limitations in Service-centric System Testing (ScST). Unfortunately, most of the existing work cannot achieve cost reduction at runtime as they perform offline testing. In this paper, we introduce a novel cost-aware pareto optimal test suite minimisation approach for ScST aimed at reducing runtime testing cost. In experimental analysis, the proposed approach achieved reductions between 69% and 98.6% in monetary cost of service invocations while retaining test suite coverage. The results also provided evidence for the effectiveness of the selected algorithm HNSGA-II over the two commonly used algorithms: Greedy and NSGA-II.

[1]  Joachim Wegener,et al.  Evolutionary test environment for automatic structural testing , 2001, Inf. Softw. Technol..

[2]  Mark Harman,et al.  Testing and verification in service‐oriented architecture: a survey , 2013, Softw. Test. Verification Reliab..

[3]  Xusheng Xiao.  Problem identification for structural test generation: first step towards cooperative developer testing , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[4]  Mark Harman,et al.  Regression testing minimization, selection and prioritization: a survey , 2012, Softw. Test. Verification Reliab..

[5]  Mark Harman,et al.  Using hybrid algorithm for Pareto efficient multi-objective test suite minimisation , 2010, J. Syst. Softw..

[6]  Mark Harman,et al.  Regression Testing Minimisation, Selection and Prioritisation - A Survey , 2009 .

[7]  Mark Harman,et al.  Optimised Realistic Test Input Generation Using Web Services , 2012, SSBSE.

[8]  Wei Sun,et al.  BPEL4WS unit testing: framework and implementation , 2005, IEEE International Conference on Web Services (ICWS'05).

[9]  Valentin Pavlov,et al.  A Composable Framework for Test Automation of Service-Based Applications , 2010, 2010 Seventh International Conference on the Quality of Information and Communications Technology.

[10]  Mark Harman,et al.  Automatically generating realistic test input from web services , 2011, Proceedings of 2011 IEEE 6th International Symposium on Service Oriented System (SOSE).

[11]  Tao Xie,et al.  Time-aware test-case prioritization using integer linear programming , 2009, ISSTA.

[12]  Mark Harman.  Making the Case for MORTO: Multi Objective Regression Test Optimization , 2011, 2011 IEEE Fourth International Conference on Software Testing, Verification and Validation Workshops.

[13]  Zhendong Su,et al.  Synthesizing method sequences for high-coverage testing , 2011, OOPSLA '11.

[14]  Saurabh Sinha,et al.  Efficient Testing of Service-Oriented Applications Using Semantic Service Stubs , 2009, 2009 IEEE International Conference on Web Services.

[15]  Hassan Reza,et al.  A Framework for Testing RESTful Web Services , 2010, 2010 Seventh International Conference on Information Technology: New Generations.

[16]  Hong Zhu,et al.  A Framework for Service-Oriented Testing of Web Services , 2006, 30th Annual International Computer Software and Applications Conference (COMPSAC'06).

[17]  M. Harman,et al.  Testing & Verification In Service-Oriented Architecture : A Survey , 2012 .

[18]  Manuel Palomo-Duarte,et al.  Takuan: A Tool for WS-BPEL Composition Testing Using Dynamic Invariant Generation , 2010, ICWE.

[20]  Philip Mayer,et al.  Towards a BPEL unit testing framework , 2006, TAV-WEB '06.

[21]  Gerardo Canfora,et al.  Service-Oriented Architectures Testing: A Survey , 2009, ISSSE.

[22]  Tao Xie,et al.  Quota-constrained test-case prioritization for regression testing of service-centric systems , 2008, 2008 IEEE International Conference on Software Maintenance.