Automated Mutation-Based Test Case Evaluation for Semantic Web Services

Semantic Web Services (SWS) introduce a semantic layer to the current web infrastructure, enabling the automated processing of web service tasks. In the past decade, various frameworks have been proposed for designing SWS. However, few of them aimed at testing SWS. Generating test cases for SWS is challenging due to its dynamic nature and abstract views, evaluating the test cases is equally essential in order to ensure the quality of the test suite. In this paper, we propose a mutation based evaluation approach to measuring the quality of test cases for SWS. Furthermore, we develop a tool support to automate the steps in the proposed solution. Finally, the approach is applied to the Amazon E-Commerce Service as a real world case study.

[1]  Yinong Chen,et al.  Automatic Mutation Testing and Simulation on OWL-S Specified Web Services , 2008, 41st Annual Simulation Symposium (anss-41 2008).

[2]  Taratip Suwannasart,et al.  An Improved Test Case Generation Method for Web Service Testing from WSDL-S and OCL with Pair-Wise Testing Technique , 2009, 2009 33rd Annual IEEE International Computer Software and Applications Conference.

[3]  S. Ranville,et al.  Winnowing tests: Getting quality coverage from a model checker without quantity , 2001, 20th DASC. 20th Digital Avionics Systems Conference (Cat. No.01CH37219).

[4]  Rui Wang,et al.  Requirement Model-Based Mutation Testing for Web Service , 2008, 2008 4th International Conference on Next Generation Web Services Practices.

[5]  Eugene H. Spafford,et al.  The Mothra tool set (software testing) , 1989, [1989] Proceedings of the Twenty-Second Annual Hawaii International Conference on System Sciences. Volume II: Software Track.

[6]  A. Jefferson Offutt,et al.  Experimental results from an automatic test case generator , 1993, TSEM.

[7]  Lu Zhang,et al.  A framework for testing Web services and its supporting tool , 2005, IEEE International Workshop on Service-Oriented System Engineering (SOSE'05).

[8]  Jing Sun,et al.  A Framework for Testing Semantic Web Services Using Model Checking , 2009, 2009 Fourth South-East European Workshop on Formal Methods.

[9]  Gregg Rothermel,et al.  An experimental determination of sufficient mutant operators , 1996, TSEM.

[10]  Yongzhao Zhan,et al.  A Web services vulnerability testing approach based on combinatorial mutation and SOAP message mutation , 2014, Service Oriented Computing and Applications.

[11]  A. Jefferson Offutt,et al.  MuJava: a mutation system for java , 2006, ICSE.

[12]  Gillian Dobbie,et al.  Towards Specification Based Testing for Semantic Web Services , 2009, 2009 Australian Software Engineering Conference.

[13]  S. Kanmani,et al.  Test Suite Minimization using Hybrid Algorithm for GA generated Test Cases , 2013, BIOINFORMATICS 2013.

[14]  Simeon C. Ntafos,et al.  An Evaluation of Random Testing , 1984, IEEE Transactions on Software Engineering.

[15]  Amit M. Paradkar,et al.  Automated Functional Conformance Test Generation for Semantic Web Services , 2007, IEEE International Conference on Web Services (ICWS 2007).

[16]  Mike Papadakis,et al.  Automatic Mutation Test Case Generation via Dynamic Symbolic Execution , 2010, 2010 IEEE 21st International Symposium on Software Reliability Engineering.

[17]  Nashat Mansour,et al.  Testing Web services , 2005, The 3rd ACS/IEEE International Conference onComputer Systems and Applications, 2005..

[18]  Siddhartha R. Dalal,et al.  Model-based testing in practice , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[19]  David A. Carrington,et al.  A Framework for Specification-Based Testing , 1996, IEEE Trans. Software Eng..