Generating test cases for web services using data perturbation

Web services have the potential to dramatically reduce the complexities and costs of software integration projects. The most obvious and perhaps most significant difference between Web services and traditional applications is that Web services use a common communication infrastructure, XML and SOAP, to communicate through the Internet. The method of communication introduces complexities to the problems of verifying and validating Web services that do not exist in traditional software. This paper presents a new approach to testing Web services based on data perturbation. Existing XML messages are modified based on rules defined on the message grammars, and then used as tests. Data perturbation uses two methods to test Web services: data value perturbation and interaction perturbation. Data value perturbation modifies values according to the data type. Interaction perturbation classifies the communication messages into two categories: RPC communication and data communication. At present, this method is restricted to peer-to-peer interactions. The paper presents preliminary empirical evidence of its usefulness.

[1]  A. Jefferson Offutt,et al.  Constraint-Based Automatic Test Data Generation , 1991, IEEE Trans. Software Eng..

[2]  A. Jefferson Offutt,et al.  Quality Attributes of Web Software Applications , 2002, IEEE Softw..

[3]  toExcel Extensible Markup Language (Xml) 1.0 Specifications: From the W3c Recommendations , 2000 .

[4]  Clemens A. Szyperski,et al.  Web services engineering: promises and challenges , 2002, Proceedings of the 24th International Conference on Software Engineering. ICSE 2002.

[5]  Boris Beizer,et al.  Software Testing Techniques , 1983 .

[6]  Wenfei Fan,et al.  What's Hard about XML Schema Constraints? , 2002, DEXA.

[7]  Je Outt Quality Attributes of Web Software Applications , 2002 .

[8]  Boris Beizer,et al.  Software testing techniques (2. ed.) , 1990 .

[9]  Boris Chidlovskii,et al.  Using regular tree automata as XML schemas , 2000, Proceedings IEEE Advances in Digital Libraries 2000.

[10]  A. Jefferson Offutt,et al.  Generating test cases for XML-based Web component interactions using mutation analysis , 2001, Proceedings 12th International Symposium on Software Reliability Engineering.

[11]  Joe Clabby Web Services Explained, Solutions and Applications for the Real World , 2002 .

[12]  Raymond A. Paul,et al.  Coyote: an XML-based framework for Web services testing , 2002, 7th IEEE International Symposium on High Assurance Systems Engineering, 2002. Proceedings..

[13]  Makoto Murata,et al.  Hedge automata: a formal model for xml schemata , 1999 .

[14]  Joseph Williams,et al.  The Web services debate: J2EE vs. .NET , 2003, CACM.