Testing Web Services

Web Services form the basis, not only of standard web based eCommerce applications but also the new Globus implementation of Open GRID Systems Architecture (OGSA). Given the prominence of this technology, test methods and tools are required to ensure that robust, fault tolerant software services are deployed. Testing is required not only to uncover existing problems with the system but to also provide potential users with metrics to compare similar serviced based solutions. Fault injection is a well-proven method of assessing the dependability of a system. Although much work has been done in the area of fault injection and distributed systems in general, there appears to have been little research carried out on applying this to web service based systems [1, 2]. Previous research in the field of service testing via fault injection has concentrated on tightly coupled, RPC based distributed systems [1]. In defining a testing method for web services new sets of challenges are faced which require different solutions. Key differences that are encountered when testing web services are: (1) greater chance for network failure, (2) higher levels of security and encryption, (3) more generic nature of the platform and the need to support multiple programming languages, (4) timing constrains and the asynchronous nature of web service operations. This is due to the loosely coupled nature of typical SOAP based systems that implement services.

[1]  Jean Arlat,et al.  Dependability of CORBA systems: service characterization by fault injection , 2002, 21st IEEE Symposium on Reliable Distributed Systems, 2002. Proceedings..

[2]  Ravishankar K. Iyer,et al.  Failure data analysis of a LAN of Windows NT based computers , 1999, Proceedings of the 18th IEEE Symposium on Reliable Distributed Systems.

[3]  Pascale Thévenod-Fosse,et al.  Software error analysis: a real case study involving real faults and mutations , 1996, ISSTA '96.

[4]  Jie Xu,et al.  Assessing the Dependability of SOAP RPC-Based Web Services by Fault Injection , 2003, 2003 The Ninth IEEE International Workshop on Object-Oriented Real-Time Dependable Systems.

[5]  Jie Xu,et al.  Assessing the dependability of OGSA middleware by fault injection , 2003, 22nd International Symposium on Reliable Distributed Systems, 2003. Proceedings..

[6]  Jacob A. Abraham,et al.  FERRARI: a tool for the validation of system dependability properties , 1992, [1992] Digest of Papers. FTCS-22: The Twenty-Second International Symposium on Fault-Tolerant Computing.

[7]  Henrique Madeira,et al.  Xception: A Technique for the Experimental Evaluation of Dependability in Modern Computers , 1998, IEEE Trans. Software Eng..

[8]  Marco Vieira,et al.  On the emulation of software faults by software fault injection , 2000, Proceeding International Conference on Dependable Systems and Networks. DSN 2000.