Model-based functional conformance testing of web services operating on persistent data

We propose a model based approach to functional conformance test generation for web services which operate in the presence of persistent data. Typically, web services are described in a standard notation called Web Services Description Language (WSDL). Unfortunately, WSDL standard does not allow behavioral specification (such as pre- and postconditions)of web services in the presence of persistent data. New standards which remedy this situation are being proposed (such as WSDL-S). In this paper, we propose the use of existing test generation techniques based on Extended Finite State Machine (EFSM) specification to address the generation of functional conformance testes for web services which operate on persistent data. The novel contribution of this paper is an algorithm which translates a WSDL-S behavioral specification of operations of a web service into an equivalent EFSM representation which can be exploited to generate an effective set of test cases.

[1]  Leesa Murray,et al.  Formal Derivation of Finite State Machines for Class Testing , 1998, ZUM.

[2]  Amit P. Sheth,et al.  Web Service Semantics - WSDL-S , 2005 .

[3]  Wei-Tek Tsai,et al.  WSDL-based automatic test case generation for Web services testing , 2005, IEEE International Workshop on Service-Oriented System Engineering (SOSE'05).

[4]  Robert M. Hierons,et al.  Testing from a Z Specification , 1997, Softw. Test. Verification Reliab..

[5]  Shaoying Liu,et al.  Generating test data from state‐based specifications , 2003, Softw. Test. Verification Reliab..

[6]  Margus Veanes,et al.  Generating finite state machines from abstract state machines , 2002, ISSTA '02.

[7]  Bruno Legeard,et al.  Generation of functional test sequences from B formal specifications presentation and industrial case-study , 2001, Proceedings 16th Annual International Conference on Automated Software Engineering (ASE 2001).

[8]  Reiko Heckel,et al.  Towards Contract-based Testing of Web Services , 2005, Electron. Notes Theor. Comput. Sci..

[9]  Bruno Legeard,et al.  A Comparison of the BTT and TTF Test-Generation Methods , 2002, ZB.

[10]  Mary Lou Soffa,et al.  Using a goal-driven approach to generate test cases for GUIs , 1999, Proceedings of the 1999 International Conference on Software Engineering (IEEE Cat. No.99CB37002).

[11]  Amit M. Paradkar.  Plannable test selection criteria for FSMs extracted from operational specifications , 2004, 15th International Symposium on Software Reliability Engineering.

[12]  Raymond A. Paul,et al.  Adaptive testing, oracle generation, and test case ranking for Web services , 2005, 29th Annual International Computer Software and Applications Conference (COMPSAC'05).

[13]  Alexander Pretschner,et al.  Model Based Testing for Real: The Inhouse Card Case Study , 2001 .

[14]  Peter Fröhlich,et al.  Automated Test Case Generation from Dynamic Models , 2000, ECOOP.

[15]  Vadim Okun,et al.  Mutation operators for specifications , 2000, Proceedings ASE 2000. Fifteenth IEEE International Conference on Automated Software Engineering.

[16]  Amit M. Paradkar.  Towards model-based generation of self-priming and self-checking conformance tests for interactive systems , 2003, SAC '03.

[17]  Kuo-Chung Tai,et al.  Theory of Fault-Based Predicate Testing for Computer Programs , 1996, IEEE Trans. Software Eng..

[18]  Jeremy Dick,et al.  Automating the Generation and Sequencing of Test Cases from Model-Based Specifications , 1993, FME.

[19]  Adele E. Howe,et al.  Test Case Generation as an AI Planning Problem , 2004, Automated Software Engineering.

[20]  Alan Hartman,et al.  Projected state machine coverage for software testing , 2002, ISSTA '02.

[21]  Reiko Heckel,et al.  Automatic Conformance Testing of Web Services , 2005, FASE.

[22]  Paul Ammann,et al.  Using model checking to generate tests from specifications , 1998, Proceedings Second International Conference on Formal Engineering Methods (Cat.No.98EX241).

[23]  Andrea Polini,et al.  Audition of Web Services for Testing Conformance to Open Specified Protocols , 2004, Architecting Systems with Trustworthy Components.

[24]  Duncan Clarke,et al.  STG: A Symbolic Test Generation Tool , 2002, TACAS.