Functional SOA testing based on constraints

In the fierce competition on today's software market, Service-Oriented Architectures (SOAs) are an established design paradigm. Essential concepts like modularization, reuse, and the corresponding IP core business are inherently supported in the development and operation of SOAs that offer flexibility in many aspects and thus optimal conditions also for heterogeneous system developments. The intrinsics of large and complex SOA enterprises, however, require us to adopt and evolve our verification technology, in order to achieve expected software quality levels. In this paper, we contribute to this challenge by proposing a constraint based testing approach for SOAs. In our work, we augment a SOA's BPEL business model with pre- and postcondition contracts defining essential component traits, and derive a suite of feasible test cases to be executed after assessing its quality via corresponding coverage criteria. We illustrate our approach's viability via a running example as well as experimental results, and discuss current and envisioned automation levels in the context of a test and diagnosis workflow.

[1]  Wil M. P. van der Aalst,et al.  Formal semantics and analysis of control flow in WS-BPEL , 2007, Sci. Comput. Program..

[2]  Philip Mayer,et al.  Towards a BPEL unit testing framework , 2006, TAV-WEB '06.

[3]  Gerardo Canfora,et al.  Service-Oriented Architectures Testing: A Survey , 2009, ISSSE.

[4]  Franz Wotawa,et al.  Fifty Shades of Grey in SOA Testing , 2013, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops.

[5]  Leif Singer,et al.  Calculating BPEL test coverage through instrumentation , 2009, 2009 ICSE Workshop on Automation of Software Test.

[6]  Reiko Heckel,et al.  Towards Contract-based Testing of Web Services , 2005, Electron. Notes Theor. Comput. Sci..

[7]  Franz Wotawa,et al.  On the use of mutations and testing for debugging , 2013, Softw. Pract. Exp..

[8]  Jorge S. Cardoso,et al.  Complexity analysis of BPEL Web processes , 2007, Softw. Process. Improv. Pract..

[9]  Xiaoying Bai,et al.  Contract-Based Testing for Web Services , 2007, 31st Annual International Computer Software and Applications Conference (COMPSAC 2007).

[10]  Paolo Traverso,et al.  Service-Oriented Computing: a Research Roadmap , 2008, Int. J. Cooperative Inf. Syst..

[11]  Ian P. Gent,et al.  Minion: A Fast Scalable Constraint Solver , 2006, ECAI.

[12]  Hanspeter Mössenböck,et al.  Single-pass generation of static single-assignment form for structured languages , 1994, TOPL.

[13]  Fred Kröger,et al.  Temporal Logic of Programs , 1987, EATCS Monographs on Theoretical Computer Science.

[14]  Mohamed Jmaiel,et al.  A QoS-Oriented Reconfigurable Middleware for Self-Healing Web Services , 2008, 2008 IEEE International Conference on Web Services.

[15]  Wei Sun,et al.  A Graph-Search Based Approach to BPEL4WS Test Generation , 2006, 2006 International Conference on Software Engineering Advances (ICSEA'06).

[16]  Wei Sun,et al.  BPEL4WS Unit Testing: Test Case Generation Using a Concurrent Path Analysis Approach , 2006, 2006 17th International Symposium on Software Reliability Engineering.

[17]  Yong Xiao,et al.  Verifying web services composition based on hierarchical colored petri nets , 2005, IHIS '05.

[18]  Yongyan Zheng,et al.  A Model Checking based Test Case Generation Framework forWeb Services , 2007, Fourth International Conference on Information Technology (ITNG'07).

[19]  Francisco Curbera,et al.  Web Services Business Process Execution Language Version 2.0 , 2007 .

[20]  Giovanni Denaro,et al.  Towards self-adaptive service-oriented architectures , 2006, TAV-WEB '06.

[21]  M. Harman,et al.  Testing Web Services : A Survey , 2011 .

[22]  Amit M. Paradkar,et al.  Specify Once Test Everywhere: Analyzing Invariants to Augment Service Descriptions for Automated Test Generation , 2008, ICSOC.

[23]  Arnaud Gotlieb,et al.  Automatic test data generation using constraint solving techniques , 1998, ISSTA '98.

[24]  Omar Rafiq,et al.  Controllability and observability in distributed testing , 1999, Inf. Softw. Technol..

[25]  Gerardo Canfora,et al.  Testing services and service-centric systems: challenges and opportunities , 2006, IT Professional.

[26]  Fatiha Zaïdi,et al.  A Formal Framework for Service Orchestration Testing Based on Symbolic Transition Systems , 2009, TestCom/FATES.

[27]  Abdul Azim Abdul Ghani,et al.  Unit Testing Approaches for BPEL: A Systematic Review , 2009, 2009 16th Asia-Pacific Software Engineering Conference.

[28]  Robert M. Hierons,et al.  Overcoming controllability problems with fewest channels between testers , 2009, Comput. Networks.

[29]  Wenli Dong.  Test Case Generation Method for BPEL-Based Testing , 2009, 2009 International Conference on Computational Intelligence and Natural Computing.

[30]  Bertrand Meyer,et al.  Applying 'design by contract' , 1992, Computer.

[31]  Robert M. Hierons,et al.  The Effect of the Distributed Test Architecture on the Power of Testing , 2008, Comput. J..

[32]  Javier Tuya,et al.  Generating Test Cases Specifications for BPEL Compositions of Web Services Using SPIN , 2006 .

[33]  Franz Wotawa,et al.  SOA Grey Box Testing -- A Constraint-Based Approach , 2013, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops.

[34]  Yongyan Zheng,et al.  An Automatic Test Case Generation Framework for Web Services , 2007, J. Softw..