Whitening SOA testing

Service Oriented Architectures (SOAs) are becoming increasingly popular and powerful. Fueling that growth is the availability of independent web services that can be cost-effectively composed with other services to provide richer functionality. The reasons that make these systems easier to build, however, also make them more challenging to test. Independent web services usually provide just an interface, enough to invoke them and develop some general (black-box) tests, but insufficient for a tester to develop an adequate understanding of the integration quality between the application and independent web services. To address this lack we propose a "whitening" approach to make web services more transparent through the addition of an intermediate coverage service. The approach, named Service Oriented Coverage Testing (SOCT), provides a tester with feedback about how a whitened service, called a Testable Service, is exercised. In this paper we introduce the SOCT approach, implement an instance of it, and perform a preliminary study to show its feasibility and potential value. SOCT enables SOA white-box testing, while maintaining SOA flexibility, dynamism and loose coupling.

[1]  Andrea Polini,et al.  SOA Test Governance: Enabling Service Integration Testing across Organization and Technology Borders , 2009, 2009 International Conference on Software Testing, Verification, and Validation Workshops.

[2]  Eda Marchetti,et al.  Data Flow-Based Validation of Web Services Compositions: Perspectives and Examples , 2008, WADS.

[3]  Gerardo Canfora,et al.  Search-based testing of service level agreements , 2007, GECCO '07.

[4]  Juan Luo,et al.  Testing Web services by XML perturbation , 2005, 16th IEEE International Symposium on Software Reliability Engineering (ISSRE'05).

[5]  Gregg Rothermel,et al.  Automated Refinement and Augmentation of Web Service Description Files , 2007 .

[6]  T. H. Tse,et al.  Data flow testing of service-oriented workflow applications , 2008, 2008 ACM/IEEE 30th International Conference on Software Engineering.

[7]  Javier Tuya,et al.  Generating Test Cases Specifications for BPEL Compositions of Web Services Using SPIN , 2006 .

[8]  Jun Zhu,et al.  Business-process-driven gray-box SOA testing , 2008, IBM Syst. J..

[9]  Eda Marchetti,et al.  Introducing service-oriented coverage testing , 2008, 2008 23rd IEEE/ACM International Conference on Automated Software Engineering - Workshops.

[10]  Wei Sun,et al.  A Graph-Search Based Approach to BPEL4WS Test Generation , 2006, 2006 International Conference on Software Engineering Advances (ICSEA'06).

[11]  Mohamed Adel Serhani,et al.  Efficient traces' collection mechanisms for passive testing of Web Services , 2009, Inf. Softw. Technol..

[12]  Wei Sun,et al.  BPEL4WS Unit Testing: Test Case Generation Using a Concurrent Path Analysis Approach , 2006, 2006 17th International Symposium on Software Reliability Engineering.

[13]  Mauro Pezzè,et al.  Software testing and analysis - process, principles and techniques , 2007 .

[14]  Francisco Curbera,et al.  Web Services Business Process Execution Language Version 2.0 , 2007 .

[15]  Hernán C. Melgratti,et al.  Testing Service Composition , 2007 .

[16]  Amit M. Paradkar,et al.  Model-based functional conformance testing of web services operating on persistent data , 2006, TAV-WEB '06.

[17]  Rogério de Lemos,et al.  Architecting dependable systems , 2006, J. Syst. Softw..

[18]  Francis G. McCabe,et al.  Reference Model for Service Oriented Architecture 1.0 , 2006 .

[19]  Eda Marchetti,et al.  Systematic Generation of XML Instances to Test Complex Software Applications , 2006, RISE.

[20]  Gregg Rothermel,et al.  Dynamic Characterization of Web Application Interfaces , 2007, FASE.

[21]  Web Team Internal server error , 2006 .

[22]  T. H. Tse,et al.  Testing context-aware middleware-centric programs: a data flow approach and an RFID-based experimentation , 2006, SIGSOFT '06/FSE-14.

[23]  Shi Ying,et al.  Towards Model-based Verification of BPEL with Model Checking , 2006, The Sixth IEEE International Conference on Computer and Information Technology (CIT'06).

[24]  Francesca Lonetti,et al.  Automated testing of healthcare document transformations in the PICASSO interoperability platform , 2009, 2009 31st International Conference on Software Engineering - Companion Volume.

[25]  Gerardo Canfora,et al.  Service-Oriented Architectures Testing: A Survey , 2009, ISSSE.