A Metamorphic Testing Approach for Online Testing of Service-Oriented Software Applications

Testing the correctness of services assures the functional quality of service-oriented applications. A service-oriented application may bind dynamically to its supportive services. For the same service interface, the supportive services may behave differently. A service may also need to realize a business strategy, like best pricing, relative to the behavior of its counterparts and the dynamic market situations. Many existing works ignore these issues to address the problem of identifying failures from test results. This article proposes a metamorphic approach for online services testing. The off-line testing determines a set of successful test cases to construct their corresponding follow-up test cases for the online testing. These test cases will be executed by metamorphic services that encapsulate the services under test as well as the implementations of metamorphic relations. Thus, any failure revealed by the metamorphic testing approach will be due to the failures in the online testing mode. An experiment is included. Copyright

[1]  Jim Melton,et al.  XML schema , 2003, SGMD.

[2]  Reiko Heckel,et al.  Towards Contract-based Testing of Web Services , 2005, Electron. Notes Theor. Comput. Sci..

[3]  Jean Jacques Moreau,et al.  SOAP Version 1. 2 Part 1: Messaging Framework , 2003 .

[4]  Shing-Chi Cheung,et al.  Fault-based testing of database application programs with conceptual data model , 2005, Fifth International Conference on Quality Software (QSIC'05).

[5]  Mary Lou Soffa,et al.  A family of test adequacy criteria for database-driven applications , 2003, ESEC/FSE-11.

[6]  Raymond A. Paul,et al.  Adaptive testing, oracle generation, and test case ranking for Web services , 2005, 29th Annual International Computer Software and Applications Conference (COMPSAC'05).

[7]  A. Jefferson Offutt,et al.  Generating test cases for web services using data perturbation , 2004, SOEN.

[8]  Robert Richards,et al.  Universal Description, Discovery, and Integration (UDDI) , 2006 .

[9]  Massimo Mecella,et al.  Designing wrapper components for e-services in integrating heterogeneous systems , 2001, The VLDB Journal.

[10]  Schahram Dustdar,et al.  Testing of Service-Oriented Architectures - A Practical Approach , 2004, Net.ObjectDays.

[11]  Tsong Yueh Chen,et al.  Semi-proving: an integrated method based on global symbolic evaluation and metamorphic testing , 2002, ISSTA '02.

[12]  Heather Kreger,et al.  Fulfilling the Web services promise , 2003, CACM.

[13]  Pierre F. Tiako,et al.  Software Applications: Concepts, Methodologies, Tools, and Applications , 2009 .

[14]  Jiong Wang,et al.  Testing web database applications , 2004, SOEN.

[15]  Paul Clements,et al.  Software architecture in practice , 1999, SEI series in software engineering.

[16]  Chen Fu,et al.  Testing of java web services for robustness , 2004, ISSTA '04.

[17]  Kees van Slooten Optimal Information Modeling Techniques , 2002 .

[18]  Roberto Chinnici,et al.  Web Services Description Language (WSDL) Version 2.0 Part 1: Core Language , 2007 .

[19]  Sanjiva Weerawarana,et al.  Unraveling the Web services web: an introduction to SOAP, WSDL, and UDDI , 2002, IEEE Internet Computing.

[20]  Boris Beizer,et al.  Software Testing Techniques , 1983 .

[21]  Jie Xu,et al.  Assessing the Dependability of SOAP RPC-Based Web Services by Fault Injection , 2003, 2003 The Ninth IEEE International Workshop on Object-Oriented Real-Time Dependable Systems.

[22]  Elaine J. Weyuker,et al.  An Applicable Family of Data Flow Testing Criteria , 1988, IEEE Trans. Software Eng..

[23]  James Skene,et al.  Service-Oriented Computing and the Model-Driven Architecture , 2005 .

[24]  Felix T.S. Chan,et al.  Application of metamorphic testing in numerical analysis , 1998, ICSE 1998.

[25]  Rishi Kalra,et al.  Channel Optimization for On Field Sales Force by Integration of Business Software on Mobile Platforms , 2009 .

[26]  OffuttJeff,et al.  Generating test cases for web services using data perturbation , 2004 .

[27]  Hong Zhu,et al.  Software unit test coverage and adequacy , 1997, ACM Comput. Surv..

[28]  Raymond A. Paul,et al.  Coyote: an XML-based framework for Web services testing , 2002, 7th IEEE International Symposium on High Assurance Systems Engineering, 2002. Proceedings..

[29]  Kovach Dragan Informationbase - A New Information System Layer , 2005, Encyclopedia of Information Science and Technology.

[30]  Shing-Chi Cheung,et al.  Publishing and composition of atomicity-equivalent services for B2B collaboration , 2006, ICSE.

[31]  C. M. Sperberg-McQueen,et al.  Extensible Markup Language (XML) , 1997, World Wide Web J..

[32]  F. Tahan From the authors , 2007, European Respiratory Journal.

[33]  Yuk Kuen Wong Why Software Review , 2006 .

[34]  Shing-Chi Cheung,et al.  Towards a metamorphic testing methodology for service-oriented software applications , 2005, Fifth International Conference on Quality Software (QSIC'05).

[35]  Ajantha Dahanayake,et al.  Service-Oriented Software System Engineering: Challenges and Practices , 2004 .

[36]  Tsong Yueh Chen,et al.  A metamorphic approach to integration testing of context-sensitive middleware-based applications , 2005, Fifth International Conference on Quality Software (QSIC'05).

[37]  Ravi B. Konuru,et al.  Cooperative middleware specialization for service oriented architectures , 2004, WWW Alt. '04.

[38]  Amit P. Sheth,et al.  Enhancing Web Services Description and Discovery to Facilitate Composition , 2004, SWSWPC.

[39]  Tsong Yueh Chen,et al.  Fault-based testing without the need of oracles , 2003, Inf. Softw. Technol..

[40]  Stephen S. Yau,et al.  Testing context-sensitive middleware-based software applications , 2004, Proceedings of the 28th Annual International Computer Software and Applications Conference, 2004. COMPSAC 2004..

[41]  Yuk Kuen Wong,et al.  Modern Software Review: Techniques and Technologies , 2006 .

[42]  Raymond A. Paul,et al.  Testing Web Services Using Progressive Group Testing , 2004, AWCC.

[43]  Tsong Yueh Chen,et al.  Case studies on the selection of useful relations in metamorphic testing , 2004 .

[44]  Anura Gurugé,et al.  Universal Description, Discovery, and Integration , 2004 .

[45]  Dong Wang,et al.  Extending WSDL to facilitate Web services testing , 2002, 7th IEEE International Symposium on High Assurance Systems Engineering, 2002. Proceedings..