Automatically generating realistic test input from web services

Generating realistic test data is a major problem for software testers. Realistic test data generation for certain input types is hard to automate and therefore laborious. We propose a novel automated solution to test data generation that exploits existing web services as sources of realistic test data. Our approach is capable of generating realistic test data and also generating data based on tester-specified constraints. In experimental analysis, our prototype tool achieved between 93% and 100% success rates in generating realistic data using service compositions while random test data generation achieved only between 2% and 34%.

[1]  Eda Marchetti,et al.  WS-TAXI: A WSDL-based Testing Tool for Web Services , 2009, 2009 International Conference on Software Testing Verification and Validation.

[2]  Xiaoying Bai,et al.  Contract-Based Testing for Web Services , 2007, 31st Annual International Computer Software and Applications Conference (COMPSAC 2007).

[3]  Juan Luo,et al.  Testing Web services by XML perturbation , 2005, 16th IEEE International Symposium on Software Reliability Engineering (ISSRE'05).

[4]  Mark Harman,et al.  Automated Session Data Repair for Web Application Regression Testing , 2008, 2008 1st International Conference on Software Testing, Verification, and Validation.

[5]  Raymond A. Paul,et al.  Swiss Cheese Test Case Generation for Web Services Testing , 2005, IEICE Trans. Inf. Syst..

[6]  Mark Harman,et al.  Optimised Realistic Test Input Generation , 2011 .

[7]  Wei-Tek Tsai,et al.  WSDL-based automatic test case generation for Web services testing , 2005, IEEE International Workshop on Service-Oriented System Engineering (SOSE'05).

[8]  Xiuzhen Zhang,et al.  Predicting Defective Software Components from Code Complexity Measures , 2007 .

[9]  Darrel C. Ince,et al.  The Automatic Generation of Test Data , 1987, Comput. J..

[10]  A. Jefferson Offutt,et al.  Generating test cases for web services using data perturbation , 2004, SOEN.

[11]  Jun Zhu,et al.  Towards a practical and effective method for Web services test case generation , 2009, 2009 ICSE Workshop on Automation of Software Test.

[12]  Mark Harman,et al.  Reducing qualitative human oracle costs associated with automatically generated test data , 2010, STOV '10.

[13]  Mei-Hwa Chen,et al.  Clustering and Tailoring User Session Data for Testing Web Applications , 2009, 2009 International Conference on Software Testing Verification and Validation.

[14]  Tao Zhang,et al.  WSDL-Based Automated Test Data Generation for Web Service , 2008, 2008 International Conference on Computer Science and Software Engineering.

[15]  Mark Grechanik,et al.  Automatic Test Generation From GUI Applications For Testing Web Services , 2007, 2007 IEEE International Conference on Software Maintenance.

[16]  Nikolai Tillmann,et al.  MSeqGen: object-oriented unit-test generation via mining source code , 2009, ESEC/SIGSOFT FSE.

[17]  Gregg Rothermel,et al.  Leveraging user-session data to support Web application testing , 2005, IEEE Transactions on Software Engineering.

[18]  Nuno Laranjeiro,et al.  Benchmarking the Robustness of Web Services , 2007 .

[19]  Shihong Huang,et al.  WSDLTest - A Tool for Testing Web Services , 2006, 2006 Eighth IEEE International Symposium on Web Site Evolution (WSE'06).

[20]  Eda Marchetti,et al.  Automatic Test Data Generation for XML Schema-based Partition Testing , 2007, ICSE 2007.

[21]  Malcolm Munro,et al.  Fault-Based Web Services Testing , 2008, Fifth International Conference on Information Technology: New Generations (itng 2008).

[22]  Juan-Zi Li,et al.  Ontology-Based Test Case Generation for Testing Web Services , 2007, Eighth International Symposium on Autonomous Decentralized Systems (ISADS'07).

[23]  M. Harman,et al.  Testing Web Services : A Survey , 2011 .

[24]  A. Jefferson Offutt,et al.  An experimental mutation system for Java , 2004, SOEN.

[25]  Mark Harman,et al.  Automated web application testing using search based software engineering , 2011, 2011 26th IEEE/ACM International Conference on Automated Software Engineering (ASE 2011).

[26]  Wei-Tek Tsai,et al.  Ontology-Based Test Modeling and Partition Testing of Web Services , 2008, 2008 IEEE International Conference on Web Services.

[27]  Mark Harman,et al.  Optimised Realistic Test Input Generation Using Web Services , 2012, SSBSE.

[28]  Jia Zhang,et al.  Criteria analysis and validation of the reliability of Web services-oriented systems , 2005, IEEE International Conference on Web Services (ICWS'05).