Automated Model-Based Performance Testing for PaaS Cloud Services

Recently, cloud computing has become popular for its unique advantages. Many applications have been migrated to cloud as web services. However, evaluating the performance of cloud services is non-trivial. Performance testing is one of the dominant techniques for evaluating system performance. In this paper, we present a model and template-based approach that automatically generates test scripts and test cases to measure service performance in an enterprise private cloud. We describe how load is generated automatically from our tool. Our empirical study shows the proposed approach can significantly decrease the cost of performance testing and help reveal potential performance issues.

[1]  Mohamed Jmaiel,et al.  Automated Significant Load Testing for WS-BPEL Compositions , 2013, 2013 IEEE Sixth International Conference on Software Testing, Verification and Validation Workshops.

[2]  Yuqing Lan,et al.  Automatic Test Task Allocation in Agent-Based Distributed Automated Testing Framework , 2009, 2009 International Conference on Computational Intelligence and Software Engineering.

[3]  Gilbert Hamann,et al.  Automated performance analysis of load tests , 2009, 2009 IEEE International Conference on Software Maintenance.

[4]  Dirk Draheim,et al.  Realistic load testing of Web applications , 2006, Conference on Software Maintenance and Reengineering (CSMR'06).

[5]  Bin Li,et al.  A Configurable Web Service Performance Testing Framework , 2008, 2008 10th IEEE International Conference on High Performance Computing and Communications.

[6]  Chia Hung Kao,et al.  Performance Testing Framework for REST-Based Web Applications , 2013, 2013 13th International Conference on Quality Software.

[7]  João W. Cangussu,et al.  Automatic feedback, control-based, stress and load testing , 2008, SAC '08.

[8]  Arshdeep Bahga,et al.  Synthetic Workload Generation for Cloud Computing Applications , 2011, J. Softw. Eng. Appl..

[9]  Wei Li,et al.  Model Based Load Testing of Web Applications , 2010, International Symposium on Parallel and Distributed Processing with Applications.

[10]  Gilbert Hamann,et al.  An automated approach for abstracting execution logs to execution events , 2008, J. Softw. Maintenance Res. Pract..

[11]  Fredrik Abbors,et al.  Model-based performance testing in the cloud using the mbpet tool , 2013, ICPE '13.

[12]  Matthew B. Dwyer,et al.  Compositional load test generation for software pipelines , 2012, ISSTA 2012.

[13]  Gilbert Hamann,et al.  Automatic Comparison of Load Tests to Support the Performance Analysis of Large Enterprise Systems , 2010, 2010 14th European Conference on Software Maintenance and Reengineering.