Model-based Performance Testing of Web Services using Probabilistic Timed Automata

In this paper, we present an approach for performance testing of web services in which we use abstract models, specified using Probabilistic Timed Automata, to describe how users interact with the system. The models are used in the load generation process to generate load against the system. The abstract actions from the model are sent in real-time to the system via an adapter. Different performance indicators are monitored during the test session and reported at the end of the process. We exemplify with an auction web service case study on which we have run several experiments.

[1]  Domenico Ferrari,et al.  On the foundations of artificial workload design , 1983, SIGMETRICS '84.

[2]  David Mosberger,et al.  httperf—a tool for measuring web server performance , 1998, PERV.

[3]  Fredrik Abbors,et al.  Model-based performance testing in the cloud using the mbpet tool , 2013, ICPE '13.

[4]  Marin Litoiu,et al.  Model-based performance testing: NIER track , 2011, 2011 33rd International Conference on Software Engineering (ICSE).

[5]  Marta Z. Kwiatkowska,et al.  Performance analysis of probabilistic timed automata using digital clocks , 2003, Formal Methods Syst. Des..

[6]  Diwakar Krishnamurthy,et al.  A model-based approach for testing the performance of web applications , 2006, SOQUA '06.

[7]  Rossano Schifanella,et al.  WALTy: a user behavior tailored tool for evaluating Web application performance , 2004, Third IEEE International Symposium on Network Computing and Applications, 2004. (NCA 2004). Proceedings..

[8]  Dorina C. Petriu,et al.  Applying the UML Performance Profile: Graph Grammar-Based Derivation of LQN Models from UML Specifications , 2002, Computer Performance Evaluation / TOOLS.

[9]  Virgílio A. F. Almeida,et al.  Capacity Planning for Web Services: Metrics, Models, and Methods , 2001 .

[10]  J. Shaw,et al.  Web Application Performance Testing — a Case Study of an On-line Learning Application , 2000 .

[11]  Guido van Rossum,et al.  Python Programming Language , 2007, USENIX Annual Technical Conference.

[12]  Mariacarla Calzarossa,et al.  Workload Characterization Issues and Methodologies , 2000, Performance Evaluation.

[13]  Daniel A. Menascé,et al.  Load Testing of Web Sites , 2002, IEEE Internet Comput..

[14]  Sam Ruby,et al.  RESTful Web Services , 2007 .

[15]  Rajeev Alur,et al.  A Theory of Timed Automata , 1994, Theor. Comput. Sci..

[16]  Giovanni Denaro,et al.  Early performance testing of distributed software applications , 2004, WOSP '04.