Automatic performance space exploration of web applications using genetic algorithms

We describe a tool-supported performance exploration approach in which we use genetic algorithms to find a potential user behavioural pattern that maximizes the resource utilization of the system under test. This work is built upon our previous work in which we generate load from workload models that describe the expected behaviour of the users. In this paper, we evolve a given probabilistic workload model (specified as a Markov Chain Model) by optimizing the probability distribution of the edges in the model and generating different solutions. During the evolution, the solutions are ranked according to their fitness values. The solutions with the highest fitness are chosen as parent solutions for generating offsprings. At the end of an experiment, we select the best solution among all the generations. We validate our approach by generating load from both the original and the best solution model, and by comparing the resource utilization they create on the system under test.

[1]  Guido van Rossum,et al.  Python Programming Language , 2007, USENIX Annual Technical Conference.

[2]  Elaine J. Weyuker,et al.  Experience with Performance Testing of Software Systems: Issues, an Approach, and Case Study , 2000, IEEE Trans. Software Eng..

[3]  Fredrik Abbors,et al.  An automated approach for creating workload models from server log data , 2014, 2014 9th International Conference on Software Engineering and Applications (ICSOFT-EA).

[4]  Dirk Draheim,et al.  Realistic load testing of Web applications , 2006, Conference on Software Maintenance and Reengineering (CSMR'06).

[5]  John N. Tsitsiklis,et al.  Introduction to Probability , 2002 .

[6]  Arben Asllani,et al.  Using genetic algorithm for dynamic and multiple criteria web-site optimizations , 2007, Eur. J. Oper. Res..

[7]  Lalit M. Patnaik,et al.  Genetic algorithms: a survey , 1994, Computer.

[8]  Charles M. Grinstead,et al.  Introduction to probability , 1999, Statistics for the Behavioural Sciences.

[9]  J. Shaw,et al.  Web Application Performance Testing — a Case Study of an On-line Learning Application , 2000 .

[10]  Ramesh R. Sarukkai,et al.  Link prediction and path analysis using Markov chains , 2000, Comput. Networks.

[11]  Fredrik Abbors,et al.  Model-based performance testing in the cloud using the mbpet tool , 2013, ICPE '13.

[12]  Marc Parizeau,et al.  DEAP: evolutionary algorithms made easy , 2012, J. Mach. Learn. Res..

[13]  Sam Ruby,et al.  RESTful Web Services , 2007 .