WAM—The Weighted Average Method for Predicting the Performance of Systems with Bursts of Customer Sessions

Predictive performance models are important tools that support system sizing, capacity planning, and systems management exercises. We introduce the Weighted Average Method (WAM) to improve the accuracy of analytic predictive performance models for systems with bursts of concurrent customers. WAM considers the customer population distribution at a system to reflect the impact of bursts. The WAM approach is robust with respect to distribution functions, including heavy-tail-like distributions, for workload parameters. We demonstrate the effectiveness of WAM using a case study involving a multitier TPC-W benchmark system. To demonstrate the utility of WAM with multiple performance modeling approaches, we developed both Queuing Network Models and Layered Queuing Models for the system. Results indicate that WAM improves prediction accuracy for bursty workloads for QNMs and LQMs by 10 and 12 percent, respectively, with respect to a Markov Chain approach reported in the literature.

[1]  Maria Kihl,et al.  Performance Modeling of an Apache Web Server with Bursty Arrival Traffic , 2003, International Conference on Internet Computing.

[2]  Virgílio A. F. Almeida,et al.  Capacity Planning for Web Services: Metrics, Models, and Methods , 2001 .

[3]  Dejan S. Milojicic,et al.  SLA Decomposition: Translating Service Level Objectives to System Level Thresholds , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[4]  Raj Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[5]  Shikharesh Majumdar,et al.  The Stochastic Rendezvous Network Model for Performance of Synchronous Client-Server-like Distributed Software , 1995, IEEE Trans. Computers.

[6]  Paola Inverardi,et al.  Model-based performance prediction in software development: a survey , 2004, IEEE Transactions on Software Engineering.

[7]  Evgenia Smirni,et al.  Bound analysis of closed queueing networks with workload burstiness , 2008, SIGMETRICS '08.

[8]  Michael K. Molloy Performance Analysis Using Stochastic Petri Nets , 1982, IEEE Transactions on Computers.

[9]  Virgílio A. F. Almeida,et al.  Analyzing a web-based system's performance measures at multiple time scales , 2002, PERV.

[10]  Prasant Mohapatra,et al.  Characterization of E-Commerce Traffic , 2003, Electron. Commer. Res..

[11]  David Mosberger,et al.  httperf—a tool for measuring web server performance , 1998, PERV.

[12]  Ray Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[13]  M.A. Qureshi,et al.  The UltraSAN Modeling Environment , 1995, Perform. Evaluation.

[14]  Mary K. Vernon,et al.  AMVA techniques for high service time variability , 2000, SIGMETRICS '00.

[15]  Diwakar Krishnamurthy,et al.  Synthetic workload generation for stress testing session-based systems , 2004 .

[16]  Qi Zhang,et al.  Performance impacts of autocorrelated flows in multi-tiered systems , 2007, Perform. Evaluation.

[17]  Pablo Molinero-Fernández,et al.  Systems with multiple servers under heavy-tailed workloads , 2005, Perform. Evaluation.

[18]  Jerome A. Rolia,et al.  A Synthetic Workload Generation Technique for Stress Testing Session-Based Systems , 2006, IEEE Transactions on Software Engineering.

[19]  Leonard Kleinrock,et al.  Queueing Systems: Volume I-Theory , 1975 .

[20]  Asser N. Tantawi,et al.  Analytic modeling of multitier Internet applications , 2007, TWEB.

[21]  Virgílio A. F. Almeida,et al.  In search of invariants for e-business workloads , 2000, EC '00.

[22]  Samuel Kounev,et al.  Performance modelling of distributed e-business applications using Queuing Petri Nets , 2003, 2003 IEEE International Symposium on Performance Analysis of Systems and Software. ISPASS 2003..

[23]  M. Reiser,et al.  A Queueing Network Analysis of Computer Communication Networks with Window Flow Control , 1979, IEEE Trans. Commun..

[24]  Virgílio A. F. Almeida,et al.  Capacity Planning and Performance Modeling: From Mainframes to Client-Server Systems , 1994 .

[25]  Giuliano Casale An efficient algorithm for the exact analysis of multiclass queueing networks with large population sizes , 2006, SIGMETRICS '06/Performance '06.

[26]  Jerome A. Rolia,et al.  Characterizing the scalability of a large web-based shopping system , 2001, ACM Trans. Internet Techn..

[27]  Qi Zhang,et al.  A Regression-Based Analytic Model for Dynamic Resource Provisioning of Multi-Tier Applications , 2007, Fourth International Conference on Autonomic Computing (ICAC'07).

[28]  William H. Sanders,et al.  Specification and construction of performability models , 1993 .

[29]  Nidhi Tiwari,et al.  Experiances of using LQN and QPN tools for performance modelling of a J2EE application , 2006, Int. CMG Conference.

[30]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[31]  Sally Floyd,et al.  Wide area traffic: the failure of Poisson modeling , 1995, TNET.

[32]  Ward Whitt,et al.  The Influence of Service-Time Variability in a Closed Network of Queues , 1986, Perform. Evaluation.

[33]  Jeffrey P. Buzen,et al.  Computational algorithms for closed queueing networks with exponential servers , 1973, Commun. ACM.

[34]  Jerome A. Rolia,et al.  The Method of Layers , 1995, IEEE Trans. Software Eng..

[35]  Kihong Park,et al.  On the relationship between file sizes, transport protocols, and self-similar network traffic , 1996, Proceedings of 1996 International Conference on Network Protocols (ICNP-96).

[36]  Lester Lipsky,et al.  Long-lasting transient conditions in simulations with heavy-tailed workloads , 1997, WSC '97.

[37]  L. Oxley,et al.  Estimators for Long Range Dependence: An Empirical Study , 2009, 0901.0762.

[38]  Thomas Bonald,et al.  Congestion at flow level and the impact of user behaviour , 2003, Comput. Networks.

[39]  Mor Harchol-Balter,et al.  On Choosing a Task Assignment Policy for a Distributed Server System , 1998, J. Parallel Distributed Comput..

[40]  Daniel A. Menascé,et al.  Analytic performance models for single class and multiple class multithreaded software servers , 2006, Int. CMG Conference.

[41]  K. Mani Chandy,et al.  Linearizer: a heuristic algorithm for queueing network models of computing systems , 1982, CACM.