Parameter inference of queueing models for IT systems using end-to-end measurements

Performance modeling has become increasingly important in the design, engineering and optimization of information technology (IT) infrastructures and applications. However, modeling work itself is time consuming and requires a good knowledge not only of the system, but also of modeling techniques. One of the biggest challenges in modeling complex IT systems consists in the calibration of model parameters, such as the service requirements of various job classes. We present an approach for solving this problem in the queueing network framework using inference techniques. This is done through a mathematical programming formulation, for which we propose an efficient and robust solution method. The necessary input data are end-to-end measurements which are usually easy to obtain. The robustness of our method means that the inferred model performs well in the presence of noisy data and further, is able to detect and remove outlying data sets. We present numerical experiments using data from real IT practice to demonstrate the promise of our framework and algorithm.

[1]  Ronald W. Wolff,et al.  Stochastic Modeling and the Theory of Queues , 1989 .

[2]  Robert B. Cooper,et al.  Queueing systems, volume II: computer applications : By Leonard Kleinrock. Wiley-Interscience, New York, 1976, xx + 549 pp. , 1977 .

[3]  Frank Kelly,et al.  Reversibility and Stochastic Networks , 1979 .

[4]  Mark S. Squillante,et al.  Workload service requirements analysis: a queueing network optimization approach , 2002, Proceedings. 10th IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunications Systems.

[5]  Donald F. Towsley,et al.  Inferring network characteristics via moment-based estimators , 2001, Proceedings IEEE INFOCOM 2001. Conference on Computer Communications. Twentieth Annual Joint Conference of the IEEE Computer and Communications Society (Cat. No.01CH37213).

[6]  Mokhtar S. Bazaraa,et al.  Nonlinear Programming: Theory and Algorithms , 1993 .

[7]  Virgílio A. F. Almeida,et al.  Capacity Planning for Web Performance: Metrics, Models, and Methods , 1998 .

[8]  Vinod Sharma,et al.  Estimating Traffic Parameters in Queueing Systems with Local Information , 1998, Perform. Evaluation.

[9]  Reinhard Männer,et al.  Accelerated Bundle Adjustment in Multiple-View Reconstruction , 2003, KES.

[10]  Donald F. Towsley,et al.  Multicast-based inference of network-internal delay distributions , 2002, TNET.

[11]  Robert Nowak,et al.  Sequential Monte Carlo Inference of Internal Delays in Nonstationary Communication Networks , 2002 .

[12]  Nick G. Duffield,et al.  Multicast inference of packet delay variance at interior network links , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[13]  Moisés Goldszmidt,et al.  On the quantification of e-business capacity , 2001, EC '01.

[14]  Stephen S. Lavenberg,et al.  Computer Performance Modeling Handbook , 1983, Int. CMG Conference.

[15]  Albert G. Greenberg,et al.  Fast accurate computation of large-scale IP traffic matrices from link loads , 2003, SIGMETRICS '03.