Multiscale Fitting Procedure Using Markov Modulated Poisson Processes

This paper proposes a parameter fitting procedure using Markov Modulated Poisson Processes (MMPPs) that leads to accurate estimates of queuing behavior for network traffic exhibiting long-range dependence behavior. The procedure matches both the autocovariance and marginal distribution of the counting process. A major feature is that the number of states is not fixed a priori, and can be adapted to the particular trace being modeled. The MMPP is constructed as a superposition of L 2-MMPPs and one M-MMPP. The 2-MMPPs are designed to match the autocovariance and the M-MMPP to match the marginal distribution. Each 2-MMPP models a specific time-scale of the data. The procedure starts by approximating the autocovariance by a weighted sum of exponential functions that model the autocovariance of the 2-MMPPs. The autocovariance tail can be adjusted to capture the long-range dependence characteristics of the traffic, up to the time-scales of interest to the system under study. The procedure then fits the M-MMPP parameters in order to match the marginal distribution, within the constraints imposed by the autocovariance matching. The number of states is also determined as part of this step. The final MMPP with M2L states is obtained by superposing the L 2-MMPPs and the M-MMPP. We apply the inference procedure to traffic traces exhibiting long-range dependence and evaluate its queuing behavior through simulation. Very good results are obtained, both in terms of queuing behavior and number of states, for the traces used, which include the well-known Bellcore traces.

[1]  Matthias Grossglauser,et al.  On the relevance of long-range dependence in network traffic , 1999, TNET.

[2]  Sally Floyd,et al.  Wide area traffic: the failure of Poisson modeling , 1995, TNET.

[3]  Walter Willinger,et al.  Long-range dependence in variable-bit-rate video traffic , 1995, IEEE Trans. Commun..

[4]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1997, TNET.

[5]  San-qi Li,et al.  On the convergence of traffic measurement and queueing analysis: a statistical-matching and queueing (SMAQ) tool , 1997, TNET.

[6]  Iraj Saniee,et al.  Performance impacts of multi-scaling in wide area TCP/IP traffic , 2000, Proceedings IEEE INFOCOM 2000. Conference on Computer Communications. Nineteenth Annual Joint Conference of the IEEE Computer and Communications Societies (Cat. No.00CH37064).

[7]  Jean C. Walrand,et al.  Effective bandwidths for multiclass Markov fluids and other ATM sources , 1993, TNET.

[8]  Debasis Mitra,et al.  Effective bandwidth of general Markovian traffic sources and admission control of high speed networks , 1993, IEEE INFOCOM '93 The Conference on Computer Communications, Proceedings.

[9]  Walter Willinger,et al.  On the self-similar nature of Ethernet traffic , 1993, SIGCOMM '93.

[10]  ElwalidAnwar,et al.  The importance of long-range dependence of VBR video traffic in ATM traffic engineering , 1996 .

[11]  Matthias Grossglauser,et al.  On the relevance of long-range dependence in network traffic , 1996, SIGCOMM 1996.

[12]  Patrice Abry,et al.  A Wavelet-Based Joint Estimator of the Parameters of Long-Range Dependence , 1999, IEEE Trans. Inf. Theory.

[13]  P. Skelly,et al.  A histogram-based model for video traffic behavior in an ATM multiplexer , 1993, TNET.

[14]  Stephan Robert,et al.  Which Arrival Law Parameters Are Decisive for Queueing System Performance , 1994 .

[15]  D. Karlis,et al.  Robust Inference for Finite Poisson Mixtures , 2001 .

[16]  Bo Friis Nielsen,et al.  A Markovian approach for modeling packet traffic with long-range dependence , 1998, IEEE J. Sel. Areas Commun..

[17]  K. Meier-Hellstern.  A fitting algorithm for Markov-modulated poisson processes having two arrival rates , 1987 .

[18]  Chris Blondia,et al.  Statistical Multiplexing of VBR Sources: A Matrix-Analytic Approach , 1992, Perform. Evaluation.

[19]  Walter Willinger,et al.  Self-similarity through high-variability: statistical analysis of Ethernet LAN traffic at the source level , 1997, TNET.

[20]  Chris Blondia,et al.  Superposition of Markov sources and long range dependence , 1998, Broadband Communications.

[21]  Walter Willinger,et al.  Self-similarity and heavy tails: structural modeling of network traffic , 1998 .

[22]  Gordon K. Smyth,et al.  A Modified Prony Algorithm for Exponential Function Fitting , 1995, SIAM J. Sci. Comput..

[23]  Bruce E. Hajek,et al.  On variations of queue response for inputs with the same mean and autocorrelation function , 1998, TNET.

[24]  Tho Le-Ngoc,et al.  MMPP models for multimedia traffic , 2000, Telecommun. Syst..

[25]  Anwar Elwalid,et al.  The Importance of Long-Range Dependence of VBR Video Traffic in ATM Traffic Engineering: Myths and Realities , 1996, SIGCOMM.

[26]  Rui J. M. T. Valadas,et al.  Framework based on Markov modulated Poisson processes for modeling traffic with long-range dependence , 2001, SPIE ITCom.

[27]  David M. Lucantoni,et al.  The BMAP/G/1 QUEUE: A Tutorial , 1993, Performance/SIGMETRICS Tutorials.

[28]  Yutaka Takahashi,et al.  Practical Time-Scale Fitting of Self-Similar Traffic with Markov-Modulated Poisson Process , 2001, Telecommun. Syst..

[29]  Ad Ridder.  Fast simulation of discrete time queues with Markov modulated batch arrivals and batch departures , 1998 .

[30]  Dan Keun Sung,et al.  Two-state MMPP modeling of ATM superposed traffic streams based on the characterization of correlated interarrival times , 1995, Proceedings of GLOBECOM '95.

[31]  Wolfgang Fischer,et al.  The Markov-Modulated Poisson Process (MMPP) Cookbook , 1993, Perform. Evaluation.

[32]  Jon W. Mark,et al.  Parameter estimation for Markov modulated Poisson processes via the EM algorithm with time discretization , 1993, Telecommun. Syst..

[33]  Azer Bestavros,et al.  Self-similarity in World Wide Web traffic: evidence and possible causes , 1996, SIGMETRICS '96.

[34]  Anja Feldmann,et al.  Fitting mixtures of exponentials to long-tail distributions to analyze network performance models , 1997, Proceedings of INFOCOM '97.

[35]  Rudolf H. Riedi,et al.  Multifractal Properties of TCP Traffic: a Numerical Study , 1997 .

[36]  DengLi,et al.  Parameter estimation for Markov modulated Poisson processes via the EM algorithm with time discretization , 1993 .

[37]  Jean-Yves Le Boudec,et al.  A Markov modulated process for self - similar traffic Saarbrucken , 1995 .

[38]  N. Rananand,et al.  Markov approximations to D-BMAPs : Information-theoretic bounds on queueing performance , 1995 .

[39]  Anja Feldmann,et al.  Fitting Mixtures of Exponentials to Long-Tail Distributions to Analyze Network , 1998, Perform. Evaluation.

[40]  Anja Feldmann,et al.  Data networks as cascades: investigating the multifractal nature of Internet WAN traffic , 1998, SIGCOMM '98.

[41]  Jean-Yves Le Boudec,et al.  New Models for Pseudo Self-Similar Traffic , 1997, Perform. Evaluation.

[42]  António Nogueira,et al.  Analyzing the relevant time scales in a network of queues , 2001, SPIE ITCom.

[43]  Anja Feldmann,et al.  Dynamics of IP traffic: a study of the role of variability and the impact of control , 1999, SIGCOMM '99.