Copula-based parameter estimation for Markov-modulated Poisson Process

Markov-modulated Poisson Process (MMPP) has been extensively studied in random process theory and widely used as a network traffic model. Most methods for estimating MMPP parameters are based on the exact arrival times. Nevertheless, in many applications it is costly to record the exact time of each arrival. Instead, we only record the number of arrivals in fixed-length time slots, which is called arrival count. Since arrival count data does not maintain detailed arrival times, it is non trivial to develop effective methods for MMPP parameter estimation with arrival counts only. Very few existing works deal with this challenge. This paper tackles the above challenge with copula analysis. The theoretical marginal distribution and copula of arrival counts in MMPP are applied to develop a new estimation method, MarCpa, which is a two-step estimation method involving marginal matching followed by copula matching. Our evaluation results demonstrate that the proposed method is fast and accurate.

[1]  T. Rydén.  An EM algorithm for estimation in Markov-modulated Poisson processes , 1996 .

[2]  Mollaei Gharehajlu Mahmood,et al.  STATISTICAL ANALYSIS OF DIFFERENT TRAFFIC TYPES EFFECT ON QOS OF WIRELESS AD HOC NETWORKS , 2015 .

[3]  Malla Reddy Perati,et al.  Generalized Variance-Based Markovian Fitting for Self-Similar Traffic Modelling , 2005, IEICE Trans. Commun..

[4]  H. Okamura,et al.  Markovian Arrival Process Parameter Estimation With Group Data , 2009, IEEE/ACM Transactions on Networking.

[5]  David M. Lucantoni,et al.  Modeling multiple IP traffic streams with rate limits , 2001 .

[6]  Bill Ravens,et al.  An Introduction to Copulas , 2000, Technometrics.

[7]  Victor S. Frost,et al.  An algorithm for fitting MMPP to IP traffic traces , 2007, IEEE Communications Letters.

[8]  Yulia Burkatovskaya,et al.  CUSUM Algorithms for Parameter Estimation in Queueing Systems with Jump Intensity of the Arrival Process , 2015 .

[9]  P. Naor,et al.  Queuing Problems with Heterogeneous Arrivals and Service , 1971, Oper. Res..

[10]  P. Embrechts,et al.  Chapter 8 – Modelling Dependence with Copulas and Applications to Risk Management , 2003 .

[11]  Padhraic Smyth,et al.  Learning to detect events with Markov-modulated poisson processes , 2007, TKDD.

[12]  Fang Dong,et al.  Copula Analysis of Latent Dependency Structure for Collaborative Auto-Scaling of Cloud Services , 2016, 2016 25th International Conference on Computer Communication and Networks (ICCCN).

[13]  António Pacheco,et al.  Multiscale Fitting Procedure Using Markov Modulated Poisson Processes , 2003, Telecommun. Syst..

[14]  Elvis Dieguez,et al.  On Ryde/spl acute/n's EM algorithm for estimating MMPPs , 2006, IEEE Signal Processing Letters.

[15]  Bo Friis Nielsen,et al.  A Markovian approach for modeling packet traffic with long-range dependence , 1998, IEEE J. Sel. Areas Commun..

[16]  Aaron K. Baughman,et al.  IBM Predicts Cloud Computing Demand for Sports Tournaments , 2016, Interfaces.

[17]  Guigang Zhang,et al.  Deep Learning , 2016, Int. J. Semantic Comput..

[18]  Andrew J. Patton.  Copula Methods for Forecasting Multivariate Time Series , 2013 .

[19]  Lothar Breuer,et al.  An EM Algorithm for Markovian Arrival Processes Observed at Discrete Times , 2010, MMB/DFT.

[20]  Wolfgang Fischer,et al.  The Markov-Modulated Poisson Process (MMPP) Cookbook , 1993, Perform. Evaluation.

[21]  Jaroslav Polec,et al.  Modeling Poisson Error Process on Wireless Channels , 2015, Int. J. Commun. Networks Inf. Secur..

[22]  Konstantin Avrachenkov,et al.  Distribution and dependence of extremes in network sampling processes , 2014, 2014 Tenth International Conference on Signal-Image Technology and Internet-Based Systems.

[23]  Evgenia Smirni,et al.  KPC-Toolbox: Simple Yet Effective Trace Fitting Using Markovian Arrival Processes , 2008, 2008 Fifth International Conference on Quantitative Evaluation of Systems.

[24]  Xin-She Yang,et al.  Metaheuristic Applications in Structures and Infrastructures , 2013 .

[25]  Fang Dong,et al.  Copula analysis for statistical network calculus , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[26]  Peter Buchholz,et al.  A Heuristic Approach for Fitting MAPs to Moments and Joint Moments , 2009, 2009 Sixth International Conference on the Quantitative Evaluation of Systems.

[27]  Robert J. Elliott,et al.  Discrete-Time Expectation Maximization Algorithms for Markov-Modulated Poisson Processes , 2008, IEEE Transactions on Automatic Control.