Modeling Job Arrival Process with Long Range Dependence and Burstiness Characteristics

Workload modeling plays a significant role in performance evaluation of large-scale parallel systems such as clusters and grids. It helps to generate synthetic workloads which capture some dominant characteristics of traces (real workloads). Modeling job arrival process is an essential part of workload modeling. Although a job arrival process has many important characteristics such as long range dependence (LRD) and burstiness, most researchers, for simplicity, assume it as a poisson process in their evaluation work. Furthermore, there is currently almost no research focusing on both LRD and burstiness at the same time according to our investigation. With respect to this research trend, the multifractal wavelet model (MWM) recently has been introduced as a good choice to yield LRD for a job arrival process. Though LRD is well controlled, we observe that a job arrival process produced by MWM does not keep burstiness. In this paper, we present our study on modifying MWM so that not only LRD but also burstiness are kept in the job arrival process. In addition, our modification also fits the marginal distribution better than MWM.

[1]  I. Daubechies Ten Lectures on Wavelets , 1992 .

[2]  Sheldon M. Ross,et al.  Introduction to Probability Models, Eighth Edition , 1972 .

[3]  Hui Li Long Range Dependent Job Arrival Process and Its Implications in Grid Environments , 2007 .

[4]  Robert G. Turcott,et al.  Fractal character of the electrocardiogram: Distinguishing heart-failure and normal patients , 1996, Annals of Biomedical Engineering.

[5]  Dror G. Feitelson,et al.  The workload on parallel supercomputers: modeling the characteristics of rigid jobs , 2003, J. Parallel Distributed Comput..

[6]  Hans G. Feichtinger,et al.  Analysis, Synthesis, and Estimation of Fractal-Rate Stochastic Point Processes , 1997, adap-org/9709006.

[7]  H. E. Hurst,et al.  Long-Term Storage Capacity of Reservoirs , 1951 .

[8]  Jan Beran,et al.  Statistics for long-memory processes , 1994 .

[9]  Athina P. Petropulu,et al.  Long-range dependence and heavy-tail modeling for teletraffic data , 2002, IEEE Signal Process. Mag..

[10]  Evgenia Smirni,et al.  How to parameterize models with bursty workloads , 2008, PERV.

[11]  Murad S. Taqqu,et al.  Theory and applications of long-range dependence , 2003 .

[12]  Marion Kee,et al.  Analysis , 2004, Machine Translation.

[13]  M. A. Johnson,et al.  Descriptors of arrival-process burstiness with application to the discrete Markovian arrival process , 1996, Queueing Syst. Theory Appl..

[14]  Sheldon M. Ross,et al.  Introduction to probability models , 1975 .

[15]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[16]  Richard G. Baraniuk,et al.  A Multifractal Wavelet Model with Application to Network Traffic , 1999, IEEE Trans. Inf. Theory.

[17]  Patrice Abry,et al.  Long-Range Dependence: Theory and Applications , 2002 .