Performance Evaluation of Cloud Data Centers with Batch Task Arrivals

ABSTRACT Accurate performance evaluation of cloud computing resources is a necessary prerequisite for ensuring that quality of service (QoS) parameters remain within agreed limits. In this chapter, we consider cloud centers with Poisson arrivals of batch task requests under total rejection policy; task service times are assumed to follow a general distribution. We describe a new approximate analytical model for performance evaluation of such systems and show that important performance indicators such as mean request response time, waiting time in the queue, queue length, blocking probability, probability of immediate service, and probability distribution of the number of tasks in the system can be obtained in a wide range of input parameters.

[1]  Farokh B. Bastani,et al.  Virtual Services in Cloud Computing , 2010, 2010 6th World Congress on Services.

[2]  Toshikazu Kimura.  Optimal buffer design of an m/g/s queue with finite capacity ∗ , 1996 .

[3]  Thomas F. Wenisch,et al.  PowerNap: eliminating server idle power , 2009, ASPLOS.

[4]  Jelena V. Misic,et al.  Performance Analysis of Cloud Centers under Burst Arrivals and Total Rejection Policy , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[5]  Jelena V. Misic,et al.  Availability analysis of cloud computing centers , 2012, 2012 IEEE Global Communications Conference (GLOBECOM).

[6]  Yuan-Shun Dai,et al.  Performance evaluation of cloud service considering fault recovery , 2009, The Journal of Supercomputing.

[7]  James MacGregor Smith,et al.  M/G/c/K blocking probability models and system performance , 2003, Perform. Evaluation.

[8]  Dror G. Feitelson,et al.  Workload Modeling for Computer Systems Performance Evaluation , 2015 .

[9]  Mark S. Squillante,et al.  Optimal stochastic scheduling in multiclass parallel queues , 1999, SIGMETRICS '99.

[10]  Yukio Takahashi.  AN APPROXIMATION FORMULA FOR THE MEAN WAITING TIME OF AN M/G/c QUEUE , 1977 .

[11]  Mor Harchol-Balter,et al.  Optimality analysis of energy-performance trade-off for server farm management , 2010, Perform. Evaluation.

[12]  Kishor S. Trivedi,et al.  Stochastic Modeling of Composite Web Services for Closed-Form Analysis of Their Performance and Reliability Bottlenecks , 2007, ICSOC.

[13]  G. Grimmett,et al.  Probability and random processes , 2002 .

[14]  Jon W. Mark,et al.  Approximation of the Mean Queue Length of an M/G/c Queueing System , 1995, Oper. Res..

[15]  Alexandru Iosup,et al.  On the Performance Variability of Production Cloud Services , 2011, 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[16]  Ewa Deelman,et al.  The cost of doing science on the cloud: the Montage example , 2008, HiPC 2008.

[17]  Chandra Krintz,et al.  Paravirtualization for HPC Systems , 2006, ISPA Workshops.

[18]  Alexandru Iosup,et al.  Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing , 2011, IEEE Transactions on Parallel and Distributed Systems.

[19]  Matei Ripeanu,et al.  Amazon S3 for science grids: a viable solution? , 2008, DADC '08.

[20]  Sanjay Chaudhary,et al.  Application Performance Isolation in Virtualization , 2009, 2009 IEEE International Conference on Cloud Computing.

[21]  Asser N. Tantawi,et al.  Optimal static load balancing in distributed computer systems , 1985, JACM.

[22]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[23]  Jelena V. Misic,et al.  Analysis of a Pool Management Scheme for Cloud Computing Centers , 2013, IEEE Transactions on Parallel and Distributed Systems.

[24]  Edward Walker,et al.  Benchmarking Amazon EC2 for High-Performance Scientific Computing , 2008, login Usenix Mag..

[25]  David D. Yao,et al.  Refining the Diffusion Approximation for the M/G/m Queue , 1985, Oper. Res..

[26]  Rupak Biswas,et al.  Scientific application-based performance comparison of SGI Altix 4700, IBM POWER5+, and SGI ICE 8200 supercomputers , 2008, HiPC 2008.

[27]  Jie Li,et al.  Optimal Load Balancing in Distributed Computer Systems , 1997 .

[28]  Jelena V. Misic,et al.  Performance Analysis of Cloud Computing Centers Using M/G/m/m+r Queuing Systems , 2012, IEEE Transactions on Parallel and Distributed Systems.

[29]  Xi He,et al.  Cloud Computing: a Perspective Study , 2010, New Generation Computing.

[30]  George P. Cosmetatos.  Some practical considerations on multi-server queues with multiple poisson arrivals , 1978 .

[31]  Jelena V. Misic,et al.  Modelling of Cloud Computing Centers Using M/G/m Queues , 2011, 2011 31st International Conference on Distributed Computing Systems Workshops.

[32]  Ali R. Hurson,et al.  Scheduling and Load Balancing in Parallel and Distributed Systems , 1995 .

[33]  Dimitris Bertsimas.  An Analytic Approach to a General Class of G/G/s Queueing Systems , 1990, Oper. Res..

[34]  Dimitris Bertsimas.  An exact FCFS waiting time analysis for a general class of G/G/s queueing systems , 1988, Queueing Syst. Theory Appl..

[35]  David D. Yao.  Some results for the queues Mx /M/c and GIx/ G/c , 1985 .

[36]  Keqin Li.  Minimizing the probability of load imbalance in heterogeneous distributed computer systems , 2002 .

[37]  Chris Rose,et al.  A Break in the Clouds: Towards a Cloud Definition , 2011 .

[38]  M. Miyazawa.  Approximation of the queue-length distribution of an M/GI/s queue by the basic equations , 1986, Journal of Applied Probability.

[39]  Jelena V. Misic,et al.  A Fine-Grained Performance Model of Cloud Computing Centers , 2013, IEEE Transactions on Parallel and Distributed Systems.

[40]  Yasushi Inoguchi,et al.  Performance evaluation of a Green Scheduling Algorithm for energy savings in Cloud computing , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum (IPDPSW).

[41]  Wen Zhang,et al.  Dynamic Control of Data Streaming and Processing in a Virtualized Environment , 2012, IEEE Transactions on Automation Science and Engineering.

[42]  Kevin Li.  Optimizing Average Job Response Time via Decentralized Probabilistic Job Dispatching in Heterogeneous Multiple Computer Systems , 1998, Comput. J..

[43]  A. Federgruen,et al.  Approximations for the steady-state probabilities in the M/G/c queue , 1981, Advances in Applied Probability.

[44]  Toshikazu Kimura,et al.  A Diffusion Approximation for an M/G/m Queue with Group Arrivals , 1984 .

[45]  Toshikazu Kimura,et al.  Diffusion Approximation for an M/G/m Queue , 1983, Oper. Res..

[46]  O. J. Boxma,et al.  Approximations of the Mean Waiting Time in an M/G/s Queueing System , 1979, Oper. Res..

[47]  Paula Smith,et al.  VMmark: A Scalable Benchmark for Virtualized Systems , 2006 .

[48]  Henk Tijms,et al.  Heuristics for Finite-Buffer Queues , 1992, Probability in the Engineering and Informational Sciences.

[49]  Awi Federgruen,et al.  An M/G/c queue in which the number of servers required is random , 1984 .

[50]  D. Joanes,et al.  Comparing measures of sample skewness and kurtosis , 1998 .

[51]  Per Hokstad,et al.  Approximations for the M/G/m Queue , 1978, Oper. Res..

[52]  Harry G. Perros,et al.  Service Performance and Analysis in Cloud Computing , 2009, 2009 Congress on Services - I.

[53]  Yi Liang,et al.  In cloud, do MTC or HTC service providers benefit from the economies of scale? , 2009, MTAGS '09.

[54]  Xiaohong Jiang,et al.  Two Optimization Mechanisms to Improve the Isolation Property of Server Consolidation in Virtualized Multi-core Server , 2010, 2010 IEEE 12th International Conference on High Performance Computing and Communications (HPCC).

[55]  S. A. Nozaki,et al.  Approximations in finite-capacity multi-server queues by Poisson arrivals , 1978, Journal of Applied Probability.

[56]  Felipe A. Cruz-Pérez,et al.  Teletraffic Model for the Performance Evaluation of Cellular Networks with Hyper-Erlang Distributed Cell Dwell Time , 2010, 2010 IEEE 71st Vehicular Technology Conference.

[57]  Toshikazu Kimura,et al.  A Transform-Free Approximation for the Finite Capacity M/G/s Queue , 1996, Oper. Res..

[58]  Jelena V. Misic,et al.  Performance Analysis of Cloud Computing Centers , 2010, QSHINE.

[59]  Sem C. Borst.  Optimal probabilistic allocation of customer types to servers , 1995, SIGMETRICS '95/PERFORMANCE '95.

[60]  Magnos Martinello,et al.  Web service availability - impact of error recovery and traffic model , 2005, Reliab. Eng. Syst. Saf..

[61]  Collin McCurdy,et al.  Early evaluation of IBM BlueGene/P , 2008, HiPC 2008.

[62]  Leonard Kleinrock,et al.  Queueing Systems: Volume I-Theory , 1975 .