Elasticity Evaluation of IaaS Cloud Based on Mixed Workloads

Elasticity mechanism is the important feature of infrastructure clouds, which can add or remove resources to adapt the workload change. The elasticity mechanism impacts the quality of service and service level agreement. However, the performance of elasticity is hard to quantity. There are no efficient benchmarks to evaluate the elasticity mechanism. Exiting methods haven't considerate the different evaluation metrics and mixed workloads. In this paper, we propose a new framework to evaluate the elasticity of IaaS cloud based on mixed workload. Firstly, we design different types and patterns workload for the infrastructure cloud. Then, we propose the aggregated metrics which are based on different aspects. Finally, we present the experiments of real-world demonstrating that our method is applicable on the commercial IaaS cloud and has efficient results of elasticity evaluation.

[1]  François Monin,et al.  Principles and Practice of Declarative Programming , 1999, Lecture Notes in Computer Science.

[2]  Schahram Dustdar,et al.  Automated testing of cloud-based elastic systems with AUToCLES , 2013, 2013 28th IEEE/ACM International Conference on Automated Software Engineering (ASE).

[3]  Daniel Moldovan,et al.  ADVISE - A Framework for Evaluating Cloud Service Elasticity Behavior , 2014, ICSOC.

[4]  Cosimo Laneve,et al.  Static analysis of cloud elasticity , 2015, PPDP.

[5]  Daniel Moldovan,et al.  On Analyzing Elasticity Relationships of Cloud Services , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[6]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[7]  Autoflex: Service Agnostic Auto-scaling Framework for IaaS Deployment Models , 2013, 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing.

[8]  S. Jørgensen The art of computer systems performance analysis: Techniques for Experimental Design, Measurement, Simulation and Modeling. Raj Jain. John Wiley, New York. Hardcover, 720 p. U.S. $52.95. , 1992 .

[9]  Virgílio A. F. Almeida,et al.  Performance by Design - Computer Capacity Planning By Example , 2004 .

[10]  Kishor S. Trivedi,et al.  A Best Practice Guide to Resource Forecasting for Computing Systems , 2007, IEEE Transactions on Reliability.

[11]  Emanuel Ferreira Coutinho,et al.  Elasticity in cloud computing: a survey , 2014, annals of telecommunications - annales des télécommunications.

[12]  Aniruddha S. Gokhale,et al.  Efficient Autoscaling in the Cloud Using Predictive Models for Workload Forecasting , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[13]  Wei Xu,et al.  Predictive Control for Dynamic Resource Allocation in Enterprise Data Centers , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[14]  Samuel Kounev,et al.  Elasticity in Cloud Computing: What It Is, and What It Is Not , 2013, ICAC.

[15]  Adam Silberstein,et al.  Benchmarking cloud serving systems with YCSB , 2010, SoCC '10.

[16]  Samuel Kounev,et al.  Towards a Resource Elasticity Benchmark for Cloud Environments , 2014, HotTopiCS '14.

[17]  Kevin Lee,et al.  Empirical prediction models for adaptive resource provisioning in the cloud , 2012, Future Gener. Comput. Syst..

[18]  Jordi Guitart,et al.  On the Anticipation of Resource Demands to Fulfill the QoS of SaaS Web Applications , 2012, 2012 ACM/IEEE 13th International Conference on Grid Computing.

[19]  Bin Chen,et al.  Cloud testing tools , 2011, Proceedings of 2011 IEEE 6th International Symposium on Service Oriented System (SOSE).

[20]  Samuel Kounev,et al.  BUNGEE: An Elasticity Benchmark for Self-Adaptive IaaS Cloud Environments , 2015, 2015 IEEE/ACM 10th International Symposium on Software Engineering for Adaptive and Self-Managing Systems.

[21]  Tao Li,et al.  ASAP: A Self-Adaptive Prediction System for Instant Cloud Resource Demand Provisioning , 2011, 2011 IEEE 11th International Conference on Data Mining.

[22]  Daniel Moldovan,et al.  MELA: Monitoring and Analyzing Elasticity of Cloud Services , 2013, 2013 IEEE 5th International Conference on Cloud Computing Technology and Science.

[23]  Ray Jain,et al.  The art of computer systems performance analysis - techniques for experimental design, measurement, simulation, and modeling , 1991, Wiley professional computing.

[24]  Kevin Lee,et al.  How a consumer can measure elasticity for cloud platforms , 2012, ICPE '12.

[25]  LiuAnna,et al.  Empirical prediction models for adaptive resource provisioning in the cloud , 2012 .