A stochastic process-based server consolidation approach for dynamic workloads in cloud data centers

With the development of information technology, there is a need for computational works everywhere and every time. Thus, people should be able to carry out their heavy computations without having the burden of purchasing expensive hardware and software. Cloud computing is an attractive solution to such needs, but the high energy consumption of physical machines in a Cloud data center is a matter of great concern. Therefore, some of the low-loaded machines can be turned off or switched into low energy mode using server consolidation approaches. In this paper, a Stochastic Process-Based Dynamic Server Consolidation (SB-DSC) policy is developed to reduce the total cost of data centers while satisfying the required quality of service. A novel algorithm, which we call it Stochastic Process-Based BFD (SBBFD), is employed in SB-DSC policy to perform virtual machine placements over time. SBBFD overcomes most drawbacks of other algorithms proposed in the literature. The simulation results on real workload data show that SB-DSC leads to a noticeable reduction in total cost in terms of power consumption, SLA violations, number of mode switching and number of migrations.

[1]  Yefu Wang,et al.  Performance-controlled server consolidation for virtualized data centers with multi-tier applications , 2014, Sustain. Comput. Informatics Syst..

[2]  Martin Bichler,et al.  A Mathematical Programming Approach for Server Consolidation Problems in Virtualized Data Centers , 2010, IEEE Transactions on Services Computing.

[3]  Yi Zhuang,et al.  Constraint Programming based Virtual Cloud Resources Allocation Model , 2013 .

[4]  KyoungSoo Park,et al.  CoMon: a mostly-scalable monitoring system for PlanetLab , 2006, OPSR.

[5]  Luca Benini,et al.  Dynamic power management for nonstationary service requests , 1999, Design, Automation and Test in Europe Conference and Exhibition, 1999. Proceedings (Cat. No. PR00078).

[6]  Albert Y. Zomaya,et al.  Energy efficient utilization of resources in cloud computing systems , 2010, The Journal of Supercomputing.

[7]  Hassan Taheri,et al.  Novel fuzzy multi objective DVFS-aware consolidation heuristics for energy and SLA efficient resource management in cloud data centers , 2017, J. Netw. Comput. Appl..

[8]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[9]  Rajkumar Buyya,et al.  SLA-based virtual machine management for heterogeneous workloads in a cloud datacenter , 2014, J. Netw. Comput. Appl..

[10]  Christine Morin,et al.  Snooze: A Scalable and Autonomic Virtual Machine Management Framework for Private Clouds , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[11]  Hannu Tenhunen,et al.  Using Ant Colony System to Consolidate VMs for Green Cloud Computing , 2015, IEEE Transactions on Services Computing.

[12]  Martin Bichler,et al.  More than bin packing: Dynamic resource allocation strategies in cloud data centers , 2015, Inf. Syst..

[13]  Andrew S. Tanenbaum,et al.  Distributed systems: Principles and Paradigms , 2001 .

[14]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[15]  Liang Liu,et al.  Service level agreement based energy-efficient resource management in cloud data centers , 2014, Comput. Electr. Eng..

[16]  Rajkumar Buyya,et al.  Cost of Virtual Machine Live Migration in Clouds: A Performance Evaluation , 2009, CloudCom.

[17]  Roger M. Sauter,et al.  Introduction to Statistical Quality Control (2nd ed.) , 1992 .

[18]  BuyyaRajkumar,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012 .

[19]  David A. Patterson,et al.  A Case For Adaptive Datacenters To Conserve Energy and Improve Reliability , 2008 .

[20]  Lachlan L. H. Andrew,et al.  Dynamic Right-Sizing for Power-Proportional Data Centers , 2011, IEEE/ACM Transactions on Networking.

[21]  P. Mell,et al.  The NIST Definition of Cloud Computing , 2011 .

[22]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[23]  Fei Zhang,et al.  Simulation of power consumption of cloud data centers , 2013, Simul. Model. Pract. Theory.

[24]  Austin Donnelly,et al.  Sierra: a power-proportional, distributed storage system , 2009 .

[25]  Feng Zhao,et al.  Energy aware consolidation for cloud computing , 2008, CLUSTER 2008.

[26]  Rajkumar Buyya,et al.  OpenStack Neat: a framework for dynamic and energy‐efficient consolidation of virtual machines in OpenStack clouds , 2015, Concurr. Comput. Pract. Exp..

[27]  Jordi Torres,et al.  Towards energy-aware scheduling in data centers using machine learning , 2010, e-Energy.

[28]  N CalheirosRodrigo,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011 .

[29]  Dang Minh Quan,et al.  Energy Efficient Resource Allocation Strategy for Cloud Data Centres , 2011, ISCIS.

[30]  Akshat Verma,et al.  pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems , 2008, Middleware.

[31]  Mohammad Masdari,et al.  An overview of virtual machine placement schemes in cloud computing , 2016, J. Netw. Comput. Appl..

[32]  Maolin Tang,et al.  A Hybrid Genetic Algorithm for the Energy-Efficient Virtual Machine Placement Problem in Data Centers , 2014, Neural Processing Letters.

[33]  Rajkumar Buyya,et al.  Managing Overloaded Hosts for Dynamic Consolidation of Virtual Machines in Cloud Data Centers under Quality of Service Constraints , 2013, IEEE Transactions on Parallel and Distributed Systems.

[34]  Ian Lumb,et al.  A Taxonomy and Survey of Cloud Computing Systems , 2009, 2009 Fifth International Joint Conference on INC, IMS and IDC.

[35]  Haipeng Luo,et al.  Adaptive Resource Provisioning for the Cloud Using Online Bin Packing , 2014, IEEE Transactions on Computers.

[36]  Abolfazl Toroghi Haghighat,et al.  Energy-aware framework with Markov chain-based parallel simulated annealing algorithm for dynamic management of virtual machines in cloud data centers , 2017, The Journal of Supercomputing.

[37]  P. Santhi Thilagam,et al.  Heuristics based server consolidation with residual resource defragmentation in cloud data centers , 2015, Future Gener. Comput. Syst..

[38]  BichlerMartin,et al.  More than bin packing , 2015 .

[39]  Douglas C. Montgomery,et al.  Introduction to Statistical Quality Control , 1986 .

[40]  Pasi Liljeberg,et al.  Energy Aware Consolidation Algorithm Based on K-Nearest Neighbor Regression for Cloud Data Centers , 2013, 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing.