Energy-aware VM placement algorithms for the OpenStack Neat consolidation framework

One of the main challenges in cloud computing is an enormous amount of energy consumed in data-centers. Several researches have been conducted on Virtual Machine(VM) consolidation to optimize energy consumption. Among the proposed VM consolidations, OpenStack Neat is notable for its practicality. OpenStack Neat is an open-source consolidation framework that can seamlessly integrate to OpenStack, one of the most common and widely used open-source cloud management tool. The framework has components for deciding when to migrate VMs and for selecting suitable hosts for the VMs (VM placement). The VM placement algorithm of OpenStack Neat is called Modified Best-Fit Decreasing (MBFD). MBFD is based on a heuristic that handles only minimizing the number of servers. The heuristic is not only less energy efficient but also increases Service Level Agreement (SLA) violation and consequently cause more VM migrations. To improve the energy efficiency, we propose VM placement algorithms based on both bin-packing heuristics and servers’ power efficiency. In addition, we introduce a new bin-packing heuristic called a Medium-Fit (MF) to reduce SLA violation. To evaluate performance of the proposed algorithms we have conducted experiments using CloudSim on three cloud data-center scenarios: homogeneous, heterogeneous and default. Workloads that run in the data-centers are generated from traces of PlanetLab and Bitbrains clouds. The results of the experiment show up-to 67% improvement in energy consumption and up-to 78% and 46% reduction in SLA violation and amount of VM migrations, respectively. Moreover, all improvements are statistically significant with significance level of 0.01.

[1]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[2]  Ching-Hsien Hsu,et al.  Provision of Data-Intensive Services Through Energy- and QoS-Aware Virtual Machine Placement in National Cloud Data Centers , 2016, IEEE Transactions on Emerging Topics in Computing.

[3]  Daniele Vigo,et al.  Bin packing approximation algorithms: Survey and classification , 2013 .

[4]  Alexandru Iosup,et al.  The Grid Workloads Archive , 2008, Future Gener. Comput. Syst..

[5]  Rashedur M. Rahman,et al.  Implementation and performance analysis of various VM placement strategies in CloudSim , 2015, Journal of Cloud Computing.

[6]  Jordi Torres,et al.  Adaptive Scheduling on Power-Aware Managed Data-Centers Using Machine Learning , 2011, 2011 IEEE/ACM 12th International Conference on Grid Computing.

[7]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[8]  Mohamed Cheriet,et al.  Carbon-aware distributed cloud: multi-level grouping genetic algorithm , 2015, Cluster Computing.

[9]  Ahmed Zekri,et al.  Power and Cost-aware Virtual Machine Placement in Geo-distributed Data Centers , 2018, CLOSER.

[10]  David S. Johnson,et al.  Near-optimal bin packing algorithms , 1973 .

[11]  Zoltán Ádám Mann,et al.  Which is the best algorithm for virtual machine placement optimization? , 2017, Concurr. Comput. Pract. Exp..

[12]  Ulas C. Kozat,et al.  Dynamic resource allocation and power management in virtualized data centers , 2010, 2010 IEEE Network Operations and Management Symposium - NOMS 2010.

[13]  Orathai Sangpetch,et al.  Thoth: Automatic Resource Management with Machine Learning for Container-based Cloud Platform. , 2017, CLOSER 2017.

[14]  Xue-Jie Zhang,et al.  Comparison of open-source cloud management platforms: OpenStack and OpenNebula , 2012, 2012 9th International Conference on Fuzzy Systems and Knowledge Discovery.

[15]  Dorit S. Hochbaum,et al.  Approximation Algorithms for NP-Hard Problems , 1996 .

[16]  Yedhu Sastri,et al.  A Comparative Study of OpenStack and CloudStack , 2015, 2015 Fifth International Conference on Advances in Computing and Communications (ICACC).

[17]  Cosimo Anglano,et al.  Exploiting VM Migration for the Automated Power and Performance Management of Green Cloud Computing Systems , 2012, E2DC.

[18]  Ali Miri,et al.  Proactive dynamic virtual-machine consolidation for energy conservation in cloud data centres , 2018, Journal of Cloud Computing.

[19]  Rakesh Kumar,et al.  Open Source Solution for Cloud Computing Platform Using OpenStack , 2014 .

[20]  Qiang Huang,et al.  Power Consumption of Virtual Machine Live Migration in Clouds , 2011, 2011 Third International Conference on Communications and Mobile Computing.

[21]  Jordi Torres,et al.  Power-Aware Multi-data Center Management Using Machine Learning , 2013, 2013 42nd International Conference on Parallel Processing.

[22]  Randy H. Katz,et al.  A view of cloud computing , 2010, CACM.

[23]  Marco Guazzone,et al.  Power and Performance Management in Cloud Computing Systems , 2012 .

[24]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[25]  KyoungSoo Park,et al.  CoMon: a mostly-scalable monitoring system for PlanetLab , 2006, OPSR.

[26]  Alexandru Iosup,et al.  Statistical Characterization of Business-Critical Workloads Hosted in Cloud Datacenters , 2015, 2015 15th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing.

[27]  Robert V. Brill,et al.  Applied Statistics and Probability for Engineers , 2004, Technometrics.

[28]  Rajkumar Buyya,et al.  Cost of Virtual Machine Live Migration in Clouds: A Performance Evaluation , 2009, CloudCom.

[29]  Waltenegus Dargie,et al.  Does Live Migration of Virtual Machines Cost Energy? , 2013, 2013 IEEE 27th International Conference on Advanced Information Networking and Applications (AINA).

[30]  Xuan Wang,et al.  A Unified Algorithm for Virtual Desktops Placement in Distributed Cloud Computing , 2016 .

[31]  Thomas F. Wenisch,et al.  PowerNap: eliminating server idle power , 2009, ASPLOS.

[32]  Rajkumar Buyya,et al.  OpenStack Neat: a framework for dynamic and energy‐efficient consolidation of virtual machines in OpenStack clouds , 2015, Concurr. Comput. Pract. Exp..

[33]  Lei Shi,et al.  Empirical evaluation of vector bin packing algorithms for energy efficient data centers , 2013, 2013 IEEE Symposium on Computers and Communications (ISCC).

[34]  Jeffrey D. Ullman,et al.  Worst-Case Performance Bounds for Simple One-Dimensional Packing Algorithms , 1974, SIAM J. Comput..

[35]  Douglas C. Montgomery,et al.  Applied Statistics and Probability for Engineers, Third edition , 1994 .

[36]  Hannu Tenhunen,et al.  Utilization Prediction Aware VM Consolidation Approach for Green Cloud Computing , 2015, 2015 IEEE 8th International Conference on Cloud Computing.