Prediction-based underutilized and destination host selection approaches for energy-efficient dynamic VM consolidation in data centers

Improving the energy efficiency while guaranteeing quality of services (QoS) is one of the main challenges of efficient resource management of large-scale data centers. Dynamic virtual machine (VM) consolidation is a promising approach that aims to reduce the energy consumption by reallocating VMs to hosts dynamically. Previous works mostly have considered only the current utilization of resources in the dynamic VM consolidation procedure, which imposes unnecessary migrations and host power mode transitions. Moreover, they select the destinations of VM migrations with conservative approaches to keep the service-level agreements , which is not in line with packing VMs on fewer physical hosts. In this paper, we propose a regression-based approach that predicts the resource utilization of the VMs and hosts based on their historical data and uses the predictions in different problems of the whole process. Predicting future utilization provides the opportunity of selecting the host with higher utilization for the destination of a VM migration, which leads to a better VMs placement from the viewpoint of VM consolidation. Results show that our proposed approach reduces the energy consumption of the modeled data center by up to 38% compared to other works in the area, guaranteeing the same QoS. Moreover, the results show a better scalability than all other approaches. Our proposed approach improves the energy efficiency even for the largest simulated benchmarks and takes less than 5% time overhead to execute for a data center with 7600 physical hosts.

[1]  Richard E. Brown,et al.  United States Data Center Energy Usage Report , 2016 .

[2]  KyoungSoo Park,et al.  CoMon: a mostly-scalable monitoring system for PlanetLab , 2006, OPSR.

[3]  Huaglory Tianfield,et al.  Energy-Aware Dynamic Virtual Machine Consolidation for Cloud Datacenters , 2018, IEEE Access.

[4]  David Atienza,et al.  Integrating Heuristic and Machine-Learning Methods for Efficient Virtual Machine Allocation in Data Centers , 2018, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[5]  Sangyoon Oh,et al.  Sercon: Server Consolidation Algorithm using Live Migration of Virtual Machines for Green Computing , 2011 .

[6]  Helmut Hlavacs,et al.  An Intelligent and Adaptive Threshold-Based Schema for Energy and Performance Efficient Dynamic VM Consolidation , 2013, EE-LSDS.

[7]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[8]  Qingsheng Zhu,et al.  Energy and Migration Cost-Aware Dynamic Virtual Machine Consolidation in Heterogeneous Cloud Datacenters , 2019, IEEE Transactions on Services Computing.

[9]  A. Fox,et al.  Cloudstone : Multi-Platform , Multi-Language Benchmark and Measurement Tools for Web 2 . 0 , 2008 .

[10]  Victor Chang,et al.  Energy-efficient and quality-aware VM consolidation method , 2020, Future Gener. Comput. Syst..

[11]  Pasi Liljeberg,et al.  LiRCUP: Linear Regression Based CPU Usage Prediction Algorithm for Live Migration of Virtual Machines in Data Centers , 2013, 2013 39th Euromicro Conference on Software Engineering and Advanced Applications.

[12]  Mohamed Othman,et al.  Energy-Efficient Algorithms for Dynamic Virtual Machine Consolidation in Cloud Data Centers , 2017, IEEE Access.

[13]  Shoubin Dong,et al.  An energy-aware heuristic framework for virtual machine consolidation in Cloud computing , 2014, The Journal of Supercomputing.

[14]  Ivan Porres,et al.  Multi-objective dynamic virtual machine consolidation in the cloud using ant colony system , 2017, Int. J. Parallel Emergent Distributed Syst..

[15]  Rashedur M. Rahman,et al.  Implementation of modified overload detection technique with VM selection strategies based on heuristics and migration control , 2015, 2015 IEEE/ACIS 14th International Conference on Computer and Information Science (ICIS).

[16]  T. V. Lakshman,et al.  Optimizing data access latencies in cloud systems by intelligent virtual machine placement , 2013, 2013 Proceedings IEEE INFOCOM.

[17]  BuyyaRajkumar,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012 .

[18]  Suhib Bani Melhem,et al.  Markov Prediction Model for Host Load Detection and VM Placement in Live Migration , 2018, IEEE Access.

[19]  Antti Ylä-Jääski,et al.  Virtual Machine Consolidation with Multiple Usage Prediction for Energy-Efficient Cloud Data Centers , 2020, IEEE Transactions on Services Computing.

[20]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[21]  Michael B. Miller Linear Regression Analysis , 2013 .

[22]  Rajkumar Buyya,et al.  Exploiting user provided information in dynamic consolidation of virtual machines to minimize energy consumption of cloud data centers , 2018, 2018 Third International Conference on Fog and Mobile Edge Computing (FMEC).

[23]  Abbas Horri,et al.  Novel resource allocation algorithms to performance and energy efficiency in cloud computing , 2014, The Journal of Supercomputing.

[24]  P. G. J. Leelipushpam,et al.  Live VM migration techniques in cloud environment — A survey , 2013, 2013 IEEE CONFERENCE ON INFORMATION AND COMMUNICATION TECHNOLOGIES.

[25]  S. I. V. Sousa,et al.  Multiple linear regression and artificial neural networks based on principal components to predict ozone concentrations , 2007, Environ. Model. Softw..

[26]  D. Zarefsky The U.S. and the world , 2014 .

[27]  David Atienza,et al.  MAGNETIC: Multi-Agent Machine Learning-Based Approach for Energy Efficient Dynamic Consolidation in Data Centers , 2019, IEEE Transactions on Services Computing.