Virtual Machine Consolidation with Multiple Usage Prediction for Energy-Efficient Cloud Data Centers

Virtual machine consolidation aims at reducing the number of active physical servers in a data center so as to decrease the total power consumption. In this context, most of the existing solutions rely on aggressive virtual machine migration, thus resulting in unnecessary overhead and energy wastage. Besides, virtual machine consolidation should take into account multiple resource types at the same time, since CPU is not the only critical resource in cloud data centers. In fact, also memory and network bandwidth can become a bottleneck, possibly causing violations in the service level agreement. This article presents a virtual machine consolidation algorithm with multiple usage prediction (VMCUP-M) to improve the energy efficiency of cloud data centers. In this context, multiple usage refers to both resource types and the horizon employed to predict future utilization. Our algorithm is executed during the virtual machine consolidation process to estimate the long-term utilization of multiple resource types based on the local history of the considered servers. The joint use of current and predicted resource utilization allows for a reliable characterization of overloaded and underloaded servers, thereby reducing both the load and the power consumption after consolidation. We evaluate our solution through simulations on both synthetic and real-world workloads. The obtained results show that consolidation with multiple usage prediction reduces the number of migrations and the power consumption of the servers while complying with the service level agreement.

[1]  S. Weisberg,et al.  Applied Linear Regression (2nd ed.). , 1986 .

[2]  Laurent Lefèvre,et al.  A survey on techniques for improving the energy efficiency of large-scale distributed systems , 2014, ACM Comput. Surv..

[3]  Michela Meo,et al.  Probabilistic Consolidation of Virtual Machines in Self-Organizing Cloud Data Centers , 2013, IEEE Transactions on Cloud Computing.

[4]  Antti Ylä-Jääski,et al.  A Multi-resource Selection Scheme for Virtual Machine Consolidation in Cloud Data Centers , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[5]  Malik Beshir Malik,et al.  Applied Linear Regression , 2005, Technometrics.

[6]  Christoph Meinel,et al.  Robust Virtual Machine Consolidation for Efficient Energy and Performance in Virtualized Data Centers , 2014, 2014 IEEE International Conference on Internet of Things(iThings), and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom).

[7]  Rajkumar Buyya,et al.  Article in Press Future Generation Computer Systems ( ) – Future Generation Computer Systems Cloud Computing and Emerging It Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility , 2022 .

[8]  Singh Ghuman,et al.  Cloud Computing-A Study of Infrastructure as a Service , 2015 .

[9]  Rajkumar Buyya,et al.  SLA-based virtual machine management for heterogeneous workloads in a cloud datacenter , 2014, J. Netw. Comput. Appl..

[10]  Rajkumar Buyya,et al.  Managing Overloaded Hosts for Dynamic Consolidation of Virtual Machines in Cloud Data Centers under Quality of Service Constraints , 2013, IEEE Transactions on Parallel and Distributed Systems.

[11]  Antti Ylä-Jääski,et al.  Virtual Machine Consolidation with Usage Prediction for Energy-Efficient Cloud Data Centers , 2015, 2015 IEEE 8th International Conference on Cloud Computing.

[12]  Xiangming Dai,et al.  Energy-Efficient Virtual Machines Scheduling in Multi-Tenant Data Centers , 2016, IEEE Transactions on Cloud Computing.

[13]  Sylvain Arlot,et al.  A survey of cross-validation procedures for model selection , 2009, 0907.4728.

[14]  Magne Jørgensen,et al.  Experience With the Accuracy of Software Maintenance Task Effort Prediction Models , 1995, IEEE Trans. Software Eng..

[15]  Kevin Lee,et al.  Empirical prediction models for adaptive resource provisioning in the cloud , 2012, Future Gener. Comput. Syst..

[16]  Mohsen Guizani,et al.  Energy-efficient cloud resource management , 2014, 2014 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[17]  Adrian Ramirez-Nafarrate,et al.  Collaborative Agents for Distributed Load Management in Cloud Data Centers Using Live Migration of Virtual Machines , 2015, IEEE Transactions on Services Computing.

[18]  Jinzy Zhu,et al.  Cloud Computing Technologies and Applications , 2010, Handbook of Cloud Computing.

[19]  Prashant J. Shenoy,et al.  Energy-aware load balancing in content delivery networks , 2011, 2012 Proceedings IEEE INFOCOM.

[20]  Feng Xia,et al.  A survey on virtual machine migration and server consolidation frameworks for cloud data centers , 2015, J. Netw. Comput. Appl..

[21]  César A. F. De Rose,et al.  Server consolidation with migration control for virtualized data centers , 2011, Future Gener. Comput. Syst..

[22]  Zhen Xiao,et al.  Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment , 2013, IEEE Transactions on Parallel and Distributed Systems.

[23]  Erik Elmroth,et al.  Service Level and Performance Aware Dynamic Resource Allocation in Overbooked Data Centers , 2016, 2016 16th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid).

[24]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[25]  Rajkumar Buyya,et al.  CloudSim: a toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms , 2011, Softw. Pract. Exp..

[26]  Ching-Hsien Hsu,et al.  Optimizing Energy Consumption with Task Consolidation in Clouds , 2014, Inf. Sci..

[27]  S. Weisberg Applied Linear Regression, 2nd Edition. , 1987 .

[28]  Pasi Liljeberg,et al.  LiRCUP: Linear Regression Based CPU Usage Prediction Algorithm for Live Migration of Virtual Machines in Data Centers , 2013, 2013 39th Euromicro Conference on Software Engineering and Advanced Applications.

[29]  Bu-Sung Lee,et al.  Optimization of Resource Provisioning Cost in Cloud Computing , 2012, IEEE Transactions on Services Computing.

[30]  Nikolay Mehandjiev,et al.  On Achieving Energy Efficiency and Reducing CO2 Footprint in Cloud Computing , 2016, IEEE Transactions on Cloud Computing.

[31]  Arun Venkataramani,et al.  Black-box and Gray-box Strategies for Virtual Machine Migration , 2007, NSDI.

[32]  Athanasios V. Vasilakos,et al.  Cloud Computing , 2014, ACM Comput. Surv..