Profiling-Based Workload Consolidation and Migration in Virtualized Data Centers

Improving energy efficiency of data centers has become increasingly important nowadays due to the significant amounts of power needed to operate these centers. An important method for achieving energy efficiency is server consolidation supported by virtualization. However, server consolidation may incur significant degradation to workload performance due to virtual machine (VM) co-location and migration. How to reduce such performance degradation becomes a critical issue to address. In this paper, we propose a profiling-based server consolidation framework which minimizes the number of physical machines (PMs) used in data centers while maintaining satisfactory performance of various workloads. Inside this framework, we first profile the performance losses of various workloads under two situations: running in co-location and experiencing migrations. We then design two modules: (1) consolidation planning module which, given a set of workloads, minimizes the number of PMs by an integer programming model, and (2) migration planning module which, given a source VM placement scenario and a target VM placement scenario, minimizes the number of VM migrations by a polynomial time algorithm. Also, based on the workload performance profiles, both modules can guarantee the performance losses of various workloads below configurable thresholds. Our experiments for workload profiling are conducted with real data center workloads and our experiments on our two modules validate the integer programming model and the polynomial time algorithm.

[1]  Albert Y. Zomaya,et al.  Energy efficient utilization of resources in cloud computing systems , 2010, The Journal of Supercomputing.

[2]  Xiaomin Zhang,et al.  Characterization & analysis of a server consolidation benchmark , 2008, VEE '08.

[3]  Cho-Li Wang,et al.  Dynamic Optimization of Multiattribute Resource Allocation in Self-Organizing Clouds , 2013, IEEE Transactions on Parallel and Distributed Systems.

[4]  Martin Bichler,et al.  A Mathematical Programming Approach for Server Consolidation Problems in Virtualized Data Centers , 2010, IEEE Transactions on Services Computing.

[5]  Calton Pu,et al.  An Analysis of Performance Interference Effects in Virtual Environments , 2007, 2007 IEEE International Symposium on Performance Analysis of Systems & Software.

[6]  Feng Zhao,et al.  Energy aware consolidation for cloud computing , 2008, CLUSTER 2008.

[7]  Paula Smith,et al.  VMmark: A Scalable Benchmark for Virtualized Systems , 2006 .

[8]  Rajkumar Buyya,et al.  Managing Overloaded Hosts for Dynamic Consolidation of Virtual Machines in Cloud Data Centers under Quality of Service Constraints , 2013, IEEE Transactions on Parallel and Distributed Systems.

[9]  Zhenhuan Gong,et al.  PAC: Pattern-driven Application Consolidation for Efficient Cloud Computing , 2010, 2010 IEEE International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems.

[10]  Albert Y. Zomaya,et al.  Priority-Based Consolidation of Parallel Workloads in the Cloud , 2013, IEEE Transactions on Parallel and Distributed Systems.

[11]  Jordi Torres,et al.  Autonomic Placement of Mixed Batch and Transactional Workloads , 2012, IEEE Transactions on Parallel and Distributed Systems.

[12]  Baochun Li,et al.  Anchor: A Versatile and Efficient Framework for Resource Management in the Cloud , 2013, IEEE Transactions on Parallel and Distributed Systems.

[13]  Xiaona Li,et al.  Cost-Aware Cooperative Resource Provisioning for Heterogeneous Workloads in Data Centers , 2013, IEEE Transactions on Computers.

[14]  James J. Filliben,et al.  An Efficient Sensitivity Analysis Method for Large Cloud Simulations , 2011, 2011 IEEE 4th International Conference on Cloud Computing.

[15]  Deshi Ye,et al.  Virt-LM: a benchmark for live migration of virtual machine (abstracts only) , 2011, PERV.

[16]  César A. F. De Rose,et al.  Server consolidation with migration control for virtualized data centers , 2011, Future Gener. Comput. Syst..

[17]  Gargi Dasgupta,et al.  Server Workload Analysis for Power Minimization using Consolidation , 2009, USENIX Annual Technical Conference.

[18]  Albert Y. Zomaya,et al.  Energy Conscious Scheduling for Distributed Computing Systems under Different Operating Conditions , 2011, IEEE Transactions on Parallel and Distributed Systems.

[19]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[20]  Xavier Lorca,et al.  Entropy: a consolidation manager for clusters , 2009, VEE '09.

[21]  Hai Jin,et al.  Performance and energy modeling for live migration of virtual machines , 2011, Cluster Computing.

[22]  Akshat Verma,et al.  pMapper: Power and Migration Cost Aware Application Placement in Virtualized Systems , 2008, Middleware.

[23]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.