Continuous Datacenter Consolidation

Efficient mapping of Virtual Machines~(VMs) onto physical servers is a key problem for cloud infrastructure providers as hardware utilization directly impacts profit. Today, this mapping is commonly only performed when new VMs are created, but as VM workloads fluctuate and server availability varies, any initial mapping is bound to become suboptimal over time. We introduce a set of heuristic methods for continuous optimization of the VM-to-server mapping based on combinations of fundamental management actions, namely suspending and resuming physical machines, migrating VMs, and suspending and resuming VMs. By using these methods, cloud infrastructure providers can continuously optimize their server resources regardless of the predictability of the workload. To verify that our approach is applicable in real-world scenarios, we build a proof-of-concept datacenter management system that implements the proposed algorithms. The feasibility of our approach is evaluated through a combination of simulations and real experiments where our system provisions a workload of benchmark applications. Our results indicate that the proposed algorithms are feasible, that the combined management approach achieves the best results, and that the VM suspend and resume mechanism has the largest impact on provider profit.

[1]  Li Zhao,et al.  VM3: Measuring, modeling and managing VM shared resources , 2009, Comput. Networks.

[2]  Prashant J. Shenoy,et al.  CloudNet: dynamic pooling of cloud resources by live WAN migration of virtual machines , 2011, VEE.

[3]  Peter J. Varman,et al.  Defragmenting the cloud using demand-based resource allocation , 2013, SIGMETRICS '13.

[4]  Faouzi Kamoun Virtualizing the Datacenter Without Compromising Server Performance , 2009, UBIQ.

[5]  Luiz André Barroso,et al.  The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines , 2009, The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines.

[6]  Feng Zhao,et al.  Energy aware consolidation for cloud computing , 2008, CLUSTER 2008.

[7]  A. Kivity,et al.  kvm : the Linux Virtual Machine Monitor , 2007 .

[8]  Akshat Verma,et al.  Power-aware dynamic placement of HPC applications , 2008, ICS '08.

[9]  Johan Tordsson,et al.  An adaptive hybrid elasticity controller for cloud infrastructures , 2012, 2012 IEEE Network Operations and Management Symposium.

[10]  Gautam Kar,et al.  Application Performance Management in Virtualized Server Environments , 2006, 2006 IEEE/IFIP Network Operations and Management Symposium NOMS 2006.

[11]  Jeffrey O. Kephart,et al.  The Vision of Autonomic Computing , 2003, Computer.

[12]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[13]  Jing Xu,et al.  Multi-Objective Virtual Machine Placement in Virtualized Data Center Environments , 2010, 2010 IEEE/ACM Int'l Conference on Green Computing and Communications & Int'l Conference on Cyber, Physical and Social Computing.

[14]  Jie Wu,et al.  Migration-based virtual machine placement in cloud systems , 2013, 2013 IEEE 2nd International Conference on Cloud Networking (CloudNet).

[15]  Roy Sterritt,et al.  Fulfilling the Vision of Autonomic Computing , 2010, Computer.

[16]  Johan Tordsson,et al.  Modeling for Dynamic Cloud Scheduling Via Migration of Virtual Machines , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[17]  Johan Tordsson,et al.  Virtual Machine Placement for Predictable and Time-Constrained Peak Loads , 2011, GECON.

[18]  Petter Svärd,et al.  The Noble art of Live Migration , 2014 .

[19]  Xavier Lorca,et al.  Entropy: a consolidation manager for clusters , 2009, VEE '09.

[20]  Calton Pu,et al.  A Cost-Sensitive Adaptation Engine for Server Consolidation of Multitier Applications , 2009, Middleware.

[21]  Rubén S. Montero,et al.  Scheduling strategies for optimal service deployment across multiple clouds , 2013, Future Gener. Comput. Syst..

[22]  Dorit S. Hochbaum,et al.  Approximation Algorithms for NP-Hard Problems , 1996 .

[23]  Yin Li,et al.  Joint study on optimizations of data center deployment, VM assignment and migration , 2013, 2013 IEEE/ACM 21st International Symposium on Quality of Service (IWQoS).

[24]  Zhen Xiao,et al.  Dynamic Resource Allocation Using Virtual Machines for Cloud Computing Environment , 2013, IEEE Transactions on Parallel and Distributed Systems.

[25]  Andrzej Kochut,et al.  Dynamic Placement of Virtual Machines for Managing SLA Violations , 2007, 2007 10th IFIP/IEEE International Symposium on Integrated Network Management.

[26]  Johan Tordsson,et al.  Improving cloud infrastructure utilization through overbooking , 2013, CAC.

[27]  David F. Bacon,et al.  Proceedings of the 2009 ACM SIGPLAN/SIGOPS international conference on Virtual execution environments , 2009, VEE 2009.

[28]  Jie Liu,et al.  PACMan: Performance Aware Virtual Machine Consolidation , 2013, ICAC.

[29]  Petter Svärd,et al.  Evaluation of delta compression techniques for efficient live migration of large virtual machines , 2011, VEE '11.

[30]  Haipeng Luo,et al.  Adaptive Resource Provisioning for the Cloud Using Online Bin Packing , 2014, IEEE Transactions on Computers.

[31]  Masaki Samejima,et al.  Dynamic optimization of virtual machine placement by resource usage prediction , 2013, 2013 11th IEEE International Conference on Industrial Informatics (INDIN).

[32]  Anne M. Holler,et al.  Cloud Scale Resource Management: Challenges and Techniques , 2011, HotCloud.

[33]  Jordi Torres,et al.  Characterizing Cloud Federation for Enhancing Providers' Profit , 2010, 2010 IEEE 3rd International Conference on Cloud Computing.

[34]  Stefan Schmid,et al.  Simple Destination-Swap Strategies for Adaptive Intra- and Inter-Tenant VM Migration , 2013, ArXiv.

[35]  Petter Svärd,et al.  Cost-Optimal Cloud Service Placement under Dynamic Pricing Schemes , 2013, 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing.

[36]  Gargi Dasgupta,et al.  Server Workload Analysis for Power Minimization using Consolidation , 2009, USENIX Annual Technical Conference.

[37]  David Sinreich,et al.  An architectural blueprint for autonomic computing , 2006 .