VMbuddies: Coordinating Live Migration of Multi-Tier Applications in Cloud Environments

Enabled by virtualization technologies, various multi-tier applications (such as web applications) are hosted by virtual machines (VMs) in cloud data centers. Live migration of multi-tier applications across geographically distributed data centers is important for load management, power saving, routine server maintenance and quality-of-service. Different from a single-VM migration, VMs in a multi-tier application are closely correlated, which results in a correlated VM migrations problem. Current live migration algorithms for single-VM cause significant application performance degradation because intermediate data exchange between different VMs suffers relatively low bandwidth and high latency across distributed data centers. In this paper, we design and implement a coordination system called VMbuddies for correlated VM migrations in the cloud. Particularly, we propose an adaptive network bandwidth allocation algorithm to minimize the migration cost in terms of migration completion time, network traffic and migration downtime. Experiments using a public benchmark show that VMbuddies significantly reduces the performance degradation and migration cost of multi-tier applications.

[1]  Jie Zheng,et al.  Workload-aware live storage migration for clouds , 2011, VEE '11.

[2]  Eyal de Lara,et al.  Jettison: efficient idle desktop consolidation with partial VM migration , 2012, EuroSys '12.

[3]  Bingsheng He,et al.  Transformation-Based Monetary CostOptimizations for Workflows in the Cloud , 2014, IEEE Transactions on Cloud Computing.

[4]  Umesh Deshpande,et al.  Live gang migration of virtual machines , 2011, HPDC '11.

[5]  Hakim Weatherspoon,et al.  The Xen-Blanket: virtualize once, run everywhere , 2012, EuroSys '12.

[6]  Roie Zivan,et al.  Max/min-sum distributed constraint optimization through value propagation on an alternating DAG , 2012, AAMAS.

[7]  Jian Yang,et al.  Parallelizing live migration of virtual machines , 2013, VEE '13.

[8]  William H. Press,et al.  Numerical Recipes: The Art of Scientific Computing , 1987 .

[9]  Dinan Gunawardena,et al.  Chatty Tenants and the Cloud Network Sharing Problem , 2013, NSDI.

[10]  Rajkumar Buyya,et al.  Cost of Virtual Machine Live Migration in Clouds: A Performance Evaluation , 2009, CloudCom.

[11]  Yellu Sreenivasulu,et al.  FAST TRANSPARENT MIGRATION FOR VIRTUAL MACHINES , 2014 .

[12]  Hai Jin,et al.  Live Virtual Machine Migration via Asynchronous Replication and State Synchronization , 2011, IEEE Transactions on Parallel and Distributed Systems.

[13]  Anja Feldmann,et al.  Live wide-area migration of virtual machines including local persistent state , 2007, VEE '07.

[14]  Hai Jin,et al.  Performance and energy modeling for live migration of virtual machines , 2011, HPDC.

[15]  Di Xie,et al.  The only constant is change: incorporating time-varying network reservations in data centers , 2012, CCRV.

[16]  Matei Ripeanu,et al.  VMFlock: virtual machine co-migration for the cloud , 2011, HPDC '11.

[17]  Hai Jin,et al.  Live migration of virtual machine based on full system trace and replay , 2009, HPDC '09.

[18]  ChiuehTzi-cker,et al.  Introspection-based memory de-duplication and migration , 2013 .

[19]  Leon Gommans,et al.  Seamless live migration of virtual machines over the MAN/WAN , 2006, Future Gener. Comput. Syst..

[20]  Bernhard Egger,et al.  Efficient live migration of virtual machines using shared storage , 2013, VEE '13.

[21]  Ajay Gulati,et al.  hClock: hierarchical QoS for packet scheduling in a hypervisor , 2013, EuroSys '13.

[22]  Vijay Mann,et al.  Remedy: Network-Aware Steady State VM Management for Data Centers , 2012, Networking.

[23]  Tal Garfinkel,et al.  The Design and Evolution of Live Storage Migration in VMware ESX , 2011, USENIX Annual Technical Conference.

[24]  Autar Kaw,et al.  The Secant Method , 2009 .

[25]  Julian Satran,et al.  Design of the iSCSI protocol , 2003, 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, 2003. (MSST 2003). Proceedings..

[26]  Shinji Kikuchi,et al.  Impact of Live Migration on Multi-tier Application Performance in Clouds , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[27]  Jerome A. Rolia,et al.  Workload Analysis and Demand Prediction of Enterprise Data Center Applications , 2007, 2007 IEEE 10th International Symposium on Workload Characterization.

[28]  Bingsheng He,et al.  Green-aware workload scheduling in geographically distributed data centers , 2012, 4th IEEE International Conference on Cloud Computing Technology and Science Proceedings.

[29]  Jie Zheng,et al.  Pacer: A Progress Management System for Live Virtual Machine Migration in Cloud Computing , 2013, IEEE Transactions on Network and Service Management.

[30]  Hai Jin,et al.  Live virtual machine migration with adaptive, memory compression , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.

[31]  Bingsheng He,et al.  A Survey of Resource Management in Multi-Tier Web Applications , 2014, IEEE Communications Surveys & Tutorials.

[32]  Bruce M. Maggs,et al.  Cutting the electric bill for internet-scale systems , 2009, SIGCOMM '09.

[33]  Albert G. Greenberg,et al.  EyeQ: Practical Network Performance Isolation at the Edge , 2013, NSDI.

[34]  Xueyan Tang,et al.  On Server Provisioning for Distributed Interactive Applications , 2013, 2013 IEEE 33rd International Conference on Distributed Computing Systems.

[35]  Kartik Gopalan,et al.  Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning , 2009, VEE '09.

[36]  Carl A. Waldspurger,et al.  Memory resource management in VMware ESX server , 2002, OSDI '02.

[37]  R. M. Mattheyses,et al.  A Linear-Time Heuristic for Improving Network Partitions , 1982, 19th Design Automation Conference.

[38]  Khaled Z. Ibrahim,et al.  Optimized pre-copy live migration for memory intensive applications , 2011, 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[39]  Helmut Hlavacs,et al.  Predicting web service levels during VM live migrations , 2011, 2011 5th International DMTF Academic Alliance Workshop on Systems and Virtualization Management: Standards and the Cloud (SVM).

[40]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[41]  Lucas Chaufournier,et al.  CloudNet: Dynamic Pooling of Cloud Resources by Live WAN Migration of Virtual Machines , 2011, IEEE/ACM Transactions on Networking.