Template-based memory deduplication method for inter-data center live migration of virtual machines

Live migration of virtual machines (VMs) can benefit data centers through load balancing, fault tolerance, energy saving, etc. Although live migration between geographically distributed data centers can enable optimized scheduling of resources in a large area, it remains expensive and difficult to implement. One of the main challenges is transferring the memory state over WAN. There is a conflict between the low data transmission speed over WAN and the rapid change of memory contents. This paper proposes a novel live migration method with page-count-based data deduplication, which takes advantage of the fact that VMs running same or similar operating systems and other software tend to have identical memory pages. Template pages are selected based on number of occurrences of each page across multiple VMs and indexed by content hash. When a memory page is transferred, the source host first compares it with the templates. If a match is identified, the source host transfers the index instead of the data of the memory page. The experimental results show that our approach reduces the migration time by 27% and the data transferred by 38% on average compared to the default method of QEMU-KVM.

[1]  Pierre Riteau,et al.  Dynamic execution platforms over federated clouds , 2011 .

[2]  Takahiro Hirofuchi,et al.  A Fast Virtual Machine Storage Migration Technique Using Data Deduplication , 2012, CLOUD 2012.

[3]  Hai Jin,et al.  Live virtual machine migration with adaptive, memory compression , 2009, 2009 IEEE International Conference on Cluster Computing and Workshops.

[4]  Matei Ripeanu,et al.  VMFlock: virtual machine co-migration for the cloud , 2011, HPDC '11.

[5]  Hai Jin,et al.  Live migration of virtual machine based on full system trace and replay , 2009, HPDC '09.

[6]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[7]  George Varghese,et al.  Difference engine , 2010, OSDI.

[8]  Prashant J. Shenoy,et al.  The Case for Enterprise-Ready Virtual Private Clouds , 2009, HotCloud.

[9]  Die Hu,et al.  Priority-Based Live Migration of Virtual Machine , 2013, GPC.

[10]  Leon Gommans,et al.  Seamless live migration of virtual machines over the MAN/WAN , 2006, Future Gener. Comput. Syst..

[11]  Nghi Nguyen,et al.  Comparative Analysis of the Hardware Implementations of Hash Functions SHA-1 and SHA-512 , 2002, ISC.

[12]  Peter Desnoyers,et al.  Memory buddies: exploiting page sharing for smart colocation in virtualized data centers , 2009, VEE '09.

[13]  Carl A. Waldspurger,et al.  Memory resource management in VMware ESX server , 2002, OSDI '02.

[14]  Christine Morin,et al.  Shrinker: Improving Live Migration of Virtual Clusters over WANs with Distributed Data Deduplication and Content-Based Addressing , 2011, Euro-Par.

[15]  Satoshi Sekiguchi,et al.  A Live Storage Migration Mechanism over WAN for Relocatable Virtual Machine Services on Clouds , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[16]  Jie Zheng,et al.  Workload-aware live storage migration for clouds , 2011, VEE '11.

[17]  Wei Huang,et al.  High performance virtual machine migration with RDMA over modern interconnects , 2007, 2007 IEEE International Conference on Cluster Computing.

[18]  Umesh Deshpande,et al.  Gang Migration of Virtual Machines Using Cluster-wide Deduplication , 2013, 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing.

[19]  Umesh Deshpande,et al.  Live gang migration of virtual machines , 2011, HPDC '11.

[20]  Jie Ma,et al.  Exploiting Data Deduplication to Accelerate Live Virtual Machine Migration , 2010, 2010 IEEE International Conference on Cluster Computing.