Principles and Performance Characteristics of Algorithms for Live VM Migration

Since first demonstrated by Clark et al. in 2005, live migration of virtual machines has both become a standard feature of hypervisors and created an active field of research. However, the rich ongoing research in live migration focusmainly on performance improvements to well-known techniques, most of them being variations of the Clark approach. In order to advance live migration beyond incremental performance improvements, it is important to gain a deeper understanding of the live migration problem itself and its underlying principles. To address this issue, this contribution takes a step back and investigates the essential characteristics of live migration. The paper identifies five fundamental properties of live migration and uses these to investigate, categorize, and compare three approaches to live migration: precopy, postcopy and hybrid. The evaluated algorithms include well-known techniques derived from that of Clark as well as novel RDMA in-kernel approaches. Our analysis of the fundamental properties of the algorithms is validated by a set of experiments. In these, we migrate virtual machines with large memory sizes hosting workloads with high page dirtying rates to expose differences and limitations of the different approaches. Finally, we provide guidelines for which approach to use in different scenarios.

[1]  Limin Xiao,et al.  Mvmotion: a metadata based virtual machine migration in cloud , 2013, Cluster Computing.

[2]  S. Sahni,et al.  A Hybrid Approach to Live Migration of Virtual Machines , 2012, 2012 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM).

[3]  Lucas Chaufournier,et al.  CloudNet: Dynamic Pooling of Cloud Resources by Live WAN Migration of Virtual Machines , 2011, IEEE/ACM Transactions on Networking.

[4]  Waltenegus Dargie,et al.  Does Live Migration of Virtual Machines Cost Energy? , 2013, 2013 IEEE 27th International Conference on Advanced Information Networking and Applications (AINA).

[5]  Anja Strunk Costs of Virtual Machine Live Migration: A Survey , 2012, 2012 IEEE Eighth World Congress on Services.

[6]  Prashant J. Shenoy,et al.  "Cut me some slack": latency-aware live migration for databases , 2012, EDBT '12.

[7]  Bernhard Egger,et al.  Efficient live migration of virtual machines using shared storage , 2013, VEE '13.

[8]  Pengcheng Liu,et al.  Heterogeneous Live Migration of Virtual Machines , 2008 .

[9]  Benoit Hudzia,et al.  Improving the live migration process of large enterprise applications , 2009, VTDC '09.

[10]  Hiroshi Yamada,et al.  Towards unobtrusive VM live migration for cloud computing platforms , 2012, APSys.

[11]  Franck Cappello,et al.  A hybrid local storage transfer scheme for live migration of I/O intensive workloads , 2012, HPDC '12.

[12]  Andrew Warfield,et al.  RemusDB: transparent high availability for database systems , 2011, The VLDB Journal.

[13]  Dutch T. Meyer,et al.  Remus: High Availability via Asynchronous Virtual Machine Replication. (Best Paper) , 2008, NSDI.

[14]  Anju Mohan,et al.  Survey on Live VM Migration Techniques , 2013 .

[15]  Umesh Deshpande,et al.  Inter-rack live migration of multiple virtual machines , 2012, VTDC '12.

[16]  E. S. Pilli,et al.  Live virtual machine migration techniques: Survey and research challenges , 2013, 2013 3rd IEEE International Advance Computing Conference (IACC).

[17]  Wei Luo,et al.  A Live Migration Strategy for Virtual Machine Based on Performance Predicting , 2012, 2012 International Conference on Computer Science and Service System.

[18]  Lei Zhang,et al.  CompSC: live migration with pass-through devices , 2012, VEE '12.

[19]  Hai Jin,et al.  Performance and energy modeling for live migration of virtual machines , 2011, Cluster Computing.

[20]  David Black-Schaffer,et al.  Phase guided profiling for fast cache modeling , 2012, CGO '12.

[21]  Ryousei Takano,et al.  MiyakoDori: A Memory Reusing Mechanism for Dynamic VM Consolidation , 2012, 2012 IEEE Fifth International Conference on Cloud Computing.

[22]  Weidong Liu,et al.  TSMC: A Novel Approach for Live Virtual Machine Migration , 2014, J. Appl. Math..

[23]  Arun Venkataramani,et al.  Black-box and Gray-box Strategies for Virtual Machine Migration , 2007, NSDI.

[24]  Matei Ripeanu,et al.  VMFlock: virtual machine co-migration for the cloud , 2011, HPDC '11.

[25]  Fan Ying,et al.  A new live virtual machine migration strategy , 2012, 2012 International Symposium on Information Technologies in Medicine and Education.

[26]  Satoshi Sekiguchi,et al.  Reactive consolidation of virtual machines enabled by postcopy live migration , 2011, VTDC '11.

[27]  Jie Zheng,et al.  Workload-aware live storage migration for clouds , 2011, VEE '11.

[28]  Petter Svärd,et al.  High Performance Live Migration through Dynamic Page Transfer Reordering and Compression , 2011, 2011 IEEE Third International Conference on Cloud Computing Technology and Science.

[29]  Bo Li,et al.  VMScatter: migrate virtual machines to many hosts , 2013, VEE '13.

[30]  Gianluigi Zanetti,et al.  Suspending, migrating and resuming HPC virtual clusters , 2010, Future Gener. Comput. Syst..

[31]  Jong Kim,et al.  Guide-copy: Fast and silent migration of virtual machine for datacenters , 2013, 2013 SC - International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[32]  Petter Svärd,et al.  Evaluation of delta compression techniques for efficient live migration of large virtual machines , 2011, VEE '11.

[33]  Binoy Ravindran,et al.  HSG-LM: hybrid-copy speculative guest OS live migration without hypervisor , 2013, SYSTOR '13.

[34]  Kai Shen,et al.  Virtual Machine Memory Access Tracing with Hypervisor Exclusive Cache , 2007, USENIX Annual Technical Conference.

[35]  Kartik Gopalan,et al.  Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning , 2009, VEE '09.

[36]  Hao Jiang,et al.  A quantitative study of virtual machine live migration , 2013, CAC.

[37]  K. K. Ramakrishnan,et al.  Live data center migration across WANs: a robust cooperative context aware approach , 2007, INM '07.

[38]  Satoshi Sekiguchi,et al.  Reactive Cloud: Consolidating Virtual Machines with Postcopy Live Migration , 2012 .

[39]  Satoshi Sekiguchi,et al.  A Live Storage Migration Mechanism over WAN for Relocatable Virtual Machine Services on Clouds , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[40]  Benoit Hudzia,et al.  Pre-Copy and Post-Copy VM Live Migration for Memory Intensive Applications , 2012, Euro-Par Workshops.

[41]  Xiang Zhou,et al.  A VM migration and service network bandwidth analysis model in IaaS , 2012, 2012 2nd International Conference on Consumer Electronics, Communications and Networks (CECNet).

[42]  Jian Yang,et al.  Parallelizing live migration of virtual machines , 2013, VEE '13.

[43]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.