Live wide-area migration of virtual machines including local persistent state

So far virtual machine (VM) migration has focused on transferring the run-time memory state of the VMs in local area networks (LAN). However, for wide-area network (WAN) migration it is crucial to not just transfer the VMs image but also transfer its local persistent state (its file system) and its on-going network connections. In this paper we address both: by combining a block-level solution with pre-copying and write throttling we show that we can transfer an entire running web server, including its local persistent state, with minimal disruption --- three seconds in the LAN and 68 seconds in the WAN); by combining dynDNS with tunneling, existing connections can continue transparently while new ones are redirected to the new network location. Thus we show experimentally that by combining well-known techniques in a novel manner we can provide system support for migrating virtual execution environments in the wide area.

[1]  Andrew Warfield,et al.  Facilitating the Development of Soft Devices , 2005, USENIX Annual Technical Conference, General Track.

[2]  C. E. Perkins Mobile IP , 1997 .

[3]  Steven Hand,et al.  Controlling the XenoServer Open Platform , 2003, 2003 IEEE Conference onOpen Architectures and Network Programming..

[4]  Brian Vinter,et al.  The Grid Block Device: Performance in LAN and WAN Environments , 2005, EGC.

[5]  Peter T. Breuer,et al.  The Network Block Device , 2000 .

[6]  H. Apte,et al.  Serverless Network File Systems , 2006 .

[7]  Mahadev Satyanarayanan,et al.  An empirical study of a wide-area distributed file system , 1996, TOCS.

[8]  Miguel Castro,et al.  Farsite: federated, available, and reliable storage for an incompletely trusted environment , 2002, OPSR.

[9]  Azer Bestavros,et al.  Distributed packet rewriting and its application to scalable server architectures , 1998, Proceedings Sixth International Conference on Network Protocols (Cat. No.98TB100256).

[10]  Mahadev Satyanarayanan,et al.  Disconnected Operation in the Coda File System , 1999, Mobidata.

[11]  Jason Nieh,et al.  Proceedings of the 5th Symposium on Operating Systems Design and Implementation , 2022 .

[12]  Eric Jul,et al.  Self-migration of operating systems , 2004, EW 11.

[13]  Monica S. Lam,et al.  Optimizing the migration of virtual computers , 2002, OPSR.

[14]  Charles E. Perkins,et al.  IP Encapsulation within IP , 1996, RFC.

[15]  Keir Fraser,et al.  Global-scale Service Deployment in the XenoServer Platform , 2004, WORLDS.

[16]  Fred Douglis,et al.  Transparent process migration: Design alternatives and the sprite implementation , 1991, Softw. Pract. Exp..

[17]  Larry L. Peterson,et al.  Reliability and Security in the CoDeeN Content Distribution Network , 2004, USENIX Annual Technical Conference, General Track.

[18]  Mahadev Satyanarayanan,et al.  Internet suspend/resume , 2002, Proceedings Fourth IEEE Workshop on Mobile Computing Systems and Applications.

[19]  Spencer Shepler NFS Version 4 Design Considerations , 1999, RFC.

[20]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[21]  Andy Barnhart,et al.  The common Internet file system , 1997 .

[22]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[23]  Julian Satran,et al.  Design of the iSCSI protocol , 2003, 20th IEEE/11th NASA Goddard Conference on Mass Storage Systems and Technologies, 2003. (MSST 2003). Proceedings..

[24]  Ian T. Foster,et al.  The anatomy of the grid: enabling scalable virtual organizations , 2001, Proceedings First IEEE/ACM International Symposium on Cluster Computing and the Grid.

[25]  Evangelos Kotsovinos,et al.  Global public computing , 2005 .

[26]  Leon Gommans,et al.  Seamless live migration of virtual machines over the MAN/WAN , 2006, Future Gener. Comput. Syst..

[27]  Hari Balakrishnan,et al.  An end-to-end approach to host mobility , 2000, MobiCom '00.

[28]  Jin-Soo Kim,et al.  GNBD/VIA: a network block device over virtual interface architecture on Linux , 2002, Proceedings 16th International Parallel and Distributed Processing Symposium.

[29]  Matthew T. O'Keefe,et al.  The Global File System , 1996 .

[30]  Henning Schulzrinne,et al.  Application-layer mobility using SIP , 2000, MOCO.