Linux-based virtualization for HPC clusters

There has been an increasing interest in virtualization in the HPC community, as it would allow to easily and efficiently share computing resources between users, and provide a simple solution for checkpointing. However, virtualization raises a number of interesting questions, on performance and overhead, of course, but also on the fairness of the sharing. In this work, we evaluate the suitability of KVM virtual machines in this context, by comparing them with solutions based on Xen. We also outline areas where improvements are needed, to provide directions for future works.

[1]  Chandra Krintz,et al.  Paravirtualization for HPC Systems , 2006, ISPA Workshops.

[2]  David Chisnall,et al.  The Definitive Guide to the Xen Hypervisor , 2007 .

[3]  Alan L. Cox,et al.  Scheduling I/O in virtual machine monitors , 2008, VEE '08.

[4]  Nick Feamster,et al.  In VINI veritas: realistic and controlled network experimentation , 2006, SIGCOMM.

[5]  Chandra Krintz,et al.  Evaluating the Performance Impact of Xen on MPI and Process Execution For HPC Systems , 2006, First International Workshop on Virtualization Technology in Distributed Computing (VTDC 2006).

[6]  No License,et al.  Intel ® 64 and IA-32 Architectures Software Developer ’ s Manual Volume 3 A : System Programming Guide , Part 1 , 2006 .

[7]  Mark Handley,et al.  Fairness issues in software virtual routers , 2008, PRESTO '08.

[8]  Fabienne Anhalt,et al.  Analysis and Experimental Evaluation of Data Plane Virtualization with Xen , 2009, 2009 Fifth International Conference on Networking and Services.

[9]  Jun Nakajima,et al.  Hybrid-Virtualization — Enhanced Virtualization for Linux * , 2010 .

[10]  A. Kivity,et al.  kvm : the Linux Virtual Machine Monitor , 2007 .

[11]  Gil Neiger,et al.  IntelŴVirtualization Technology: Hardware Support for Efficient Processor Virtualization , 2006 .

[12]  Daisuke Takahashi,et al.  The HPC Challenge (HPCC) benchmark suite , 2006, SC.

[13]  Alan L. Cox,et al.  Optimizing network virtualization in Xen , 2006 .

[14]  Franck Cappello,et al.  Scalability Comparison of Four Host Virtualization Tools , 2007, Journal of Grid Computing.

[15]  Rusty Russell,et al.  virtio: towards a de-facto standard for virtual I/O devices , 2008, OPSR.

[16]  Gerald J. Popek,et al.  Formal requirements for virtualizable third generation architectures , 1974, SOSP '73.

[17]  William von Hagen Professional XEN Virtualization , 2008 .