An evaluation of multiple communication interfaces for virtualized SMP clusters

Clusters with multiple CPU nodes are becoming increasingly popular due to their cost/performance ratio. Due to its many potential advantages, interest in using virtualization on these systems has also increased. Although several studies on the applicability of Xen for high performance computing have been made, most overlook the issue of multiple network interfaces. In this paper, we present an update to the state of art of Xen and give a comprehensive performance evaluation of the various network configurations that can be implemented using multiple gigabit ethernet (GigE) interfaces. We introduce new Xen network configurations, which enable the Xen guests to efficiently utilize the available network infrastructure compared to the default Xen network configurations. The evaluation of these configurations show 10--50% improvement in the NAS Parallel Benchmark suite compared to the default configurations. For these new configuration on multiple SMP nodes, the results also indicate that the need for fast intra-domain communication mechanisms is not compelling. We also detail the MPI implementations in the case of multiple GigE interfaces and their impact on a virtualized environment.