Optimizing Grid Site Manager Performance with Virtual Machines

Virtualization can enhance the functionality and ease the management of current and future Grids by enabling on-demand creation of services and virtual clusters with customized environments, QoS provisioning and policy-based resource allocation. In this work, we consider the use of virtual machines (VMs) in a data-center environment, where a significant portion of resources from a shared pool are dedicated to Grid job processing. The goal is to improve efficiency while supporting a variety of different workloads. We analyze workload data for the past year from a Tier-2 Resource Center at the RRC Kurchatov Institute (Moscow, Russia). Our analysis reveals that a large fraction of Grid jobs have low CPU utilization, which suggests that using virtual machines to isolate execution of different Grid jobs on the shared hardware might be beneficial for optimizing the data-center resource usage. Our simulation results show that with only half the original infrastructure employing VMs (50 nodes and four VMs per node) we can support 99% of the load processed by the original system (100 nodes). Finally, we describe a prototype implementation of a virtual machine management system for Grid computing.

[1]  Renato J. O. Figueiredo,et al.  A case for grid computing on virtual machines , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[2]  Mor Harchol-Balter,et al.  Exploiting process lifetime distributions for dynamic load balancing , 1995, SIGMETRICS.

[3]  Renato J. O. Figueiredo,et al.  VMPlants: Providing and Managing Virtual Machine Execution Environments for Grid Computing , 2004, Proceedings of the ACM/IEEE SC2004 Conference.

[4]  Ian T. Foster,et al.  From sandbox to playground: dynamic virtual environments in the grid , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[5]  ZhangJian,et al.  From virtualized resources to virtual computing grids , 2005 .

[6]  Ian T. Foster,et al.  Virtual workspaces: Achieving quality of service and quality of life in the Grid , 2005, Sci. Program..

[7]  Xiaomin Zhu,et al.  From virtualized resources to virtual computing grids: the In-VIGO system , 2005, Future Gener. Comput. Syst..

[8]  David E. Irwin,et al.  Dynamic virtual clusters in a grid site manager , 2003, High Performance Distributed Computing, 2003. Proceedings. 12th IEEE International Symposium on.