An Efficient Resource Management System for On-Line Virtual Cluster Provision

As a prevalent paradigm for flexible, scalable and on-demand provisions of computing services, Cloud Computing can be an alternative platform for scientific computing. In this paper, we propose an efficient resource management system for on-line virtual clusters provision, aiming to provide immediately-available virtual clusters for academic users. Particularly, we investigated two crucial problems: efficient VM image management and intelligent resource mapping, either of them has remarkable impact on the performance of the system. VM image management includes image preparation and local image management on physical resources. A resource mapping refers to a mapping from user’s resource constraints to specific physical resources. We explore how to simplify VM image management and reduce image preparation overhead by the multicast file transferring and image caching/reusing. Additionally, the Load-Aware Mapping, a novel resource mapping strategy, is proposed in order to further reduce deploying overhead and make efficient use of resources. The strategy takes account of both image cache and VM load distribution information. System evaluation is conducted through various real stress workloads, and results show that our approaches are effective comparing to other common solutions.

[1]  Borja Sotomayor,et al.  Combining batch execution and leasing using virtual machines , 2008, HPDC '08.

[2]  Andrew A. Chien,et al.  Efficient resource description and high quality selection for virtual grids , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[3]  Dan Stanzione,et al.  Efficient virtual machine caching in dynamic virtual clusters , 2007 .

[4]  Qin Li,et al.  CIVIC: a Hypervisor based Virtual Computing Environment , 2007, 2007 International Conference on Parallel Processing Workshops (ICPPW 2007).

[5]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[6]  Ian T. Foster,et al.  Virtual workspaces: Achieving quality of service and quality of life in the Grid , 2005, Sci. Program..

[7]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[8]  Yong Zhao,et al.  Cloud Computing and Grid Computing 360-Degree Compared , 2008, GCE 2008.

[9]  Satoshi Matsuoka,et al.  Model-based Resource Selection for Efficient Virtual Cluster Deployment , 2007, Proceedings of the 2nd International Workshop on Virtualization Technology in Distributed Computing (VTDC '07).

[10]  Iain D. Craig,et al.  Virtual machines , 2005 .

[11]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[12]  Daniel C. Stanzione,et al.  Dynamic Virtual Clustering with Xen and Moab , 2006, ISPA Workshops.

[13]  Jano I. van Hemert,et al.  Towards optimising distributed data streaming graphs using parallel streams , 2010, HPDC '10.

[14]  Dmitrii Zagorodnov,et al.  Eucalyptus : A Technical Report on an Elastic Utility Computing Archietcture Linking Your Programs to Useful Systems , 2008 .

[15]  Francine Berman,et al.  Overview of the Book: Grid Computing – Making the Global Infrastructure a Reality , 2003 .

[16]  Tal Garfinkel,et al.  Virtual machine monitors: current technology and future trends , 2005, Computer.