Image Distribution Mechanisms in Large Scale Cloud Providers

This paper presents the various mechanisms for virtual machine image distribution within a large batch farm and between sites that offer cloud computing services. The work is presented within the context of the Large Hadron Collider Computing Grid (LCG), it has two main goals. First it aims at presenting the CERN specific mechanisms that have been put in place to test the pre-staging of virtual machine images within a large cloud infrastructure of several hundred physical hosts. Second it introduces the basis of a policy for trusting and distributing virtual machine images between sites of the LCG. Finally experimental results are shown for the distribution of a 10 GB virtual machine image distributed to over 400 physical nodes using a binary tree and a Bit Torrent algorithm. Results show that images can be pre-staged within 30 minutes.

[1]  刘锋,et al.  Kernel-based virtual machine事件跟踪机制的设计与实现 , 2008 .

[2]  Borja Sotomayor,et al.  Virtual Infrastructure Management in Private and Hybrid Clouds , 2009, IEEE Internet Computing.

[3]  Paul Marshall,et al.  Elastic Site: Using Clouds to Elastically Extend Site Resources , 2010, 2010 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing.

[4]  Sebastien Goasguen,et al.  Kestrel: an XMPP-based framework for many task computing applications , 2009, MTAGS '09.

[5]  Bernd Freisleben,et al.  Efficient Distribution of Virtual Machines for Cloud Computing , 2010, 2010 18th Euromicro Conference on Parallel, Distributed and Network-based Processing.

[6]  Andrew Washbrook,et al.  Quattor: Tools and Techniques for the Configuration, Installation and Management of Large-Scale Grid Computing Fabrics , 2004, Journal of Grid Computing.

[7]  Renato J. O. Figueiredo,et al.  A case for grid computing on virtual machines , 2003, 23rd International Conference on Distributed Computing Systems, 2003. Proceedings..

[8]  Chris Rose,et al.  A Break in the Clouds: Towards a Cloud Definition , 2011 .

[9]  Richard Wolski,et al.  The Eucalyptus Open-Source Cloud-Computing System , 2009, 2009 9th IEEE/ACM International Symposium on Cluster Computing and the Grid.

[10]  Sebastien Goasguen,et al.  Autonomic Clouds on the Grid , 2010, Journal of Grid Computing.

[11]  Alastair Scobie,et al.  Autonomic Management of Large Clusters and Their Integration into the Grid , 2004, Journal of Grid Computing.