Shadow-Routing Based Dynamic Algorithms for Virtual Machine Placement in a Network Cloud

We consider a <italic>shadow routing</italic> based approach to the problem of real-time adaptive placement of virtual machines (VM) in large data centers (DC) within a network cloud. Such placement in particular has to respect <italic>vector packing</italic> constraints on the allocation of VMs to host physical machines (PM) within a DC, because each PM can potentially serve multiple VMs simultaneously. Shadow routing is attractive in that it allows a large variety of system objectives and/or constraints to be treated within a common framework (as long as the underlying optimization problem is convex). Perhaps even more attractive feature is that the corresponding algorithm is very simple to implement, it runs continuously, and adapts automatically to changes in the VM demand rates, changes in system parameters, etc., without the need to re-solve the underlying optimization problem “from scratch”. In this paper we focus on the <italic>min-max-DC-load</italic> problem. Namely, we propose a combined VM-to-DC routing and VM-to-PM assignment algorithm, referred to as <italic>Shadow scheme</italic>, which minimizes the maximum of appropriately defined DC utilizations. We prove that the Shadow scheme is asymptotically optimal (as one of its parameters goes to <inline-formula><tex-math notation="LaTeX">$0$</tex-math><alternatives> <inline-graphic xlink:href="guo-ieq1-2464795.gif"/></alternatives></inline-formula>). Simulation confirms good performance and high adaptivity of the algorithm. Favorable performance is also demonstrated in comparison with a baseline algorithm based on VMware implementation <xref ref-type="bibr" rid="ref7">[7]</xref> , <xref ref-type="bibr" rid="ref8">[8]</xref> . We also propose a simplified – “more distributed” – version of the Shadow scheme, which performs almost as well in simulations.

[1]  On the sum-of-squares algorithm for bin packing , 2000, STOC '00.

[2]  Alexander L. Stolyar,et al.  Maximizing Queueing Network Utility Subject to Stability: Greedy Primal-Dual Algorithm , 2005, Queueing Syst. Theory Appl..

[3]  Randy H. Katz,et al.  Above the Clouds: A Berkeley View of Cloud Computing , 2009 .

[4]  Alberto Caprara,et al.  A New Approximation Method for Set Covering Problems, with Applications to Multidimensional Bin Packing , 2009, SIAM J. Comput..

[5]  Rajkumar Buyya,et al.  Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters , 2009, HPDC '09.

[6]  Vasileios Pappas,et al.  Improving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement , 2010, 2010 Proceedings IEEE INFOCOM.

[7]  Eric Bouillet,et al.  Efficient resource provisioning in compute clouds via VM multiplexing , 2010, ICAC '10.

[8]  Alexander L. Stolyar,et al.  Control of systems with flexible multi-server pools: a shadow routing approach , 2010, Queueing Syst. Theory Appl..

[9]  Li Jin,et al.  Design and implementation of adaptive resource co-allocation approaches for cloud service environments , 2010, 2010 3rd International Conference on Advanced Computer Theory and Engineering(ICACTE).

[10]  Anne M. Holler,et al.  Cloud Scale Resource Management: Challenges and Techniques , 2011, HotCloud.

[11]  Alexander L. Stolyar,et al.  Shadow-Routing Based Control of Flexible Multiserver Pools in Overload , 2011, Oper. Res..

[12]  T. V. Lakshman,et al.  Network aware resource allocation in distributed clouds , 2012, 2012 Proceedings IEEE INFOCOM.

[13]  R. Srikant,et al.  Stochastic models of load balancing and scheduling in cloud computing clusters , 2012, 2012 Proceedings IEEE INFOCOM.

[14]  Minghua Chen,et al.  Joint VM placement and routing for data center traffic engineering , 2012, 2012 Proceedings IEEE INFOCOM.

[15]  Alexander L. Stolyar,et al.  Shadow-routing based dynamic algorithms for virtual machine placement in a network cloud , 2013, INFOCOM.

[16]  Ajay Gulati VMware distributed resource Management : design , Implementation , and lessons learned , 2022 .