PAM & PAL: Policy-Aware Virtual Machine Migration and Placement in Dynamic Cloud Data Centers

We focus on policy-aware data centers (PADCs), wherein virtual machine (VM) traffic traverses a sequence of middleboxes (MBs) for security and performance purposes, and propose two new VM placement and migration problems. We first study PAL: policy-aware virtual machine placement. Given a PADC with a data center policy that communicating VM pairs must satisfy, the goal of PAL is to place the VMs into the PADC to minimize their total communication cost. Due to dynamic traffic loads in PADCs, however, above VM placement may no longer be optimal after some time. We thus study PAM: policy-aware virtual machine migration. Given an existing VM placement in the PADC and dynamic traffic rates among communicating VMs, PAM migrates VMs in order to minimize the total cost of migration and communication of the VM pairs. We design optimal, approximation, and heuristic policyaware VM placement and migration algorithms. Our experiments show that i) VM migration is an effective technique, reducing total communication cost of VM pairs by 25%, ii) our PAL algorithms outperform state-of-the-art VM placement algorithm that is oblivious to data center policies by 40-50%, and iii) our PAM algorithms outperform the only existing policy-aware VM migration scheme by 30%.

[1]  Andrew V. Goldberg,et al.  An efficient implementation of a scaling minimum-cost flow algorithm , 1993, IPCO.

[2]  Fung Po Tso,et al.  Synergistic policy and virtual machine consolidation in cloud data centers , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[3]  Jie Wu,et al.  Let's stay together: Towards traffic aware virtual machine placement in data centers , 2012, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[4]  Kate Ching-Ju Lin,et al.  Deploying chains of virtual network functions: On the relation between link and server usage , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[5]  A. J.,et al.  Analysis of Christofides ' heuristic : Some paths are more difficult than cycles , 2002 .

[6]  Weijia Jia,et al.  PLAN: Joint Policy- and Network-Aware VM Management for Cloud Data Centers , 2017, IEEE Transactions on Parallel and Distributed Systems.

[7]  Alex C. Snoeren,et al.  Inside the Social Network's (Datacenter) Network , 2015, Comput. Commun. Rev..

[8]  Dan Li,et al.  PACE: Policy-Aware Application Cloud Embedding , 2013, 2013 Proceedings IEEE INFOCOM.

[9]  Minlan Yu,et al.  SIMPLE-fying middlebox policy enforcement using SDN , 2013, SIGCOMM.

[10]  Bin Li,et al.  Shortest Path and Maximum Flow Problems Under Service Function Chaining Constraints , 2018, IEEE INFOCOM 2018 - IEEE Conference on Computer Communications.

[11]  Rajkumar Buyya,et al.  Managing Overloaded Hosts for Dynamic Consolidation of Virtual Machines in Cloud Data Centers under Quality of Service Constraints , 2013, IEEE Transactions on Parallel and Distributed Systems.

[12]  Chuang Lin,et al.  Delay guaranteed live migration of Virtual Machines , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[13]  Zhe Xu,et al.  SpeedyBox: Low-Latency NFV Service Chains with Cross-NF Runtime Consolidation , 2019, 2019 IEEE 39th International Conference on Distributed Computing Systems (ICDCS).

[14]  Ying Zhang,et al.  Improve Service Chaining Performance with Optimized Middlebox Placement , 2017, IEEE Transactions on Services Computing.

[15]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[16]  Chunming Qiao,et al.  Availability-aware mapping of service function chains , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[17]  Xin Wang,et al.  Traffic-aware virtual machine migration in topology-adaptive DCN , 2016, 2016 IEEE 24th International Conference on Network Protocols (ICNP).

[18]  Vasileios Pappas,et al.  Improving the Scalability of Data Center Networks with Traffic-aware Virtual Machine Placement , 2010, 2010 Proceedings IEEE INFOCOM.

[19]  Mostafa Ammar,et al.  An Approach for Service Function Chain Routing and Virtual Function Network Instance Migration in Network Function Virtualization Architectures , 2017, IEEE/ACM Transactions on Networking.

[20]  Ravindra K. Ahuja,et al.  Network Flows: Theory, Algorithms, and Applications , 1993 .

[21]  Ying Zhang,et al.  Virtual machine migration planning in software-defined networks , 2014, 2015 IEEE Conference on Computer Communications (INFOCOM).

[22]  Ion Stoica,et al.  A policy-aware switching layer for data centers , 2008, SIGCOMM '08.

[23]  T. V. Lakshman,et al.  Optimizing data access latencies in cloud systems by intelligent virtual machine placement , 2013, 2013 Proceedings IEEE INFOCOM.

[24]  Aditya Akella,et al.  OpenNF , 2014, SIGCOMM.

[25]  Meral Shirazipour,et al.  StEERING: A software-defined networking for inline service chaining , 2013, 2013 21st IEEE International Conference on Network Protocols (ICNP).

[26]  Vyas Sekar,et al.  Making middleboxes someone else's problem: network processing as a cloud service , 2012, SIGCOMM '12.

[27]  Yi Pan,et al.  Stochastic Load Balancing for Virtual Resource Management in Datacenters , 2020, IEEE Transactions on Cloud Computing.

[28]  Joseph Naor,et al.  Almost optimal virtual machine placement for traffic intense data centers , 2013, 2013 Proceedings IEEE INFOCOM.

[29]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[30]  Ao Tang,et al.  Scalable Routing in SDN-enabled Networks with Consolidated Middleboxes , 2015, HotMiddlebox@SIGCOMM.

[31]  Jinsong Wu,et al.  Service Chaining for Hybrid Network Function , 2019, IEEE Transactions on Cloud Computing.

[32]  V G Andrew,et al.  AN EFFICIENT IMPLEMENTATION OF A SCALING MINIMUM-COST FLOW ALGORITHM , 1997 .

[33]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[34]  Kang-Won Lee,et al.  Application-aware virtual machine migration in data centers , 2011, 2011 Proceedings IEEE INFOCOM.

[35]  Vijay Mann,et al.  Remedy: Network-Aware Steady State VM Management for Data Centers , 2012, Networking.

[36]  Junjie Liu,et al.  On Dynamic Service Function Chain Deployment and Readjustment , 2017, IEEE Transactions on Network and Service Management.

[37]  Xiaojiang Du,et al.  Provably efficient algorithms for joint placement and allocation of virtual network functions , 2017, IEEE INFOCOM 2017 - IEEE Conference on Computer Communications.

[38]  Brian E. Carpenter,et al.  Middleboxes: Taxonomy and Issues , 2002, RFC.

[39]  Minlan Yu,et al.  Enforcing Network-Wide Policies in the Presence of Dynamic Middlebox Actions using FlowTags , 2014, NSDI.

[40]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.

[41]  Vyas Sekar,et al.  Design and Implementation of a Consolidated Middlebox Architecture , 2012, NSDI.

[42]  K. K. Ramakrishnan,et al.  Virtual function placement and traffic steering in flexible and dynamic software defined networks , 2015, The 21st IEEE International Workshop on Local and Metropolitan Area Networks.