Network Defragmentation in Virtualized Data Centers

Network virtualization is an extensively used approach to allow multiple tenants with different network architectures and services to coexist on a shared data center infrastructure. Core to its realization is the mapping (or embedding) of virtual networks onto the underlying substrate infrastructure. Existing approaches are not suitable for cloud environments as they lack its most fundamental requirement: elasticity. To address this issue, we introduce two new network primitives –expand and contract– which allow virtual networks to scale up and down. Mapping and scaling virtual networks over time, however, introduces fragmentation in the substrate network. This is akin to fragmentation in a file system where files are not laid out in contiguous physical blocks of the storage device. This problem impacts network performance and reliability for tenants and their applications. Instead of further improving embedding algorithms to tackle this problem, in this work, we present a yet unexplored approach: leveraging network migration techniques to defragment the network. We introduce network defragmentation as a new management primitive and propose algorithms to materialize it. We show through extensive simulations that our techniques significantly improve network performance while maintaining high utilization of the infrastructure, thus increasing provider revenue. On average, using defragmentation leads to 20% reduction in path length and utilization and cuts the number of very long paths (longer than half of the network diameter) between 52% and 62%. Moreover, it doubles the number of servers utilized by 50% or less as a result of consolidation.

[1]  Matthias Rost,et al.  Beyond the Stars: Revisiting Virtual Cluster Embeddings , 2015, CCRV.

[2]  Minlan Yu,et al.  Rethinking virtual network embedding: substrate support for path splitting and migration , 2008, CCRV.

[3]  Lisandro Zambenedetti Granville,et al.  On tackling virtual data center embedding problem , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[4]  David Walker,et al.  Transparent, Live Migration of a Software-Defined Network , 2014, SoCC.

[5]  Stefan Schmid,et al.  Kraken: Online and elastic resource reservations for multi-tenant datacenters , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.

[6]  Martín Casado,et al.  Network Virtualization in Multi-tenant Datacenters , 2014, NSDI.

[7]  Lieguang Zeng,et al.  A virtual network embedding scheme with two-stage node mapping based on physical resource migration , 2010, 2010 IEEE International Conference on Communication Systems.

[8]  Kang-Won Lee,et al.  Application-aware virtual machine migration in data centers , 2011, 2011 Proceedings IEEE INFOCOM.

[9]  Haiying Shen,et al.  Cache contention aware Virtual Machine placement and migration in cloud datacenters , 2016, 2016 IEEE 24th International Conference on Network Protocols (ICNP).

[10]  Guy Pujolle,et al.  VNR Algorithm: A Greedy Approach for Virtual Networks Reconfigurations , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[11]  Xavier Hesselbach,et al.  Virtual Network Embedding: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[12]  Raouf Boutaba,et al.  ViNEYard: Virtual Network Embedding Algorithms With Coordinated Node and Link Mapping , 2012, IEEE/ACM Transactions on Networking.

[13]  Rob Sherwood,et al.  Can the Production Network Be the Testbed? , 2010, OSDI.

[14]  Hitesh Ballani,et al.  Towards predictable datacenter networks , 2011, SIGCOMM 2011.

[15]  Gwendal Simon,et al.  VDC Planner: Dynamic migration-aware Virtual Data Center embedding for clouds , 2013, 2013 IFIP/IEEE International Symposium on Integrated Network Management (IM 2013).

[16]  Qiang Liu,et al.  Virtual Network Embedding for Evolving Networks , 2010, 2010 IEEE Global Telecommunications Conference GLOBECOM 2010.

[17]  Ulas C. Kozat,et al.  Designing and embedding reliable virtual infrastructures , 2011, CCRV.

[18]  Xiang Cheng,et al.  Virtual network embedding through topology-aware node ranking , 2011, CCRV.

[19]  Jennifer Rexford,et al.  Scalable Network Virtualization in Software-Defined Networks , 2013, IEEE Internet Computing.

[20]  Christo Wilson,et al.  Better never than late , 2011, SIGCOMM 2011.

[21]  Gang Sun,et al.  A new algorithm with coordinated node and link mapping for virtual network embedding based on LP relaxation , 2010, Asia Communications and Photonics Conference and Exhibition.