Dynamic Load Balancing in Hybrid Switching Data Center Networks with Converters

Today's data centers rely on scale-out architectures like fat-tree, BCube, VL2, etc. to connect a large number of commodity servers. It's important to balance the traffic load across the available links. Since the traditional electrical network cannot perfectly respond to the traffic variations in data centers, a growing trend is to introduce converters with adjustable optical links instead of adding more wiring links. However, little is known today about how to fully exploit the potential of the flexibility from the converters: the joint optimization on adjusting the optical links inside the converters and the routing in the whole network remains algorithmically challenging. In this paper, we initiate the study of dynamic load balancing problem (DLBP) in hybrid switching data center networks with converters. We design a set of specific converters for Diamond, VL2, BCube topologies to introduce more flexibility. Based on it, the connections of the optical links inside the converter and the route for each flow needs to be jointly optimized to minimize the maximum link utilization in the whole network. We formulate DLBP as an optimization program and prove that it's not only NP-hard, but also ρ-inapproximation. Further, we design a greedy algorithm to solve it. Extensive experiments show that our algorithm can reduce the traffic congestion by 12% on average.

[1]  Qunfeng Dong,et al.  WaveCube: A scalable, fault-tolerant, high-performance optical data center architecture , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[2]  T. S. Eugene Ng,et al.  HyperOptics: A High Throughput and Low Latency Multicast Architecture for Datacenters , 2016, HotCloud.

[3]  T. S. Eugene Ng,et al.  Enabling Topological Flexibility for Data Centers Using OmniSwitch , 2015, HotCloud.

[4]  M. Glick,et al.  Dynamically reconfigurable optical links for high-bandwidth data center networks , 2009, 2009 Conference on Optical Fiber Communication - incudes post deadline papers.

[5]  Ankit Singla,et al.  Jellyfish: Networking Data Centers Randomly , 2011, NSDI.

[6]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[7]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[8]  Haitao Wu,et al.  BCube: a high performance, server-centric network architecture for modular data centers , 2009, SIGCOMM '09.

[9]  Ankit Singla,et al.  High Throughput Data Center Topology Design , 2013, NSDI.

[10]  Albert G. Greenberg,et al.  The nature of data center traffic: measurements & analysis , 2009, IMC '09.

[11]  Amin Vahdat,et al.  Integrating microsecond circuit switching into the data center , 2013, SIGCOMM.

[12]  Alejandro López-Ortiz,et al.  REWIRE: An optimization-based framework for unstructured data center network design , 2012, 2012 Proceedings IEEE INFOCOM.

[13]  Roberto Proietti,et al.  DOS - A scalable optical switch for datacenters , 2010, 2010 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[14]  Ankit Singla,et al.  OSA: An Optical Switching Architecture for Data Center Networks With Unprecedented Flexibility , 2012, IEEE/ACM Transactions on Networking.

[15]  T. S. Eugene Ng,et al.  Flat-tree: A Convertible Data Center Network Architecture from Clos to Random Graph , 2016, HotNets.

[16]  T. S. Eugene Ng,et al.  A Tale of Two Topologies: Exploring Convertible Data Center Network Architectures with Flat-tree , 2017, SIGCOMM.

[17]  Nikhil R. Devanur,et al.  ProjecToR: Agile Reconfigurable Data Center Interconnect , 2016, SIGCOMM.

[18]  Qiang Liu,et al.  Diamond: An Improved Fat-tree Architecture for Large-scale Data Centers , 2014, J. Commun..

[19]  Hong Liu,et al.  Jupiter Rising: A Decade of Clos Topologies and Centralized Control in Google's Datacenter Network , 2015, Comput. Commun. Rev..