Traffic Load Balancing Schemes for Devolved Controllers in Mega Data Centers

In most existing cloud services, a centralized controller is used for resource management and coordination. However, such infrastructure is gradually not sufficient to meet the rapid growth of mega data centers. In recent literature, a new approach named devolved controller was proposed for scalability concern. This approach splits the whole network into several regions, each with one controller to monitor and reroute a portion of the flows. This technique alleviates the problem of an overloaded single controller, but brings other problems such as unbalanced work load among controllers and reconfiguration complexities. In this paper, we make an exploration on the usage of devolved controllers for mega data centers, and design some new schemes to overcome these shortcomings and improve the performance of the system. We first formulate <italic>Load Balancing problem for Devolved Controllers</italic>  (LBDC) in data centers, and prove that it is NP-complete. We then design an <inline-formula> <tex-math notation="LaTeX">$f$</tex-math><alternatives><inline-graphic xlink:href="gao-ieq1-2579622.gif"/> </alternatives></inline-formula>-approximation for LBDC, where <inline-formula><tex-math notation="LaTeX">$f$</tex-math> <alternatives><inline-graphic xlink:href="gao-ieq2-2579622.gif"/></alternatives></inline-formula> is the largest number of potential controllers for a switch in the network. Furthermore, we propose both centralized and distributed greedy approaches to solve the LBDC problem effectively. The numerical results validate the efficiency of our schemes, which can become a solution to monitoring, managing, and coordinating mega data centers with multiple controllers working together.

[1]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[2]  Douglas E. Comer,et al.  Internetworking with TCP/IP. Vol.1: Principles, protocols, and architecture; Vol.2: Design, implementation, and internals , 2000 .

[3]  Seif Haridi,et al.  Distributed Algorithms , 1992, Lecture Notes in Computer Science.

[4]  Douglas E. Comer,et al.  Internetworking with TCP/IP, Volume 1: Principles, Protocols, and Architectures, Fourth Edition , 2000 .

[5]  A.G. Aghdam,et al.  Decentralized Control Design for Interconnected Systems Based on A Centralized Reference Controller , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[6]  Nick McKeown,et al.  OpenFlow: enabling innovation in campus networks , 2008, CCRV.

[7]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[8]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[9]  Paramvir Bahl,et al.  Flyways To De-Congest Data Center Networks , 2009, HotNets.

[10]  Martín Casado,et al.  Onix: A Distributed Control Platform for Large-scale Production Networks , 2010, OSDI.

[11]  Amin Vahdat,et al.  Hedera: Dynamic Flow Scheduling for Data Center Networks , 2010, NSDI.

[12]  Christian Esteve Rothenberg,et al.  In-packet Bloom filter based data center networking with distributed OpenFlow controllers , 2010, 2010 IEEE Globecom Workshops.

[13]  Yashar Ganjali,et al.  HyperFlow: A Distributed Control Plane for OpenFlow , 2010, INM/WREN.

[14]  Sujata Banerjee,et al.  ElasticTree: Saving Energy in Data Center Networks , 2010, NSDI.

[15]  Jeffrey C. Mogul,et al.  SPAIN: COTS Data-Center Ethernet for Multipathing over Arbitrary Topologies , 2010, NSDI.

[16]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[17]  David P. Williamson,et al.  The Design of Approximation Algorithms , 2011 .

[18]  Sujata Banerjee,et al.  DevoFlow: scaling flow management for high-performance networks , 2011, SIGCOMM.

[19]  H. Jonathan Chao,et al.  Use of devolved controllers in data center networks , 2011, 2011 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS).

[20]  Ming Zhang,et al.  MicroTE: fine grained traffic engineering for data centers , 2011, CoNEXT '11.

[21]  H. Jonathan Chao,et al.  Scalability and Resilience in Data Center Networks: Dynamic Flow Reroute as an Example , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[22]  Rob Sherwood,et al.  The controller placement problem , 2012, HotSDN '12.

[23]  Anja Feldmann,et al.  Logically centralized?: state distribution trade-offs in software defined networks , 2012, HotSDN '12.

[24]  Yashar Ganjali,et al.  Kandoo: a framework for efficient and scalable offloading of control applications , 2012, HotSDN '12.

[25]  Hai Jin,et al.  Falloc: Fair network bandwidth allocation in IaaS datacenters via a bargaining game approach , 2013, 2013 21st IEEE International Conference on Network Protocols (ICNP).

[26]  Michael J. Freedman,et al.  Scalable, optimal flow routing in datacenters via local link balancing , 2013, CoNEXT.

[27]  Haitao Wu,et al.  Per-packet load-balanced, low-latency routing for clos-based data center networks , 2013, CoNEXT.

[28]  Hai Jin,et al.  A cooperative game based allocation for sharing data center networks , 2013, 2013 Proceedings IEEE INFOCOM.

[29]  Min Zhu,et al.  B4: experience with a globally-deployed software defined wan , 2013, SIGCOMM.

[30]  Yashar Ganjali,et al.  On scalability of software-defined networking , 2013, IEEE Communications Magazine.

[31]  Fang Hao,et al.  Towards an elastic distributed SDN controller , 2013, HotSDN '13.

[32]  秋好 一平,et al.  Open Networking Foundation(ONF)の標準化動向 , 2014 .

[33]  Mohamed Faten Zhani,et al.  Design and management of DOT: A Distributed OpenFlow Testbed , 2014, 2014 IEEE Network Operations and Management Symposium (NOMS).

[34]  Hai Jin,et al.  On efficient bandwidth allocation for traffic variability in datacenters , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[35]  Fung Po Tso,et al.  Scalable Traffic-Aware Virtual Machine Management for Cloud Data Centers , 2014, 2014 IEEE 34th International Conference on Distributed Computing Systems.

[36]  Fan Wu,et al.  Balancing traffic load for devolved controllers in data center networks , 2014, 2014 IEEE Global Communications Conference.

[37]  Athanasios V. Vasilakos,et al.  Energy-Efficient Flow Scheduling and Routing with Hard Deadlines in Data Center Networks , 2014, 2014 IEEE 34th International Conference on Distributed Computing Systems.

[38]  Ligang Dong,et al.  Multiple Controller Management in Software Defined Networking , 2014, 2014 IEEE Symposium on Computer Applications and Communications.

[39]  Pakawat Pupatwibul,et al.  DAIM: a Mechanism to Distribute Control Functions within OpenFlow Switches , 2014, J. Networks.

[40]  Yonggang Wen,et al.  “ A Survey of Software Defined Networking , 2020 .

[41]  Julie A. McCann,et al.  UbiFlow: Mobility management in urban-scale software defined IoT , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[42]  Hai Jin,et al.  Fair Network Bandwidth Allocation in IaaS Datacenters via a Cooperative Game Approach , 2016, IEEE/ACM Transactions on Networking.

[43]  Roger Wattenhofer,et al.  On consistent migration of flows in SDNs , 2016, IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications.