Scalability and Bandwidth Optimization for Data Center Networks

Data centers now being built may contain tens of thousands hosts, and this number is still growing. Deficiencies of the conventional network architecture are gradually revealed. It is facing a set of limitations such as poor scalability, resources fragmentation, lack of support for virtual machine migration and inefficient packets forwarding. In this paper, we propose an alternative solution which is more suitable for data center than the traditional structure. We redesign a large and scalable layer 2 network that supports VM migration better and removes resource fragmentation. We employ a global controller to maintain network information which can be accessed through a directory service running on the controller. With the directory service we achieve proxy ARP resolving and MAC-in-MAC tunneling while forwarding data frames. Moreover, we replace the shortest path first route algorithm with bandwidth-aware forwarding algorithm that dynamically adjusts route when overloaded link detected. The simulation results show that our approach can significantly increase the aggregate throughput and is more efficient.

[1]  Amin Vahdat,et al.  PortLand: a scalable fault-tolerant layer 2 data center network fabric , 2009, SIGCOMM '09.

[2]  Michael Isard,et al.  Autopilot: automatic data center management , 2007, OPSR.

[3]  Albert G. Greenberg,et al.  Towards a next generation data center architecture: scalability and commoditization , 2008, PRESTO '08.

[4]  Eugene Ch'ng,et al.  Rethinking the service model: Scaling Ethernet to a million nodes , 2004 .

[5]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[6]  Haitao Wu,et al.  BCube: a high performance, server-centric network architecture for modular data centers , 2009, SIGCOMM '09.

[7]  Nick McKeown,et al.  OpenFlow: enabling innovation in campus networks , 2008, CCRV.

[8]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[9]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[10]  Sujata Banerjee,et al.  Bandwidth-Aware Routing in Overlay Networks , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[11]  GhemawatSanjay,et al.  The Google file system , 2003 .

[12]  Jennifer Rexford,et al.  Floodless in seattle: a scalable ethernet architecture for large enterprises , 2008, SIGCOMM '08.

[13]  Lei Shi,et al.  Dcell: a scalable and fault-tolerant network structure for data centers , 2008, SIGCOMM '08.

[14]  T. V. Lakshman,et al.  Proceedings of the ACM workshop on Programmable routers for extensible services of tomorrow , 2008, SIGCOMM 2008.

[15]  Eddie Kohler,et al.  MultiQ: automated detection of multiple bottleneck capacities along a path , 2004, IMC '04.