A scalable multi-datacenter layer-2 network architecture

Cloud today is evolving towards multi-datacenter deployment, with each datacenter serving customers in different geographical areas. The independence between datacenters, however, prohibits effective inter-datacenter resource sharing and flexible management of the infrastructure. In this paper, we propose WL2, a Software-Defined Networking (SDN) solution to an Internet-scale Layer-2 network across multiple datacenters. In WL2, a logically centralized controller handles control-plane communication and configuration in each datacenter. We achieve scalability in three ways: (1) eliminating Layer-2 broadcast by rerouting control-plane traffic to the controller; (2) introducing a layered addressing scheme for aggregate Layer-2 routing; and (3) creating an overlay abstraction on top of physical topology for fast flow setup. WL2 is fault-tolerant against controller and gateway failures. We deployed and evaluated WL2 in a 2,250-VM testbed across three datacenters. The results indicate high performance and robustness of the system.

[1]  Muli Ben-Yehuda,et al.  The Turtles Project: Design and Implementation of Nested Virtualization , 2010, OSDI.

[2]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[3]  Nick McKeown,et al.  OpenFlow: enabling innovation in campus networks , 2008, CCRV.

[4]  Ayan Banerjee,et al.  Transparent Interconnection of Lots of Links (TRILL) Use of IS-IS , 2011, RFC.

[5]  Min Zhu,et al.  B4: experience with a globally-deployed software defined wan , 2013, SIGCOMM.

[6]  VXLAN Performance Evaluation on VMware vSphere 5.1 , 2013 .

[7]  Lawrence Kreeger,et al.  Virtual eXtensible Local Area Network (VXLAN): A Framework for Overlaying Virtualized Layer 2 Networks over Layer 3 Networks , 2014, RFC.

[8]  Yun Mao,et al.  Inception: Towards a Nested Cloud Architecture , 2013, HotCloud.

[9]  Martín Casado,et al.  Extending Networking into the Virtualization Layer , 2009, HotNets.

[10]  Jim Groom,et al.  Docker - Build, Ship, and Run Any App, Anywhere , 2014 .

[11]  Martín Casado,et al.  Applying NOX to the Datacenter , 2009, HotNets.

[12]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[13]  Eugene Ch'ng,et al.  Rethinking the service model: Scaling Ethernet to a million nodes , 2004 .

[14]  Alan L. Cox,et al.  PAST: scalable ethernet for data centers , 2012, CoNEXT '12.

[15]  Santosh Krishnan,et al.  Google Compute Engine , 2015 .

[16]  Amin Vahdat,et al.  PortLand: a scalable fault-tolerant layer 2 data center network fabric , 2009, SIGCOMM '09.

[17]  Leslie Lamport,et al.  The part-time parliament , 1998, TOCS.

[18]  Martín Casado,et al.  Onix: A Distributed Control Platform for Large-scale Production Networks , 2010, OSDI.

[19]  Dino Farinacci,et al.  Generic Routing Encapsulation (GRE) , 2000, RFC.

[20]  Jennifer Rexford,et al.  Floodless in seattle: a scalable ethernet architecture for large enterprises , 2008, SIGCOMM '08.

[21]  Anja Feldmann,et al.  Live wide-area migration of virtual machines including local persistent state , 2007, VEE '07.

[22]  Martín Casado,et al.  Network Virtualization in Multi-tenant Datacenters , 2014, NSDI.

[23]  Mahadev Konar,et al.  ZooKeeper: Wait-free Coordination for Internet-scale Systems , 2010, USENIX ATC.

[24]  Andrew Warfield,et al.  Live migration of virtual machines , 2005, NSDI.