meGautz: A High Capacity, Fault-Tolerant and Traffic Isolated Modular Datacenter Network

The modular datacenter networks (MDCN) comprise inter- and intra-container networks. Although it simplifies the construction and maintenance of mega-datacenters, interconnecting hundreds of containers and supporting online data-intensive services is still challenging. In this paper, we present meGautz, which is the first inter-container network that isolates inter- and intra-container traffic, and it has the following advantages. First, meGautz offers uniform high capacity among servers in the different containers, and balances loads at the container, switch, and server levels. Second, it achieves traffic isolation and allocates bandwidth evenly. Therefore, even under an all-to-all traffic pattern, the inter- and intra-container networks can deal with their own flows without interfering with each other, and both can gain high throughput. meGautz hence improves the performance of both the entire MDCN and individual servers, for there is no performance loss caused by resource competition. Third, meGautz is the first to achieve as graceful performance degradation as computation and storage do. Results from theoretical analysis and experiments demonstrate that meGautz is a high-capacity, fault-tolerant, and traffic isolated inter-container network.

[1]  Thomas F. Wenisch,et al.  Power management of online data-intensive services , 2011, 2011 38th Annual International Symposium on Computer Architecture (ISCA).

[2]  Antony Rowstron,et al.  Symbiotic routing in future data centers , 2010, SIGCOMM 2010.

[3]  Haitao Wu,et al.  BCube: a high performance, server-centric network architecture for modular data centers , 2009, SIGCOMM '09.

[4]  Haitao Wu,et al.  ServerSwitch: A Programmable and High Performance Platform for Data Center Networks , 2011, NSDI.

[5]  Jie Wu,et al.  FISSIONE: a scalable constant degree and low congestion DHT scheme based on Kautz graphs , 2005, Proceedings IEEE 24th Annual Joint Conference of the IEEE Computer and Communications Societies..

[6]  Dharma P. Agrawal,et al.  Design and Performance of Generalized Interconnection Networks , 1983, IEEE Transactions on Computers.

[7]  Pavel Tvrdik Factoring and scaling Kautz digraphs , 1994 .

[8]  Yunhao Liu,et al.  BCN: Expansible network structures for data centers using hierarchical compound graphs , 2011, 2011 Proceedings IEEE INFOCOM.

[9]  Haitao Wu,et al.  MDCube: a high performance network structure for modular data center interconnection , 2009, CoNEXT '09.

[10]  Christo Wilson,et al.  Better never than late , 2011, SIGCOMM 2011.

[11]  Scott Shenker,et al.  Minimizing churn in distributed systems , 2006, SIGCOMM.

[12]  Xiaoming Fu,et al.  Building mega data center from heterogeneous containers , 2011, 2011 19th IEEE International Conference on Network Protocols.

[13]  Hitesh Ballani,et al.  Towards predictable datacenter networks , 2011, SIGCOMM 2011.

[14]  Kashi Venkatesh Vishwanath,et al.  Modular data centers: how to design them? , 2009, LSAP '09.

[15]  Jiaxin Li,et al.  Efficient Multi-Tenant Virtual Machine Allocation in Cloud Data Centers , 2015 .

[16]  Sujata Banerjee,et al.  ElasticSwitch: practical work-conserving bandwidth guarantees for cloud computing , 2013, SIGCOMM.

[17]  Yunhao Liu,et al.  Expandable and Cost-Effective Network Structures for Data Centers Using Dual-Port Servers , 2013, IEEE Transactions on Computers.

[18]  Anirban Mahanti,et al.  Traffic classification using clustering algorithms , 2006, MineNet '06.

[19]  Helen J. Wang,et al.  SecondNet: a data center network virtualization architecture with bandwidth guarantees , 2010, CoNEXT.

[20]  Sujata Banerjee,et al.  DevoFlow: scaling flow management for high-performance networks , 2011, SIGCOMM 2011.

[21]  Ankit Singla,et al.  Jellyfish: Networking Data Centers Randomly , 2011, NSDI.

[22]  Qunfeng Dong,et al.  WaveCube: A scalable, fault-tolerant, high-performance optical data center architecture , 2015, 2015 IEEE Conference on Computer Communications (INFOCOM).

[23]  James R. Hamilton,et al.  An Architecture for Modular Data Centers , 2006, CIDR.

[24]  Amin Vahdat,et al.  Helios: a hybrid electrical/optical switch architecture for modular data centers , 2010, SIGCOMM '10.

[25]  Lisandro Zambenedetti Granville,et al.  Data Center Network Virtualization: A Survey , 2013, IEEE Communications Surveys & Tutorials.

[26]  Miguel Angel Fiol,et al.  The Partial Line Digraph Technique in the Design of Large Interconnection Networks , 1992, IEEE Trans. Computers.

[27]  Konstantina Papagiannaki,et al.  c-Through: part-time optics in data centers , 2010, SIGCOMM 2010.

[28]  Jie Wu,et al.  On peer-assisted data dissemination in data center networks: Analysis and implementation , 2014 .

[29]  T. N. Vijaykumar,et al.  Deadline-aware datacenter tcp (D2TCP) , 2012, CCRV.

[30]  Feng Huang,et al.  SCautz: a high performance and fault-tolerant datacenter network for modular datacenters , 2012, Science China Information Sciences.

[31]  Lotfi Mhamdi,et al.  A survey on architectures and energy efficiency in Data Center Networks , 2014, Comput. Commun..

[32]  Ling Liu,et al.  Distributed Line Graphs: A Universal Technique for Designing DHTs Based on Arbitrary Regular Graphs , 2012, IEEE Transactions on Knowledge and Data Engineering.