HHS: an efficient network topology for large-scale data centers

Designing an efficient topology is a critical challenge for large-scale data center networks. Although the current switch-centric network topologies have high bisection bandwidth, they bear the disadvantage of high network cost. In this paper, we propose a novel switch-centric data center network topology called Hyper Hoffman–Singleton (HHS). HHS is a symmetric multi-dimensional topology, in which switches form a Hoffman–Singleton graph in each dimension. The proposed topology can accommodate a large number of servers with small network diameter, low cost and high bisection bandwidth. We also present a multipath routing algorithm for HHS. Our simulation results show that the HHS network offers low latency and high throughput under different workloads. By comparing with the existing data center network topologies, we show that HHS is a promising candidate for large-scale data centers because of its ability to achieve a desirable trade-off between performance and cost, without introducing any overheads on servers.

[1]  Haitao Wu,et al.  Scalable and Cost-Effective Interconnection of Data-Center Servers Using Dual Server Ports , 2011, IEEE/ACM Transactions on Networking.

[2]  Lei Shi,et al.  Dcell: a scalable and fault-tolerant network structure for data centers , 2008, SIGCOMM '08.

[3]  Hamid R. Arabnia,et al.  A Transputer Network for the Arbitrary Rotation of Digitised Images , 1987, Comput. J..

[4]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[5]  Jie Wu,et al.  On the design and analysis of Data Center Network architectures for interconnecting dual-port servers , 2014, IEEE INFOCOM 2014 - IEEE Conference on Computer Communications.

[6]  Ion Stoica,et al.  A cost comparison of datacenter network architectures , 2010, CoNEXT.

[7]  Fernando M. V. Ramos,et al.  Software-Defined Networking: A Comprehensive Survey , 2014, Proceedings of the IEEE.

[8]  Yuanyuan Yang,et al.  BCCC: An Expandable Network for Data Centers , 2014, IEEE/ACM Transactions on Networking.

[9]  VahdatAmin,et al.  A scalable, commodity data center network architecture , 2008 .

[10]  Zhiyang Su,et al.  Rethinking the Data Center Networking: Architecture, Network Protocols, and Resource Sharing , 2014, IEEE Access.

[11]  Hamid Sarbazi-Azad,et al.  XMulator: A Listener-Based Integrated Simulation Platform for Interconnection Networks , 2007, First Asia International Conference on Modelling & Simulation (AMS'07).

[12]  Dong Lin,et al.  Data Center Networks: Topologies, Architectures and Fault-Tolerance Characteristics , 2013 .

[13]  William J. Dally,et al.  Principles and Practices of Interconnection Networks , 2004 .

[14]  John Kim,et al.  High Performance Datacenter Networks: Architectures, Algorithms, and Opportunities , 2011, High Performance Datacenter Networks: Architectures, Algorithms, and Opportunities.

[15]  Haitao Wu,et al.  FiConn: Using Backup Port for Server Interconnection in Data Centers , 2009, IEEE INFOCOM 2009.

[16]  Hong Liu,et al.  Energy proportional datacenter networks , 2010, ISCA.

[17]  Albert G. Greenberg,et al.  The nature of data center traffic: measurements & analysis , 2009, IMC '09.

[18]  Lixin Zhang,et al.  A High-Performance and Cost-Efficient Interconnection Network for High-Density Servers , 2013, 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing.

[19]  Albert G. Greenberg,et al.  VL2: a scalable and flexible data center network , 2009, SIGCOMM '09.

[20]  Axel Jantsch,et al.  Networks on chip , 2003 .

[21]  Amin Vahdat,et al.  Hedera: Dynamic Flow Scheduling for Data Center Networks , 2010, NSDI.

[22]  Haitao Wu,et al.  BCube: a high performance, server-centric network architecture for modular data centers , 2009, SIGCOMM '09.

[23]  Dharma P. Agrawal,et al.  Generalized Hypercube and Hyperbus Structures for a Computer Network , 1984, IEEE Transactions on Computers.

[24]  Amin Vahdat,et al.  Data Center Switch Architecture in the Age of Merchant Silicon , 2009, 2009 17th IEEE Symposium on High Performance Interconnects.

[25]  Sanjay Ghemawat,et al.  MapReduce: Simplified Data Processing on Large Clusters , 2004, OSDI.

[26]  Sudhakar Yalamanchili,et al.  Interconnection Networks , 2011, Encyclopedia of Parallel Computing.

[27]  GhemawatSanjay,et al.  The Google file system , 2003 .

[28]  Farshad Safaei,et al.  On the topological properties of HyperX , 2013, The Journal of Supercomputing.

[29]  Lixin Gao,et al.  DPillar: Dual-port server interconnection network for large scale data centers , 2012, Comput. Networks.

[30]  Dong Lin,et al.  Data Center Networks , 2013, SpringerBriefs in Computer Science.

[31]  Sudhakar Yalamanchili,et al.  Interconnection Networks: An Engineering Approach , 2002 .

[32]  Jung Ho Ahn,et al.  HyperX: topology, routing, and packaging of efficient large-scale networks , 2009, Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis.

[33]  Hamid R. Arabnia,et al.  Parallel Edge-Region-Based Segmentation Algorithm Targeted at Reconfigurable MultiRing Network , 2003, The Journal of Supercomputing.

[34]  H.R. Arabnia,et al.  A Transputer Network for Fast Operations on Digitised Images , 1989, Comput. Graph. Forum.

[35]  William J. Dally,et al.  Flattened butterfly: a cost-efficient topology for high-radix networks , 2007, ISCA '07.

[36]  Torsten Hoefler,et al.  Slim Fly: A Cost Effective Low-Diameter Network Topology , 2014, SC14: International Conference for High Performance Computing, Networking, Storage and Analysis.

[37]  Wilfred Pinfold,et al.  Proceedings of the Conference on High Performance Computing Networking, Storage and Analysis , 2009, HiPC 2009.

[38]  Amin Vahdat,et al.  A scalable, commodity data center network architecture , 2008, SIGCOMM '08.

[39]  Mingyu Chen,et al.  A High-Performance and Cost-Efficient Interconnection Network for High-Density Servers , 2013, 2013 IEEE 10th International Conference on High Performance Computing and Communications & 2013 IEEE International Conference on Embedded and Ubiquitous Computing.

[40]  Crispín Gómez Requena.  Low-Memory Techniques for Routing and Fault-Tolerance on the Fat-Tree Topology , 2011 .

[41]  Hamid Sarbazi-Azad,et al.  An Analytical Model of Adaptive Wormhole Routing in Hypercubes in the Presence of Hot Spot Traffic , 2001, IEEE Trans. Parallel Distributed Syst..

[42]  Behrooz Parhami,et al.  Introduction to Parallel Processing: Algorithms and Architectures , 1999 .

[43]  J. A.,et al.  On Moore Graphs with Diameters 2 and 3 , 2022 .

[44]  Yan Zhang,et al.  On Architecture Design, Congestion Notification, TCP Incast and Power Consumption in Data Centers , 2013, IEEE Communications Surveys & Tutorials.