Traffic Pattern Adaptive Hybrid Electrical and Optical Switching Network for HPC System

As the performance requirements and scale of high-performance computing (HPC) systems grow rapidly, systems with such a large number of computing nodes present significant challenges in network architecture design because their peak performance is increasingly limited by communication rather than computation. Moreover, certain HPC application always shows some specific communication patterns, and different topologies have various performances with these patterns. To implement a traffic pattern adaptive HPC system, we propose a topology reconfigurable hybrid network architecture based on optical circuit switching (OCS), which could be adjusted into different classical topologies. And an algorithm of topology calculating and a permutation matrix-based optical switch configuration mechanism are proposed to construct network. We discuss network performances with limited OCS switches occupation, and results show that traffic pattern adaptive network improves the performance of latency and throughput to a large extent.

[1]  Hideharu Amano,et al.  Optical network technologies for HPC: computer-architects point of view , 2016, IEICE Electron. Express.

[2]  Keren Bergman,et al.  Flexfly: Enabling a Reconfigurable Dragonfly through Silicon Photonics , 2016, SC16: International Conference for High Performance Computing, Networking, Storage and Analysis.

[3]  Roberto Proietti,et al.  Experimental Demonstration of Flexible Bandwidth Optical Data Center Core Network With All-to-All Interconnectivity , 2015, Journal of Lightwave Technology.

[4]  J. Shalf,et al.  Understanding ultra-scale application communication requirements , 2005, IEEE International. 2005 Proceedings of the IEEE Workload Characterization Symposium, 2005..

[5]  Benjamin G. Lee Photonic Switch Fabrics in Computer Communications Systems , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[6]  Philip Heidelberger,et al.  Performance benefits of optical circuit switches for large-scale dragonfly networks , 2016, 2016 Optical Fiber Communications Conference and Exhibition (OFC).

[7]  Xin Li,et al.  Optical Circuit Switching Enabled Reconfigurable HPC Network for Traffic Pattern , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).