Hi-LION: Hierarchical large-scale interconnection optical network with AWGRs [invited]

This paper proposes Hi-LION, a hierarchical large-scale interconnect optical network, exploiting high-radix arrayed waveguide grating routers (AWGRs) in hierarchy to achieve very large scale and low latency interconnection of many computing nodes. By using the unique wavelength routing property of AWGRs together with electrical switching inside the processors, Hi-LION can scale beyond 100,000 nodes. A comparison with a legacy fat-tree network with a 3:1 oversubscription ratio shows that Hi-LION can achieve 2.5-fold throughput increases while using less than 20% of the global switches and cables.

[1]  Jung Ho Ahn,et al.  The role of optics in future high radix switch design , 2011, 2011 38th Annual International Symposium on Computer Architecture (ISCA).

[2]  Eli Upfal,et al.  Efficient Algorithms for All-to-All Communications in Multiport Message-Passing Systems , 1997, IEEE Trans. Parallel Distributed Syst..

[3]  Roberto Proietti,et al.  A scalable silicon photonic chip-scale optical switch for high performance computing systems. , 2013, Optics express.

[4]  Konstantina Papagiannaki,et al.  c-Through: part-time optics in data centers , 2010, SIGCOMM '10.

[5]  K. Hasharoni,et al.  High BW Parallel Optical Interconnects , 2014 .

[6]  Christopher Batten,et al.  Building Manycore Processor-to-DRAM Networks with Monolithic Silicon Photonics , 2008, 2008 16th IEEE Symposium on High Performance Interconnects.

[7]  T. Shibata,et al.  64 × 64-channel Uniform-loss and Cyclic-frequency Arrayed-waveguide Grating Router Module , 2002, 2002 28TH European Conference on Optical Communication.

[8]  R. Luijten,et al.  An Optical Packet-Switched Interconnect for Supercomputer Applications ∗ , 2004 .

[9]  S. J. B. Yoo,et al.  Ultra-Compact Silicon Photonic 512 × 512 25 GHz Arrayed Waveguide Grating Router , 2014, IEEE Journal of Selected Topics in Quantum Electronics.

[10]  Bernard Glance,et al.  Applications of the integrated waveguide grating router , 1994 .

[11]  K. Bergman,et al.  The Data Vortex Optical Packet Switched Interconnection Network , 2008, Journal of Lightwave Technology.

[12]  Roberto Proietti,et al.  Scalable and distributed optical interconnect architecture based on AWGR for HPC and data centers , 2014, OFC 2014.

[13]  David A. Maltz,et al.  Network traffic characteristics of data centers in the wild , 2010, IMC '10.

[14]  Jitender S. Deogun,et al.  HyScaleII: A high performance hybrid optical network architecture for data centers , 2012, 2012 35th IEEE Sarnoff Symposium.

[15]  M. S. Moreolo,et al.  Optical Fiber Communication Conference , 2014 .

[16]  H. Takahashi,et al.  Large Port Count Wavelength Routing Optical Switch Consisting of Cascaded Small-Size Cyclic Arrayed Waveguide Gratings , 2012, IEEE Photonics Technology Letters.

[17]  Roberto Proietti,et al.  DOS - A scalable optical switch for datacenters , 2010, 2010 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[18]  Christina Delimitrou,et al.  ECHO: Recreating network traffic maps for datacenters with tens of thousands of servers , 2012, 2012 IEEE International Symposium on Workload Characterization (IISWC).

[19]  Roberto Proietti,et al.  Scalable Optical Interconnect Architecture Using AWGR-Based TONAK LION Switch With Limited Number of Wavelengths , 2013, Journal of Lightwave Technology.

[20]  Ronald P. Luijten,et al.  Optical-packet-switched interconnect for supercomputer applications[Invited] , 2004 .

[21]  Amin Vahdat,et al.  Helios: a hybrid electrical/optical switch architecture for modular data centers , 2010, SIGCOMM '10.

[22]  Michael Gschwind,et al.  The IBM Blue Gene/Q Compute Chip , 2012, IEEE Micro.

[23]  Atul Singh,et al.  Proteus: a topology malleable data center network , 2010, Hotnets-IX.