On the routing and scalability of MZI-based optical Beneš interconnects

Abstract Silicon Photonic interconnects are a promising technology for scaling computing systems into the exa-scale domain. However, there exist significant challenges in terms of optical losses and complexity. In this work, we evaluate the applicability of a thermally/electrically tuned Benes network based on Mach–Zehnder Interferometers for on-chip and inter-chip interconnects as regards its scalability. We examine how insertion loss, laser power and switching energy consumption scale with the number of endpoints. In addition, we propose a set of hardware-inspired routing strategies that leverage the inherent asymmetry present in the switching components. We evaluate a range of network sizes, from 16 up to 256 endpoints, using 8 realistic and synthetic workloads and found very promising results. Our routing strategies offer a reduction in path-dependent insertion loss of up to 35% in the best case, as well as a laser power reduction of 31% for 32 endpoints. In addition, bit-switching energy is reduced by between 8% and 15% using the most efficient routing strategy, depending on the communication workload. We also show that workload execution time can be reduced with the best strategies by 5%–25% in some workloads, while the worst-case increases are at most 3%. Using our routing strategies, we show that under the examined technology parameters, a 32-endpoint interconnect can be considered for the NoC domain in terms of insertion loss and laser power, even when using conservative parameters for the modulator.

[1]  Ronny Henker,et al.  Survey of Photonic and Plasmonic Interconnect Technologies for Intra-Datacenter and High-Performance Computing Communications , 2018, IEEE Communications Surveys & Tutorials.

[2]  Chen Sun,et al.  DSENT - A Tool Connecting Emerging Photonics with Electronics for Opto-Electronic Networks-on-Chip Modeling , 2012, 2012 IEEE/ACM Sixth International Symposium on Networks-on-Chip.

[3]  Linjie Zhou,et al.  16 × 16 Silicon Optical Switch Based on Dual-Ring-Assisted Mach–Zehnder Interferometers , 2018, Journal of Lightwave Technology.

[4]  Jung Ho Ahn,et al.  Corona: System Implications of Emerging Nanophotonic Technology , 2008, 2008 International Symposium on Computer Architecture.

[5]  Hamid Mehrvar,et al.  High-performance silicon photonic tri-state switch based on balanced nested Mach-Zehnder interferometer , 2017, Scientific Reports.

[6]  Benjamin G. Lee,et al.  Ultralow crosstalk nanosecond-scale nested 2 × 2 Mach-Zehnder silicon photonic switch. , 2016, Optics letters.

[7]  Yvain Thonnart,et al.  Technology assessment of silicon interposers for manycore SoCs: Active, passive, or optical? , 2014, 2014 Eighth IEEE/ACM International Symposium on Networks-on-Chip (NoCS).

[8]  William J. Dally,et al.  Principles and Practices of Interconnection Networks , 2004 .

[9]  Simon D. Hammond,et al.  Optical interconnects for extreme scale computing systems , 2017, Parallel Comput..

[10]  Sebastian Werner,et al.  Designing Low-Power, Low-Latency Networks-on-Chip by Optimally Combining Electrical and Optical Links , 2017, 2017 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[11]  J. Cartledge,et al.  Silicon Microring Modulator for Dispersion Uncompensated Transmission Applications , 2016, Journal of Lightwave Technology.

[12]  K. Bergman,et al.  High-Speed 2$\, \times \,$2 Switch for Multiwavelength Silicon-Photonic Networks–On-Chip , 2009, Journal of Lightwave Technology.

[13]  Cyriel Minkenberg,et al.  Control path implementation for a low-latency optical HPC switch , 2005, 13th Symposium on High Performance Interconnects (HOTI'05).

[14]  Jean Decobert,et al.  Hybrid III-V Silicon Photonic Integrated Circuits for Optical Communication Applications , 2016, IEEE Journal of Selected Topics in Quantum Electronics.

[15]  Javier Navaridas,et al.  Scalability analysis of optical Beneš networks based on thermally/electrically tuned Mach-Zehnder interferometers , 2019, NoCArc@MICRO.

[16]  Ashok V. Krishnamoorthy,et al.  Silicon-photonic network architectures for scalable, power-efficient multi-chip systems , 2010, ISCA '10.

[17]  D. Bunandar,et al.  A MoTe2-based light-emitting diode and photodetector for silicon photonic integrated circuits. , 2017, Nature nanotechnology.

[18]  George Kurian,et al.  ATAC: A 1000-core cache-coherent processor with on-chip optical network , 2010, 2010 19th International Conference on Parallel Architectures and Compilation Techniques (PACT).

[19]  Daniel J. Blumenthal,et al.  Silicon Nitride in Silicon Photonics , 2018, Proceedings of the IEEE.

[20]  Natalie D. Enright Jerger,et al.  QuT: A low-power optical Network-on-Chip , 2014, 2014 Eighth IEEE/ACM International Symposium on Networks-on-Chip (NoCS).

[22]  Rekha Mehra,et al.  Machzehnder Interferometer and it’s Applications , 2010 .

[23]  Cyriel Minkenberg,et al.  Reimagining datacenter topologies with integrated silicon photonics , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[24]  Chien-Chun Lu,et al.  The double-layer network architecture for photonic switching , 1994 .

[25]  Lian-Kuan Chen,et al.  Optimization of Microring-Based Interconnection by Leveraging the Asymmetric Behaviors of Switching Elements , 2013, Journal of Lightwave Technology.

[26]  A. Biberman,et al.  Silicon Microring Resonator-Based Broadband Comb Switch for Wavelength-Parallel Message Routing , 2007, LEOS 2007 - IEEE Lasers and Electro-Optics Society Annual Meeting Conference Proceedings.

[27]  Keren Bergman,et al.  Modeling and Evaluation of Chip-to-Chip Scale Silicon Photonic Networks , 2014, 2014 IEEE 22nd Annual Symposium on High-Performance Interconnects.

[28]  Wei Li,et al.  Electrically pumped continuous-wave III–V quantum dot lasers on silicon , 2016, Nature Photonics.

[29]  Han Wui Then,et al.  The Transistor Laser: Theory and Experiment , 2013, Proceedings of the IEEE.

[30]  K. Bergman,et al.  Advanced path mapping for silicon photonic switch fabrics , 2017, 2017 Conference on Lasers and Electro-Optics (CLEO).

[31]  Iain A. Stewart,et al.  INRFlow: An interconnection networks research flow-level simulation framework , 2019, J. Parallel Distributed Comput..

[32]  Nikolaos Hardavellas,et al.  EcoLaser: An adaptive laser control for energy-efficient on-chip photonic interconnects , 2014, 2014 IEEE/ACM International Symposium on Low Power Electronics and Design (ISLPED).

[33]  Keren Bergman,et al.  Flexfly: Enabling a Reconfigurable Dragonfly through Silicon Photonics , 2016, SC16: International Conference for High Performance Computing, Networking, Storage and Analysis.

[34]  Sebastian Werner,et al.  A Survey on Optical Network-on-Chip Architectures , 2017, ACM Comput. Surv..

[35]  Yu Zhang,et al.  Silicon and hybrid silicon photonic devices for intra-datacenter applications: state of the art and perspectives [Invited] , 2015 .

[36]  Ray T. Chen,et al.  Recent advances in silicon-based passive and active optical interconnects. , 2015, Optics express.

[37]  A. Krishnamoorthy,et al.  High speed silicon microring modulator based on carrier depletion , 2010, 2010 Conference on Optical Fiber Communication (OFC/NFOEC), collocated National Fiber Optic Engineers Conference.

[38]  Geert Morthier,et al.  Novel Light Source Integration Approaches for Silicon Photonics , 2017 .

[39]  Jens H. Schmid,et al.  Roadmap on silicon photonics , 2016 .

[40]  Fei Zhao,et al.  Silicon photonic switch subsystem with 900 monolithically integrated calibration photodiodes and 64-fiber package , 2017, 2017 Optical Fiber Communications Conference and Exhibition (OFC).

[41]  Roberto Gaudino,et al.  Scalability of Optical Interconnects Based on Microring Resonators , 2010, IEEE Photonics Technology Letters.

[42]  H. J. S. Dorren,et al.  On the performance of a large-scale optical packet switch under realistic data center traffic , 2013, IEEE/OSA Journal of Optical Communications and Networking.

[43]  Sudeep Pasricha,et al.  METEOR: Hybrid photonic ring-mesh network-on-chip for multicore architectures , 2014, ACM Trans. Embed. Comput. Syst..

[44]  Javier Navaridas,et al.  Efficient sharing of optical resources in low-power optical networks-on-chip , 2017, IEEE/OSA Journal of Optical Communications and Networking.

[45]  K. Bergman,et al.  The Data Vortex Optical Packet Switched Interconnection Network , 2008, Journal of Lightwave Technology.

[46]  Qixiang Cheng,et al.  Recent advances in optical technologies for data centers: a review , 2018, Optica.

[47]  K. Murakami,et al.  Path-independent insertion loss optical space switch , 1987 .

[48]  Benjamin G. Lee,et al.  Impact of Topology on the Scalability of Mach–Zehnder-Based Multistage Silicon Photonic Switch Networks , 2018, Journal of Lightwave Technology.

[49]  Fei Zhao,et al.  Large-Scale Silicon Photonic Switch , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[50]  Arghavan Asad,et al.  A novel power model for future heterogeneous 3D chip-multiprocessors in the dark silicon age , 2018, EURASIP J. Embed. Syst..

[51]  Jiang Xu,et al.  Low-Loss High-Radix Integrated Optical Switch Networks for Software-Defined Servers , 2016, Journal of Lightwave Technology.

[52]  Smruti R. Sarangi,et al.  A Survey of On-Chip Optical Interconnects , 2019, ACM Comput. Surv..

[53]  R. Soref,et al.  The Past, Present, and Future of Silicon Photonics , 2006, IEEE Journal of Selected Topics in Quantum Electronics.

[54]  Roberto Proietti,et al.  DOS - A scalable optical switch for datacenters , 2010, 2010 ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS).

[55]  Jeffrey A. Kash,et al.  Optical interconnects for high performance computing , 2012, 2009 Asia Communications and Photonics conference and Exhibition (ACP).

[56]  Linjie Zhou,et al.  16 × 16 non-blocking silicon optical switch based on electro-optic Mach-Zehnder interferometers. , 2016, Optics express.

[57]  Kostas Katrinis,et al.  Rack-scale disaggregated cloud data centers: The dReDBox project vision , 2016, 2016 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[58]  Zhiping Zhou,et al.  On-chip light sources for silicon photonics , 2015, Light: Science & Applications.

[59]  Huaxi Gu,et al.  Venus: A Low-Latency, Low-Loss 3-D Hybrid Network-on-Chip for Kilocore Systems , 2017, Journal of Lightwave Technology.

[60]  Frederic T. Chong,et al.  Baldur: A Power-Efficient and Scalable Network Using All-Optical Switches , 2020, 2020 IEEE International Symposium on High Performance Computer Architecture (HPCA).

[61]  E. Bente,et al.  A III-V-on-Si ultra-dense comb laser , 2016, Light: Science & Applications.

[62]  Hamid Mehrvar,et al.  Switches and routing for on-chip photonic networks , 2019, 2019 24th OptoElectronics and Communications Conference (OECC) and 2019 International Conference on Photonics in Switching and Computing (PSC).

[63]  Rajeev Thakur,et al.  Improving the Performance of Collective Operations in MPICH , 2003, PVM/MPI.

[64]  Benjamin G. Lee,et al.  Silicon Photonic Switch Fabrics: Technology and Architecture , 2019, Journal of Lightwave Technology.

[65]  Nikolaos Hardavellas,et al.  Galaxy: a high-performance energy-efficient multi-chip architecture using photonic interconnects , 2014, ICS '14.

[66]  R.P. Luijten,et al.  The OSMOSIS optical packet switch for supercomputers , 2009, 2009 Conference on Optical Fiber Communication - incudes post deadline papers.

[67]  George T. Kanellos,et al.  Optics in Computing: From Photonic Network-on-Chip to Chip-to-Chip Interconnects and Disintegrated Architectures , 2019, Journal of Lightwave Technology.

[68]  Keren Bergman,et al.  Performance Requirements for Terabit-Class Silicon Photonic Links Based on Cascaded Microring Resonators , 2020, Journal of Lightwave Technology.