Toward exa-scale optical circuit switch interconnect networks for future datacenter/HPC

This paper discusses how to realize an optical circuit switching interconnect capable of more than 10 Tbps link bandwidth and more than 100,000 end points scalability. To keep continuous performance improvement of datacenters or high performance computers, high capacity and low latency interconnect network is essential. To handle such large bandwidth interconnect networks with low energy consumption, optical switch technologies will become inevitable. This paper firstly examines the scaling of the energy consumption of optical circuit switching networks based on the state of the art silicon photonics switch technology. Secondly to achieve Tbps-class link bandwidth, the WDM transmission technology and a shared WDM light source mechanism named “wavelength bank” are introduced. Due to the shared light source, each optical transceiver does not have to carry individual light sources, which enables simple WDM transceivers with cost-efficient silicon photonics technologies. Then a new optical switch control approach which reduces the control overhead time is discussed. In the proposed approach, the optical data plane itself represents the path destination, which enables a simple distributed-like control procedure. The proposed approach is expected to achieve the scalability and flexibility supporting more than 10 Tbps link bandwidth and more than 100,000 endpoints with 40 WDM channels. The proposed interconnect architecture offers direct end-to-end optical paths enabling low latencies with the “speed of light”. The paper also discusses some of the challenges which should be resolved to practically realize the future large bandwidth optical interconnect networks.

[1]  Ryousei Takano,et al.  Flow-centric computing leveraged by photonic circuit switching for the post-moore era , 2016, 2016 Tenth IEEE/ACM International Symposium on Networks-on-Chip (NOCS).

[2]  A. Pilipetskii,et al.  64QAM based coded modulation transmission over transoceanic distance with > 60 Tb/s capacity , 2015, 2015 Optical Fiber Communications Conference and Exhibition (OFC).

[3]  G. Papen,et al.  A 10 µs hybrid optical-circuit/electrical-packet network for datacenters , 2013, 2013 Optical Fiber Communication Conference and Exposition and the National Fiber Optic Engineers Conference (OFC/NFOEC).

[4]  Ken Tanizawa,et al.  Silicon photonic 32 × 32 strictly-non-blocking blade switch and its full path characterization , 2016, 2016 21st OptoElectronics and Communications Conference (OECC) held jointly with 2016 International Conference on Photonics in Switching (PS).

[5]  A. Ghiasi Is there a need for on-chip photonic integration for large data warehouse switches , 2012, The 9th International Conference on Group IV Photonics (GFP).

[6]  Qi Li,et al.  Silicon Photonics for Exascale Systems , 2014, Journal of Lightwave Technology.

[7]  G. Cong,et al.  Ultra-compact 32 × 32 strictly-non-blocking Si-wire optical switch with fan-out LGA interposer. , 2015, Optics express.

[8]  Takashi Inoue,et al.  Exabit Optical Network Based on Optical Comb Distribution for High-Performance Datacenters: Challenges and Strategies , 2015 .

[9]  Tatsushi Nakahara,et al.  A torus datacenter network based on OPS/OCS/VOCS enabled by smart flow management , 2015, 2015 Optical Fiber Communications Conference and Exhibition (OFC).

[10]  Shu Namiki,et al.  Distributed-like optical path switch control approach for interconnect networks , 2016, 2016 IEEE 17th International Conference on High Performance Switching and Routing (HPSR).

[11]  Yojiro Mori,et al.  Demonstration of 1,440×1,440 fast optical circuit switch for datacenter networking , 2016, 2016 21st OptoElectronics and Communications Conference (OECC) held jointly with 2016 International Conference on Photonics in Switching (PS).

[12]  Andrzej Jajszczyk Nonblocking, repackable, and rearrangeable Clos networks: fifty years of the theory evolution , 2003, IEEE Commun. Mag..

[13]  Shu Namiki,et al.  Toward exa-scale photonic switch system for the future datacenter (invited paper) , 2016, 2016 Tenth IEEE/ACM International Symposium on Networks-on-Chip (NOCS).

[14]  Ming C. Wu,et al.  64×64 Low-loss and broadband digital silicon photonic MEMS switches , 2015, 2015 European Conference on Optical Communication (ECOC).