A 1024-Port Optical Uni- and Multicast Packet Switch Fabric

Novel Data Center (DC) architectures based on resource disaggregation hold the potential to increase the resource utilization at a reduced energy and cost envelope, imposing, however, significant challenges in the underlying DC network infrastructure that has to provide high-radix and high-bandwidth connectivity, while maintaining sub-μs latency. At the same time, the explosive growth of AI applications has transformed the traffic profiles on the majority of DC workloads calling for support of advanced network functionalities, such as multicasting. In this direction, we scale-up the Hipoλaos optical packet switch architecture to a thousand-port layout, at the same time upgrading its functionality to allow latency-free intra-tray multicasting. The feasibility of a 10.24-Tb/s capacity switch fabric with a 10-Gb/s line rate in a 1024-port configuration, with four-packet buffering capacity is experimentally demonstrated, revealing error-free performance with <3.4-dB power penalty. Optical multicasting to up-to five nodes is also experimentally validated at 10 Gb/s, with a power penalty variation of less than 1 dB between the different output ports, while multicast operation across the whole required spectral range of a 1024-port switch is investigated, utilizing pairs of wavelengths with different channel spacing. Network-level analysis of the 1024-port Hipoλaos switch revealed sub-μs p90-latency and ∼85% throughput, for the unicast case, when utilizing a two-packet-buffer design. Finally, the simulation model was extended to support the Hipoλaos multicast friendly layout, revealing up to 4250% throughput improvement, as compared to the conventional layout, while maintaining sub-μs latency.

[1]  N. Pleros,et al.  40 Gb/s NRZ Wavelength Conversion Using a Differentially-Biased SOA-MZI: Theory and Experiment , 2011, Journal of Lightwave Technology.

[2]  Nikos Pleros,et al.  A 1024-Port sub-$\mu\text{see}$ Latency Optical Packet Switch Using the $\text{Hipo}\lambda \text{aos} \lambda$-Routed Modified Spanke Switch Architecture , 2018, 2018 European Conference on Optical Communication (ECOC).

[3]  Franck Cappello,et al.  Characterizing Cloud Applications on a Google Data Center , 2013, 2013 42nd International Conference on Parallel Processing.

[4]  Yojiro Mori,et al.  Large-Scale Optical Switch Utilizing Multistage Cyclic Arrayed-Waveguide Gratings for Intra-Datacenter Interconnection , 2017, IEEE Photonics Journal.

[5]  Dawei Wang,et al.  High-speed optical switch fabrics with large port count. , 2009, Optics express.

[6]  Emmanuel Varvarigos,et al.  Application-Oriented On-Board Optical Technologies for HPCs , 2017, Journal of Lightwave Technology.

[7]  J. Luo,et al.  Scaling photonic packet switches to a large number of ports [invited] , 2012, IEEE/OSA Journal of Optical Communications and Networking.

[8]  M. Moralis-Pegios,et al.  Multicasting in a High-Port Sub-μ sec Latency Hipo λ aos Optical Packet Switch , 2018 .

[9]  Kostas Katrinis,et al.  dReDBox: Materializing a full-stack rack-scale system prototype of a next-generation disaggregated datacenter , 2018, 2018 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[10]  Christina Delimitrou,et al.  ECHO: Recreating network traffic maps for datacenters with tens of thousands of servers , 2012, 2012 IEEE International Symposium on Workload Characterization (IISWC).

[11]  Georgios Zervas,et al.  Optically disaggregated data centers with minimal remote memory latency: Technologies, architectures, and resource allocation [Invited] , 2018, IEEE/OSA Journal of Optical Communications and Networking.

[12]  Roberto Proietti,et al.  Scalable Optical Interconnect Architecture Using AWGR-Based TONAK LION Switch With Limited Number of Wavelengths , 2013, Journal of Lightwave Technology.

[13]  Nikos Pleros,et al.  High-port low-latency optical switch architecture with optical feed-forward buffering for 256-node disaggregated data centers. , 2018, Optics express.

[14]  Scott Shenker,et al.  Network Requirements for Resource Disaggregation , 2016, OSDI.

[15]  R. Spanke,et al.  Architectures for large nonblocking optical space switches , 1986 .

[16]  Hiroshi Hasegawa,et al.  A large-scale wavelength routing optical switch for data center networks , 2013, IEEE Communications Magazine.

[17]  Xin Yin,et al.  A 40 Gb/s Chip-to-Chip Interconnect for 8-Socket Direct Connectivity Using Integrated Photonics , 2018, IEEE Photonics Journal.

[18]  Randy H. Katz,et al.  Heterogeneity and dynamicity of clouds at scale: Google trace analysis , 2012, SoCC '12.

[19]  H. J. S. Dorren,et al.  Scaling photonic packet switches to a large number of ports , 2011, 2011 ICO International Conference on Information Photonics.

[20]  T. Aalto,et al.  Multicast-Enabling Optical Switch Design Employing Si Buffering and Routing Elements , 2018, IEEE Photonics Technology Letters.

[21]  H. J. S. Dorren,et al.  Scaling low-latency optical packet switches to a thousand ports , 2012, IEEE/OSA Journal of Optical Communications and Networking.

[22]  Albert G. Greenberg,et al.  The nature of data center traffic: measurements & analysis , 2009, IMC '09.

[23]  Alex C. Snoeren,et al.  Inside the Social Network's (Datacenter) Network , 2015, Comput. Commun. Rev..

[24]  Nikos Pleros,et al.  O-band Energy-efficient Broadcast-friendly Interconnection Scheme with SiPho Mach-Zehnder Modulator (MZM) & Arrayed Waveguide Grating Router (AWGR) , 2018, 2018 Optical Fiber Communications Conference and Exposition (OFC).

[25]  N. Pleros,et al.  On-Chip SOI Delay Line Bank for Optical Buffers and Time Slot Interchangers , 2018, IEEE Photonics Technology Letters.

[26]  Nikos Pleros,et al.  Multicasting in a 256-Port Sub-$\mu \text{sec}$ Latency $\text{Hipo}\lambda\text{aos}$ Switch Architecture for Disaggregated DataCenters , 2018, 2018 European Conference on Optical Communication (ECOC).

[27]  Leslie Lamport,et al.  The part-time parliament , 1998, TOCS.

[28]  M. Moralis-Pegios,et al.  High-port and low-latency optical switches for disaggregated data centers: the Hipoλaos switch architecture , 2018, IEEE/OSA Journal of Optical Communications and Networking.