As the relentless quest for higher throughput and lower energy cost continues in heterogenous multicores, there is a strong demand for energy-efficient and high-performance Network-on-Chip (NoC) architectures. Heterogeneous architectures that can simultaneously utilize both the serialized nature of the CPU as well as the thread level parallelism of the GPU are gaining traction in the industry. A critical issue with heterogeneous architectures is finding an optimal way to utilize the shared resources such as the last level cache and NoC without hindering the performance of either the CPU or the GPU core. Photonic interconnects are a disruptive technology solution that has the potential to increase the bandwidth, reduce latency, and improve energy-efficiency over traditional metallic interconnects. In this article, we propose a CPU-GPU heterogeneous architecture called Shared Heterogeneous Architecture with Reconfigurable Photonic Network-on-Chip (SHARP) that clusters CPU and GPU cores around the same router and dynamically allocates bandwidth between the CPU and GPU cores based on application demands. The SHARP architecture is designed as a Single-Writer Multiple-Reader (SWMR) crossbar with reservation-assist to connect CPU/GPU cores that dynamically reallocates bandwidth using buffer utilization information at runtime. As network traffic exhibits temporal and spatial fluctuations due to application behavior, SHARP can dynamically reallocate bandwidth and thereby adapt to application demands. SHARP demonstrates 34% performance (throughput) improvement over a baseline electrical CMESH while consuming 25% less energy per bit. Simulation results have also shown 6.9% to 14.9% performance improvement over other flavors of the proposed SHARP architecture without dynamic bandwidth allocation.
[1]
David R. Kaeli,et al.
Multi2Sim: A simulation framework for CPU-GPU computing
,
2012,
2012 21st International Conference on Parallel Architectures and Compilation Techniques (PACT).
[2]
Xiaowen Wu,et al.
SUOR: Sectioned Undirectional Optical Ring for Chip Multiprocessor
,
2014,
JETC.
[3]
Zhongliang Chen,et al.
Exploring the heterogeneous design space for both performance and reliability
,
2014,
2014 51st ACM/EDAC/IEEE Design Automation Conference (DAC).
[4]
Jeffrey S. Vetter,et al.
A Survey of CPU-GPU Heterogeneous Computing Techniques
,
2015,
ACM Comput. Surv..
[5]
Dennis Sullivan,et al.
Firefly
,
2012
.
[6]
Radu Marculescu,et al.
Hybrid network-on-chip architectures for accelerating deep learning kernels on heterogeneous manycore platforms
,
2016,
2016 International Conference on Compliers, Architectures, and Sythesis of Embedded Systems (CASES).
[7]
Sudhakar Yalamanchili,et al.
Adaptive virtual channel partitioning for network-on-chip in heterogeneous architectures
,
2013,
ACM Trans. Design Autom. Electr. Syst..
[8]
Sudhakar Yalamanchili,et al.
Design space exploration of on-chip ring interconnection for a CPU-GPU heterogeneous architecture
,
2013,
J. Parallel Distributed Comput..
[9]
Anoop Gupta,et al.
The SPLASH-2 programs: characterization and methodological considerations
,
1995,
ISCA.
[10]
Feng Liu,et al.
Dynamically managed data for CPU-GPU architectures
,
2012,
CGO '12.
[11]
David R. Kaeli,et al.
Leveraging Silicon-Photonic NoC for Designing Scalable GPUs
,
2015,
ICS.
[12]
Jung Ho Ahn,et al.
McPAT: An integrated power, area, and timing modeling framework for multicore and manycore architectures
,
2009,
2009 42nd Annual IEEE/ACM International Symposium on Microarchitecture (MICRO).