GPU Energy Consumption Optimization With a Global-Based Neural Network Method

With the widespread use of smart technologies, graphics processing unit (GPU) power-optimization issues are becoming increasingly important. Many researchers have tried to use dynamic voltage and frequency scaling (DVFS) technology to optimize a GPU’s internal energy consumption. However, DVFS energy management often has difficulty balancing GPU performance and energy efficiency. This paper aims to implement a DVFS energy management strategy. We constructed a new type of neural network to a GPU-based energy management scheme, implemented the global-based DVFS model, and explored its implementation details. Using a master-slave model, we built a global energy control solution strategy. This strategy performs global collaborative DVFS adjustments on the GPU’s energy consumption module based on task characteristics. Through the software construction and implementation of the global-based DVFS model, we proved that the strategy improves the GPU performance while improving the GPU’s energy efficiency. We conducted performance and energy tests on three GPUs on the Tesla, Fermi, and Kepler platforms. The experiments showed that this strategy improved the performance and power consumption of GPUs based on each of the platforms.

[1]  Qiang Wang,et al.  HKBU Institutional Repository , 2018 .

[2]  Henry Hoffmann,et al.  Racing and Pacing to Idle: Theoretical and Empirical Analysis of Energy Optimization Heuristics , 2015, 2015 IEEE 3rd International Conference on Cyber-Physical Systems, Networks, and Applications.

[3]  Xinxin Mei,et al.  A measurement study of GPU DVFS on energy conservation , 2013, HotPower '13.

[4]  Keqin Li,et al.  Improving Multicore Server Performance and Reducing Energy Consumption by Workload Dependent Dynamic Power Management , 2016, IEEE Transactions on Cloud Computing.

[5]  Yanhui Huang,et al.  A Modeling Approach for Energy Saving Based on GA-BP Neural Network , 2016 .

[6]  Michael L. Scott,et al.  Energy-efficient processor design using multiple clock domains with dynamic voltage and frequency scaling , 2002, Proceedings Eighth International Symposium on High Performance Computer Architecture.

[7]  Guoming Tang,et al.  Zero-Cost, Fine-Grained Power Monitoring of Datacenters Using Non-Intrusive Power Disaggregation , 2015, Middleware.

[8]  Hiroshi Sasaki,et al.  Power and Performance Characterization and Modeling of GPU-Accelerated Systems , 2014, 2014 IEEE 28th International Parallel and Distributed Processing Symposium.

[9]  Song Hua,et al.  Design of electric loading system in flight simulator based on PIDNN , 2011, 2011 International Conference on Mechatronic Science, Electric Engineering and Computer (MEC).

[10]  Martin Burtscher,et al.  Energy, Power, and Performance Characterization of GPGPU Benchmark Programs , 2016, 2016 IEEE International Parallel and Distributed Processing Symposium Workshops (IPDPSW).

[11]  Zhang Yong,et al.  PIDNN decoupling control of boiler combustion system based on MCS , 2017, 2017 29th Chinese Control And Decision Conference (CCDC).

[12]  Wen-mei W. Hwu,et al.  Parboil: A Revised Benchmark Suite for Scientific and Commercial Throughput Computing , 2012 .

[13]  Shuaiwen Song,et al.  System-level power-performance efficiency modeling for emergent GPU architectures , 2012, 2012 21st International Conference on Parallel Architectures and Compilation Techniques (PACT).

[14]  Sherief Reda,et al.  Power-aware characterization and mapping of workloads on CPU-GPU processors , 2016, 2016 IEEE International Symposium on Workload Characterization (IISWC).

[15]  Yun Liang,et al.  Efficient GPU Spatial-Temporal Multitasking , 2015, IEEE Transactions on Parallel and Distributed Systems.