Exploration of Load Balancing Thresholds to Save Energy on Iterative Applications

The power consumption of High Performance Computing systems is an increasing concern as large-scale systems grow in size and, consequently, consume more energy. In response to this challenge, we proposed two variants of a new energy-aware load balancer that aim at reducing the energy consumption of parallel platforms running imbalanced scientific applications without degrading their performance. Our research combines Dynamic Load Balancing with Dynamic Voltage and Frequency Scaling techniques in order to reduce the clock frequency of underloaded computing cores which experience some residual imbalance even after tasks are remapped. This work presents a trade-off evaluation between runtime, power demand and total energy consumption when applying these two energy-aware load balancer variants on real-world applications. In this way, we can define which is the best threshold value for each application under the total energy consumption, total execution time or the average power demand focus.

[1]  Laxmikant V. Kalé,et al.  Load Balancing in Parallel Molecular Dynamics , 1998, IRREGULAR.

[2]  Stefanos Kaxiras,et al.  Introducing DVFS-Management in a Full-System Simulator , 2013, 2013 IEEE 21st International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems.

[3]  Laxmikant V. Kalé,et al.  Automated Load Balancing Invocation Based on Application Characteristics , 2012, 2012 IEEE International Conference on Cluster Computing.

[4]  Ian Karlin,et al.  LULESH Programming Model and Performance Ports Overview , 2012 .

[5]  Philippe Olivier Alexandre Navaux,et al.  Saving energy by exploiting residual imbalances on iterative applications , 2014, 2014 21st International Conference on High Performance Computing (HiPC).

[6]  Philippe Olivier Alexandre Navaux,et al.  Improving the Performance of Seismic Wave Simulations with Dynamic Load Balancing , 2014, 2014 22nd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[7]  Margaret Martonosi,et al.  An Analysis of Efficient Multi-Core Global Power Management Policies: Maximizing Performance for a Given Power Budget , 2006, 2006 39th Annual IEEE/ACM International Symposium on Microarchitecture (MICRO'06).

[8]  Laxmikant V. Kalé,et al.  A ‘cool’ way of improving the reliability of HPC machines , 2013, 2013 SC - International Conference for High Performance Computing, Networking, Storage and Analysis (SC).

[9]  Laxmikant V. Kale,et al.  Programming Petascale Applications with Charm , 2007 .

[10]  Gerard J. M. Smit,et al.  Analytic Clock Frequency Selection for Global DVFS , 2014, 2014 22nd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[11]  Jean Roman,et al.  Exploiting Intensive Multithreading for the Efficient Simulation of 3D Seismic Wave Propagation , 2008, 2008 11th IEEE International Conference on Computational Science and Engineering.

[12]  Seyedmehdi Hosseinimotlagh,et al.  A Cooperative Two-Tier Energy-Aware Scheduling for Real-Time Tasks in Computing Clouds , 2014, 2014 22nd Euromicro International Conference on Parallel, Distributed, and Network-Based Processing.

[13]  Yves Robert,et al.  Energy-aware scheduling under reliability and makespan constraints , 2011, 2012 19th International Conference on High Performance Computing.

[14]  Martin Schulz,et al.  Exploring Traditional and Emerging Parallel Programming Models Using a Proxy Application , 2013, 2013 IEEE 27th International Symposium on Parallel and Distributed Processing.

[15]  Richard F. Barrett,et al.  Exascale design space exploration and co-design , 2014, Future Gener. Comput. Syst..

[16]  Joseph Y.-T. Leung,et al.  Handbook of Scheduling: Algorithms, Models, and Performance Analysis , 2004 .

[17]  Madhusudhan Govindaraju,et al.  MapReduce framework energy adaptation via temperature awareness , 2013, Cluster Computing.

[18]  Shin Gyu Kim,et al.  Energy-Centric DVFS Controling Method for Multi-core Platforms , 2012, SC Companion.

[19]  Sally A. McKee,et al.  Portable, scalable, per-core power estimation for intelligent resource management , 2010, International Conference on Green Computing.

[20]  Sang Lyul Min,et al.  Energy-centric DVFS controlling method for multi-core platforms , 2012, 2012 SC Companion: High Performance Computing, Networking Storage and Analysis.

[21]  Laxmikant V. Kalé,et al.  Periodic hierarchical load balancing for large supercomputers , 2011, Int. J. High Perform. Comput. Appl..