Energy consumption reduction for asynchronous message-passing applications

It is widely accepted that the asynchronous parallel methods are more suitable than the synchronous ones on a grid architecture. Indeed, they outperform the synchronous methods, because they overlap the communications of the synchronous methods with computations. However, they also usually execute more iterations than the synchronous ones and thus consume more energy. To reduce the energy consumption of the CPUs executing such methods, the Dynamic voltage and frequency scaling technique can be used. It lowers the frequency of a CPU to reduce its energy consumption, but it also decreases its computing power. Therefore, the frequency that gives the best trade-off between energy consumption and performance must be selected. This paper presents a new online frequency selecting algorithm for parallel iterative asynchronous methods running over grids. It selects a vector of frequencies that gives the best trade-off between energy consumption and performance. New energy and performance models were used in this algorithm to predict the execution time and the energy consumption of synchronous, asynchronous, or hybrid iterative applications running over grids. The proposed algorithm was evaluated on the SimGrid simulator. The experiments showed that synchronously applying the proposed algorithm to the asynchronous version of the application reduces on average its energy consumption by 22% and speeds it up by 5.72%. Finally, the proposed algorithm was also compared to a method that uses the well-known energy and delay product and the comparison results showed that it outperforms this method in terms of energy consumption and performance.

[1]  Michael Schwind,et al.  Energy measurement, modeling, and prediction for processors with frequency scaling , 2014, The Journal of Supercomputing.

[2]  Gernot Heiser,et al.  Dynamic voltage and frequency scaling: the laws of diminishing returns , 2010 .

[3]  Stefanos Kaxiras,et al.  Green governors: A framework for Continuously Adaptive DVFS , 2011, 2011 International Green Computing Conference and Workshops.

[4]  Laurent Lefèvre,et al.  The GREEN-NET framework: Energy efficiency in large scale distributed systems , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[5]  Che Wun Chiou,et al.  An Energy Conservation DVFS Algorithm for the Android Operating System , 2011 .

[6]  José Manuel Moya,et al.  Leakage-Aware Cooling Management for Improving Server Energy Efficiency , 2015, IEEE Transactions on Parallel and Distributed Systems.

[7]  Raphaël Couturier,et al.  Dynamic Frequency Scaling for Energy Consumption Reduction in Synchronous Distributed Applications , 2014, 2014 IEEE International Symposium on Parallel and Distributed Processing with Applications.

[8]  Sherief Reda,et al.  Identifying the optimal energy-efficient operating points of parallel workloads , 2011, 2011 IEEE/ACM International Conference on Computer-Aided Design (ICCAD).

[9]  Laurent Lefèvre,et al.  Multi-facet approach to reduce energy consumption in clouds and grids: the GREEN-NET framework , 2010, e-Energy.

[10]  Chaitali Chakrabarti,et al.  Energy-efficient dynamic task scheduling algorithms for DVS systems , 2008, TECS.

[11]  Adelinde M. Uhrmacher,et al.  Proceedings of the Winter Simulation Conference , 2012, WSC 2012.

[12]  Frank Mueller,et al.  Exploiting synchronous and asynchronous DVS for feedback EDF scheduling on an embedded platform , 2007, TECS.

[13]  Ananta Tiwari,et al.  PMaC's green queue: a framework for selecting energy optimal DVFS configurations in large scale MPI applications , 2016, Concurr. Comput. Pract. Exp..

[14]  Rajkumar Buyya,et al.  Optimal online deterministic algorithms and adaptive heuristics for energy and performance efficient dynamic consolidation of virtual machines in Cloud data centers , 2012, Concurr. Comput. Pract. Exp..

[15]  William Jalby,et al.  Minimizing Energy Consumption of MPI Programs in Realistic Environment , 2015, ArXiv.

[16]  Albert Y. Zomaya,et al.  Energy-aware parallel task scheduling in a cluster , 2013, Future Gener. Comput. Syst..

[17]  Shuaiwen Song,et al.  Designing energy efficient communication runtime systems: a view from PGAS models , 2013, The Journal of Supercomputing.

[18]  Raphaël Couturier,et al.  Simulation of Asynchronous Iterative Algorithms Using SimGrid , 2014, 2014 IEEE Intl Conf on High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security, 2014 IEEE 11th Intl Conf on Embedded Software and Syst (HPCC,CSS,ICESS).

[19]  Mahmut T. Kandemir,et al.  Leakage Current: Moore's Law Meets Static Power , 2003, Computer.

[20]  D. O’Leary,et al.  Multi-Splittings of Matrices and Parallel Solution of Linear Systems , 1985 .

[21]  Albert Y. Zomaya,et al.  Some observations on optimal frequency selection in DVFS-based energy consumption minimization , 2011, J. Parallel Distributed Comput..

[22]  Xiao Qin,et al.  EAD and PEBD: Two Energy-Aware Duplication Scheduling Algorithms for Parallel Tasks on Homogeneous Clusters , 2011, IEEE Transactions on Computers.

[23]  Raphaël Couturier,et al.  Energy Consumption Reduction with DVFS for Message Passing Iterative Applications on Heterogeneous Architectures , 2015, 2015 IEEE International Parallel and Distributed Processing Symposium Workshop.

[24]  Jean-Marc Pierson,et al.  Energy Aware Clouds Scheduling Using Anti-load Balancing Algorithm - EACAB , 2014, SMARTGREENS.

[25]  José Manuel Moya,et al.  Leakage and temperature aware server control for improving energy efficiency in data centers , 2013, 2013 Design, Automation & Test in Europe Conference & Exhibition (DATE).

[26]  Thomas Rauber,et al.  Analytical modeling and simulation of the energy consumption of independent tasks , 2012, Proceedings Title: Proceedings of the 2012 Winter Simulation Conference (WSC).

[27]  José Ranilla,et al.  A software tool to efficiently manage the energy consumption of HPC clusters , 2015, 2015 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE).

[28]  Wu-chun Feng,et al.  A Power-Aware Run-Time System for High-Performance Computing , 2005, ACM/IEEE SC 2005 Conference (SC'05).

[29]  Rajkumar Buyya,et al.  Energy-aware simulation with DVFS , 2013, Simul. Model. Pract. Theory.

[30]  Daniel Shelepov Scheduling on Heterogeneous Multicore Processors Using Architectural Signatures , 2008 .

[31]  William H. Sanders,et al.  Blackbox prediction of the impact of DVFS on end-to-end performance of multitier systems , 2010, PERV.

[32]  Wei Chen,et al.  GreenGPU: A Holistic Approach to Energy Efficiency in GPU-CPU Heterogeneous Architectures , 2012, 2012 41st International Conference on Parallel Processing.

[33]  K. Malkowski,et al.  Co-adapting scientific applications and architectures toward energy-efficient high performance computing , 2008 .

[34]  Lothar Thiele,et al.  Dynamic Frequency Scaling Schemes for Heterogeneous Clusters under Quality of Service Requirements , 2012, J. Inf. Sci. Eng..

[35]  Rodolfo Azevedo,et al.  Energy-Performance Tradeoffs in Software Transactional Memory , 2012, 2012 IEEE 24th International Symposium on Computer Architecture and High Performance Computing.

[36]  Hartwig Anzt,et al.  Asynchronous and Multiprecision Linear Solvers - Scalable and Fault-Tolerant Numerics for Energy Efficient High Performance Computing , 2012 .

[37]  Karthik Ramani,et al.  Power efficient resource scaling in partitioned architectures through dynamic heterogeneity , 2006, 2006 IEEE International Symposium on Performance Analysis of Systems and Software.

[38]  Rong Ge,et al.  Effects of Dynamic Voltage and Frequency Scaling on a K20 GPU , 2013, 2013 42nd International Conference on Parallel Processing.

[39]  Laurent Lefèvre,et al.  Save Watts in Your Grid: Green Strategies for Energy-Aware Framework in Large Scale Distributed Systems , 2008, 2008 14th IEEE International Conference on Parallel and Distributed Systems.

[40]  Rizos Sakellariou,et al.  Energy-Aware Workflow Scheduling Using Frequency Scaling , 2014, 2014 43rd International Conference on Parallel Processing Workshops.

[41]  Raphaël Couturier,et al.  Parallel Iterative Algorithms: From Sequential to Grid Computing (Chapman & Hall/crc Numerical Analy & Scient Comp. Series) , 2007 .

[42]  Feng Pan,et al.  Exploring the energy-time tradeoff in MPI programs on a power-scalable cluster , 2005, 19th IEEE International Parallel and Distributed Processing Symposium.

[43]  Henri Casanova,et al.  Versatile, scalable, and accurate simulation of distributed applications and platforms , 2014, J. Parallel Distributed Comput..

[44]  Hao Shen,et al.  Learning based DVFS for simultaneous temperature, performance and energy management , 2012, Thirteenth International Symposium on Quality Electronic Design (ISQED).