Practical power consumption estimation for real life HPC applications

Due to high energy costs, fine-grained power consumption accounting and capability of making users of High Performance Computing (HPC) clusters aware of the cost of their computation is becoming more and more important. Hardware power measurement solutions can be very expensive, hence the appeal of software-based estimation methods. In this paper we present a practical approach to power consumption estimation of both individual application executions and whole computing nodes. We compare it to existing state-of-the-art solutions, provide accuracy figures, and discuss possible deployment scenarios. Highlights? We explore existing methods for measuring HPC machine power use. ? We propose general method for software estimation of power consumption. ? We discuss both application and machine-level power estimation. ? We provide practical application scenarios for both methods.

[1]  Ryan Jansen,et al.  Enabling Sustainable Clouds via Environmentally Opportunistic Computing , 2010, 2010 IEEE Second International Conference on Cloud Computing Technology and Science.

[2]  Margaret Martonosi,et al.  Run-time power estimation in high performance microprocessors , 2001, ISLPED '01.

[3]  Garrick Staples,et al.  TORQUE resource manager , 2006, SC.

[4]  Laxmikant V. Kalé,et al.  Scalable molecular dynamics with NAMD , 2005, J. Comput. Chem..

[5]  Hermann de Meer,et al.  Evaluating and modeling power consumption of multi-core processors , 2012, 2012 Third International Conference on Future Systems: Where Energy, Computing and Communication Meet (e-Energy).

[6]  Xiaohan Ma,et al.  Statistical Power Consumption Analysis and Modeling for GPU-based Computing , 2011 .

[7]  Maria Grazia Fugini,et al.  Layered Green Performance Indicators , 2012, Future Gener. Comput. Syst..

[8]  Nian-Feng Tzeng,et al.  Run-time Energy Consumption Estimation Based on Workload in Server Systems , 2008, HotPower.

[9]  Henri Casanova,et al.  Energy-aware service allocation , 2012, Future Gener. Comput. Syst..

[10]  John Maindonald,et al.  Data Analysis and Graphics Using R: An Example-based Approach (Cambridge Series in Statistical and Probabilistic Mathematics) , 2003 .

[11]  Hrvoje Jasak,et al.  A tensorial approach to computational continuum mechanics using object-oriented techniques , 1998 .

[12]  John E. Stone,et al.  Quantifying the impact of GPUs on performance and energy efficiency in HPC clusters , 2010, International Conference on Green Computing.

[13]  David E. Culler,et al.  The ganglia distributed monitoring system: design, implementation, and experience , 2004, Parallel Comput..

[14]  Matthieu Verstraete,et al.  First-principles computation of material properties: the ABINIT software project , 2002 .

[15]  Laurent Lefèvre,et al.  Multi-facet approach to reduce energy consumption in clouds and grids: the GREEN-NET framework , 2010, e-Energy.

[16]  Ayan Banerjee,et al.  Spatio-temporal thermal-aware job scheduling to minimize energy consumption in virtualized heterogeneous data centers , 2009, Comput. Networks.

[17]  Laurent Lefèvre,et al.  The GREEN-NET framework: Energy efficiency in large scale distributed systems , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[18]  Rong Ge,et al.  Green Supercomputing Comes of Age , 2008, IT Professional.

[19]  John H. Maindonald,et al.  Data Analysis and Graphics Using R: An Example-Based Approach , 2010 .

[20]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[21]  Helmut Hlavacs,et al.  Methodology of measurement for energy consumption of applications , 2010, 2010 11th IEEE/ACM International Conference on Grid Computing.

[22]  Trevor N. Mudge,et al.  Understanding and Designing New Server Architectures for Emerging Warehouse-Computing Environments , 2008, 2008 International Symposium on Computer Architecture.