Runtime power usage estimation of HPC servers for various classes of real-life applications

Abstract In this paper we propose a methodology underlying a development of system-wide energy consumption models for servers, which is based on the analysis of performance counters. It enables to estimate the power usage of a machine under any load at runtime. By clustering applications we extract groups of programs having similar characteristics. This allows us to create more specialized and accurate power usage models. By using decision trees it is possible to automatically select an appropriate model to current system load. Training and test sets of programs were used to test the estimates. The presented models are accurate within an error of 4% as verified on servers from different vendors, including the latest pre-production one.

[1]  Jan Weglarz,et al.  Practical power consumption estimation for real life HPC applications , 2013, Future Gener. Comput. Syst..

[2]  Laurent Lefèvre,et al.  Energy-efficient data transfers in large-scale distributed systems , 2012 .

[3]  Laurent Lefèvre,et al.  The GREEN-NET framework: Energy efficiency in large scale distributed systems , 2009, 2009 IEEE International Symposium on Parallel & Distributed Processing.

[4]  Gilles Kassel,et al.  The Green Computing Observatory: A Data Curation Approach for Green IT , 2011, 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing.

[5]  Hermann de Meer,et al.  Evaluating and modeling power consumption of multi-core processors , 2012, 2012 Third International Conference on Future Systems: Where Energy, Computing and Communication Meet (e-Energy).

[6]  Aleksandar Jemcov,et al.  OpenFOAM: A C++ Library for Complex Physics Simulations , 2007 .

[7]  Leo Breiman,et al.  Classification and Regression Trees , 1984 .

[8]  Vipin Kumar,et al.  Introduction to Data Mining, (First Edition) , 2005 .

[9]  Nian-Feng Tzeng,et al.  Run-time Energy Consumption Estimation Based on Workload in Server Systems , 2008, HotPower.

[10]  Helmut Hlavacs,et al.  Methodology of measurement for energy consumption of applications , 2010, 2010 11th IEEE/ACM International Conference on Grid Computing.

[11]  Donald K. Wedding,et al.  Discovering Knowledge in Data, an Introduction to Data Mining , 2005, Inf. Process. Manag..

[12]  Vipin Kumar,et al.  Introduction to Data Mining , 2022, Data Mining and Machine Learning Applications.

[13]  Daniel T. Larose,et al.  Discovering Knowledge in Data: An Introduction to Data Mining , 2005 .

[14]  Peter Dalgaard,et al.  Introductory statistics with R , 2002, Statistics and computing.

[15]  Laurent Lefèvre,et al.  Energy-Efficient Data Transfers in Large-Scale Distributed Systems , 2012, Handbook of Energy-Aware and Green Computing.

[16]  Giovanni Giuliani,et al.  A methodology to predict the power consumption of servers in data centres , 2011, e-Energy.