Integrating dynamic pricing of electricity into energy aware scheduling for HPC systems

The research literature to date mainly aimed at reducing energy consumption in HPC environments. In this paper we propose a job power aware scheduling mechanism to reduce HPC's electricity bill without degrading the system utilization. The novelty of our job scheduling mechanism is its ability to take the variation of electricity price into consideration as a means to make better decisions of the timing of scheduling jobs with diverse power profiles. We verified the effectiveness of our design by conducting trace-based experiments on an IBM Blue Gene/P and a cluster system as well as a case study on Argonne's 48-rack IBM Blue Gene/Q system. Our preliminary results show that our power aware algorithm can reduce electricity bill of HPC systems as much as 23%.

[1]  Zhiling Lan,et al.  Reducing Fragmentation on Torus-Connected Supercomputers , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[2]  Dario Pompili,et al.  Proactive thermal management in green datacenters , 2012, The Journal of Supercomputing.

[3]  Narayan Desai,et al.  Co-analysis of RAS Log and Job Log on Blue Gene/P , 2011, 2011 IEEE International Parallel & Distributed Processing Symposium.

[4]  Ann C. Gentile,et al.  OVIS: a tool for intelligent, real-time monitoring of computational clusters , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[5]  Wolf-Dietrich Weber,et al.  Power provisioning for a warehouse-sized computer , 2007, ISCA '07.

[6]  Rong Ge,et al.  A power aware study for VTDIRECT95 using DVFS , 2009, SpringSim '09.

[7]  Bruce M. Maggs,et al.  Cutting the electric bill for internet-scale systems , 2009, SIGCOMM '09.

[8]  Clifford Stein,et al.  Introduction to Algorithms, 2nd edition. , 2001 .

[9]  Zhiling Lan,et al.  Job scheduling with adjusted runtime estimates on production supercomputers , 2013, J. Parallel Distributed Comput..

[10]  Luiz André Barroso,et al.  The Case for Energy-Proportional Computing , 2007, Computer.

[11]  Zhiling Lan,et al.  Reducing Energy Costs for IBM Blue Gene/P via Power-Aware Job Scheduling , 2013, JSSPP.

[12]  Xiaorui Wang,et al.  Power capping: a prelude to power shifting , 2008, Cluster Computing.

[13]  Ibm Redbooks.  IBM System Blue Gene Solution: Blue Gene/Q System Administration , 2012 .

[14]  Chandrakant D. Patel,et al.  Energy Aware Grid: Global Workload Placement Based on Energy Efficiency , 2003 .

[15]  Mateo Valero,et al.  Parallel job scheduling for power constrained HPC systems , 2012, Parallel Comput..

[16]  Dan Tsafrir,et al.  Reducing Performance Evaluation Sensitivity and Variability by Input Shaking , 2007, 2007 15th International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems.

[17]  Dror G. Feitelson,et al.  Utilization and Predictability in Scheduling the IBM SP2 with Backfilling , 1998, Proceedings of the First Merged International Parallel Processing Symposium and Symposium on Parallel and Distributed Processing.

[18]  Zhiling Lan,et al.  Analyzing and adjusting user runtime estimates to improve job scheduling on the Blue Gene/P , 2010, 2010 IEEE International Symposium on Parallel & Distributed Processing (IPDPS).

[19]  Xin-She Yang,et al.  Introduction to Algorithms , 2021, Nature-Inspired Optimization Algorithms.

[20]  Hiroshi Nakashima,et al.  Saving 200kW and $200 K/year by power-aware job/machine scheduling , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[21]  Wolfgang Frings,et al.  Measuring power consumption on IBM Blue Gene/P , 2011, Computer Science - Research and Development.

[22]  J. Lundgren,et al.  Multinational electricity market integration and electricity price dynamics , 2008, 2008 5th International Conference on the European Electricity Market.

[23]  Peng Li.  Variational analysis of large power grids by exploring statistical sampling sharing and spatial locality , 2005, ICCAD-2005. IEEE/ACM International Conference on Computer-Aided Design, 2005..

[24]  Takanori Ida,et al.  Using Dynamic Electricity Pricing to Address Energy Crises Evidence from Randomized Field Experiments , 2013 .

[25]  Hong Zhu,et al.  A survey of practical algorithms for suffix tree construction in external memory , 2010 .

[26]  Zhiling Lan,et al.  Measuring Power Consumption on IBM Blue Gene/Q , 2013, 2013 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum.

[27]  Carolina García-Martos,et al.  Forecasting electricity prices by extracting dynamic common factors: application to the Iberian Market , 2012 .

[28]  Enrique V. Carrera,et al.  Load balancing and unbalancing for power and performance in cluster-based systems , 2001 .