Energy and Makespan Tradeoffs in Heterogeneous Computing Systems using Efficient Linear Programming Techniques

Resource management for large-scale high performance computing systems pose difficult challenges to system administrators. The extreme scale of these modern systems require task scheduling algorithms that are capable of handling at least millions of tasks and thousands of machines. These large computing systems consume vast amounts of electricity leading to high operating costs. System administrators try to simultaneously reduce operating costs and offer state-of-the-art performance; however, these are often conflicting objectives. Highly scalable algorithms are necessary to schedule tasks efficiently and to help system administrators gain insight into energy/performance trade-offs of the system. System administrators can examine this trade-off space to quantify how much a difference in the performance level will cost in electricity, or analyze how much performance can be expected within an energy budget. In this study, we design a novel linear programming based resource allocation algorithm for a heterogeneous computing system to efficiently compute high quality solutions for simultaneously minimizing energy and makespan. These solutions are used to bound the Pareto front to easily trade-off energy and performance. The new algorithms are highly scalable in both solution quality and computation time compared to existing algorithms, especially as the problem size increases.

[1]  Shapour Azarm,et al.  Metrics for Quality Assessment of a Multiobjective Design Optimization Solution Set , 2001 .

[2]  Jie Wu,et al.  Energy-Aware Scheduling for Frame-Based Tasks on Heterogeneous Multiprocessor Platforms , 2012, 2012 41st International Conference on Parallel Processing.

[3]  He Yan,et al.  A bi-objective model for job-shop scheduling problem to minimize both energy consumption and makespan , 2005 .

[4]  David J. Brown,et al.  Toward Energy-Efficient Computing , 2010, ACM Queue.

[5]  Samee U. Khan,et al.  A Weighted Sum Technique for the Joint Optimization of Performance and Power Consumption in Data Centers , 2009 .

[6]  J. Koomey Worldwide electricity used in data centers , 2008 .

[7]  Gabriele Eichfelder,et al.  Adaptive Scalarization Methods in Multiobjective Optimization , 2008, Vector Optimization.

[8]  Harold P. Benson,et al.  An Outer Approximation Algorithm for Generating All Efficient Extreme Points in the Outcome Set of a Multiple Objective Linear Programming Problem , 1998, J. Glob. Optim..

[9]  A. A. Maciejewski,et al.  A Machine-by-Machine Analysis of a Bi-Objective Resource Allocation Problem , 2013 .

[10]  Marco Laumanns,et al.  SPEA2: Improving the Strength Pareto Evolutionary Algorithm For Multiobjective Optimization , 2002 .

[11]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[12]  E. Polak,et al.  On Multicriteria Optimization , 1976 .

[13]  Edoardo Amaldi,et al.  On population diversity measures in Euclidean space , 2010, IEEE Congress on Evolutionary Computation.

[14]  Viktor K. Prasanna,et al.  Heterogeneous computing: challenges and opportunities , 1993, Computer.

[15]  Klaus Jansen,et al.  Improved approximation schemes for scheduling unrelated parallel machines , 1999, STOC '99.

[16]  Imtiaz Ahmad,et al.  An Integrated Technique for Task Matching and Scheduling onto Distributed Heterogeneous Computing Systems , 2002, J. Parallel Distributed Comput..

[17]  Éva Tardos,et al.  Scheduling unrelated machines with costs , 1993, SODA '93.

[18]  Debasish Ghose,et al.  Scheduling Divisible Loads in Parallel and Distributed Systems , 1996 .

[19]  Anthony A. Maciejewski,et al.  Analyzing the Trade-offs Between Minimizing Makespan and Minimizing Energy Consumption in a Heterogeneous Resource Allocation Problem , 2012 .

[20]  Keqin Li,et al.  Future Generation Computer Systems ( ) – Future Generation Computer Systems Multi-objective Scheduling of Many Tasks in Cloud Platforms , 2022 .

[21]  Anthony A. Maciejewski,et al.  Scalable linear programming based resource allocation for makespan minimization in heterogeneous computing systems , 2015, J. Parallel Distributed Comput..

[22]  Andreas Löhne,et al.  Vector Optimization with Infimum and Supremum , 2011, Vector Optimization.

[23]  Yves Robert,et al.  Energy-aware scheduling under reliability and makespan constraints , 2011, 2012 19th International Conference on High Performance Computing.

[24]  Gregory A. Koenig,et al.  Utility Functions and Resource Management in an Oversubscribed Heterogeneous Computing Environment , 2015, IEEE Transactions on Computers.

[25]  I. Y. Kim,et al.  Adaptive weighted-sum method for bi-objective optimization: Pareto front generation , 2005 .

[26]  Kalyanmoy Deb,et al.  A fast and elitist multiobjective genetic algorithm: NSGA-II , 2002, IEEE Trans. Evol. Comput..

[27]  Anthony A. Maciejewski,et al.  Statistical measures for quantifying task and machine heterogeneities , 2011, The Journal of Supercomputing.

[28]  Stacey L. Faulkenberg,et al.  On the quality of discrete representations in multiple objective programming , 2010 .

[29]  John N. Tsitsiklis,et al.  Introduction to linear optimization , 1997, Athena scientific optimization and computation series.

[30]  Anthony A. Maciejewski,et al.  Efficient and Scalable Pareto Front Generation for Energy and Makespan in Heterogeneous Computing Systems , 2013, WCO@FedCSIS.

[31]  J. Marchal Cours d'economie politique , 1950 .

[32]  Yuping Wang,et al.  U-measure: a quality measure for multiobjective programming , 2003, IEEE Trans. Syst. Man Cybern. Part A.

[33]  Howard Jay Siegel,et al.  Representing Task and Machine Heterogeneities for Heterogeneous Computing Systems , 2000 .

[34]  Gregory A. Koenig,et al.  An Analysis Framework for Investigating the Trade-Offs between System Performance and Energy Consumption in a Heterogeneous Computing Environment , 2013, 2013 IEEE International Symposium on Parallel & Distributed Processing, Workshops and Phd Forum.

[35]  Ishfaq Ahmad,et al.  Optimal task assignment in heterogeneous distributed computing systems , 1998, IEEE Concurr..

[36]  Kirk W. Cameron,et al.  Energy Oddities, Part 2: Why Green Computing Is Odd , 2013, Computer.