Deadline and energy constrained dynamic resource allocation in a heterogeneous computing environment

Energy-efficient resource allocation within clusters and data centers is important because of the growing cost of energy. We study the problem of energy-constrained dynamic allocation of tasks to a heterogeneous cluster computing environment. Our goal is to complete as many tasks by their individual deadlines and within the system energy constraint as possible given that task execution times are uncertain and the system is oversubscribed at times. We use Dynamic Voltage and Frequency Scaling (DVFS) to balance the energy consumption and execution time of each task. We design and evaluate (via simulation) a set of heuristics and filtering mechanisms for making allocations in our system. We show that the appropriate choice of filtering mechanisms improves performance more than the choice of heuristic (among the heuristics we tested).

[1]  Rudi van Drunen,et al.  Localization of Random Pulse Point Sources Using Physically Implementable Search Algorithms , 2020, Optoelectronics, Instrumentation and Data Processing.

[2]  Howard Jay Siegel,et al.  Representing Task and Machine Heterogeneities for Heterogeneous Computing Systems , 2000 .

[3]  Alexandru Iosup,et al.  Grid Computing Workloads , 2011, IEEE Internet Computing.

[4]  A. James.  2010 , 2011, Philo of Alexandria: an Annotated Bibliography 2007-2016.

[5]  Larry Wasserman,et al.  All of Statistics: A Concise Course in Statistical Inference , 2004 .

[6]  Benjamin W. Wah,et al.  Wiley Encyclopedia of Computer Science and Engineering , 2009, Wiley Encyclopedia of Computer Science and Engineering.

[7]  Sanguthevar Rajasekaran,et al.  Handbook of Parallel Computing - Models, Algorithms and Applications , 2007 .

[8]  Jorge Manuel Gomes Barbosa,et al.  Dynamic Job Scheduling on Heterogeneous Clusters , 2009, 2009 Eighth International Symposium on Parallel and Distributed Computing.

[9]  Michael Kistler,et al.  The case for power management in web servers , 2002 .

[10]  Rajkumar Buyya,et al.  Power Aware Scheduling of Bag-of-Tasks Applications with Deadline Constraints on DVS-enabled Clusters , 2007, Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07).

[11]  Riccardo Bettati,et al.  Response time analysis for distributed real-time systems with bursty job arrivals , 1998, Proceedings. 1998 International Conference on Parallel Processing (Cat. No.98EX205).

[12]  Klaus-Dieter Lange,et al.  ASSESSING TRENDS OVER TIME IN PERFORMANCE , COSTS , AND ENERGY USE FOR SERVERS , 2009 .

[13]  Rami G. Melhem,et al.  Dynamic and aggressive scheduling techniques for power-aware real-time systems , 2001, Proceedings 22nd IEEE Real-Time Systems Symposium (RTSS 2001) (Cat. No.01PR1420).

[14]  Anthony A. Maciejewski,et al.  Stochastic-Based Robust Dynamic Resource Allocation in a Heterogeneous Computing System , 2009, 2009 International Conference on Parallel Processing.

[15]  Leon Garcia,et al.  Probability and Random Processes for Electrical Engineering , 1993 .

[16]  Anthony A. Maciejewski,et al.  Dynamic Resource Management in Energy Constrained Heterogeneous Computing Systems Using Voltage Scaling , 2008, IEEE Transactions on Parallel and Distributed Systems.

[17]  Anthony A. Maciejewski,et al.  Robust Resource Allocation in Heterogeneous Parallel and Distributed Computing Systems , 2008, Wiley Encyclopedia of Computer Science and Engineering.

[18]  Yung-Hsiang Lu,et al.  Dynamic Voltage Scaling for Multitasking Real-Time Systems With Uncertain Execution Time , 2008, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[19]  Yan Alexander Li,et al.  Determining the Execution Time Distribution for a Data Parallel Program in a Heterogeneous Computing Environment , 1997, J. Parallel Distributed Comput..

[20]  Yajun Ha,et al.  Dynamic scheduling of imprecise-computation tasks in maximizing QoS under energy constraints for embedded systems , 2008, 2008 Asia and South Pacific Design Automation Conference.

[21]  Anthony A. Maciejewski,et al.  Energy-Constrained Dynamic Resource Allocation in a Heterogeneous Computing Environment , 2011, ICPP Workshops.

[22]  Anthony A. Maciejewski,et al.  Heuristics for Robust Resource Allocation of Satellite Weather Data Processing on a Heterogeneous Parallel System , 2011, IEEE Transactions on Parallel and Distributed Systems.

[23]  Eve A. Riskin,et al.  Signals, Systems, and Transforms , 1994 .

[24]  Rami Melhem,et al.  Power Aware Computing , 2002, Series in Computer Science.

[25]  Anthony A. Maciejewski,et al.  Perspectives on Robust Resource Allocation for Heterogeneous Parallel and Distributed Systems , 2007, Handbook of Parallel Computing.

[26]  Gregory A. Koenig,et al.  Time Utility Functions for Modeling and Evaluating Resource Allocations in a Heterogeneous Computing System , 2011, 2011 IEEE International Symposium on Parallel and Distributed Processing Workshops and Phd Forum.

[27]  Anthony A. Maciejewski,et al.  Stochastically robust static resource allocation for energy minimization with a makespan constraint in a heterogeneous computing environment , 2011, 2011 9th IEEE/ACS International Conference on Computer Systems and Applications (AICCSA).

[28]  R. F. Freund,et al.  Dynamic Mapping of a Class of Independent Tasks onto Heterogeneous Computing Systems , 1999, J. Parallel Distributed Comput..