Grid Scheduling with Makespan and Energy-Based Goals

The need for better energy efficiency in grid computing is significant given the massive amount of energy dissipated by large grids. We approximate the optimal allocation of compute nodes to a job stream, with each job consisting of multiple tasks, and while considering both the computing requirements and a desired balance of shorter makespans and lower energy consumption. The approach is widely applicable to many grid scenarios and does not require the scheduler to have administrative rights to change the workers’ DVFS or hibernation state. A discrete particle swarm optimisation (PSO) determines the worker assignments based on estimations of the tasks’ service times and energy consumption using an online learning process, and taking into account pending task executions from prior jobs. The performance of the proposed system is then evaluated through extensive Monte Carlo simulations using traces of real multi-threaded program executions on representative computer hardware. The results demonstrate the latent energy savings that are possible in grid computing through an energy-aware task scheduling.

[1]  Albert Y. Zomaya,et al.  Artificial life techniques for load balancing in computational grids , 2007, J. Comput. Syst. Sci..

[2]  Lesandro Ponciano,et al.  Assessing Green Strategies in Peer-to-Peer Opportunistic Grids , 2012, Journal of Grid Computing.

[3]  David P. Anderson,et al.  BOINC: a system for public-resource computing and storage , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[4]  Lesandro Ponciano,et al.  On the impact of energy-saving strategies in opportunistic grids , 2010, 2010 11th IEEE/ACM International Conference on Grid Computing.

[5]  Andries Petrus Engelbrecht,et al.  Particle swarm optimization approaches to coevolve strategies for the iterated prisoner's dilemma , 2005, IEEE Transactions on Evolutionary Computation.

[6]  Christoforos E. Kozyrakis,et al.  Models and Metrics to Enable Energy-Efficiency Optimizations , 2007, Computer.

[7]  Ricardo Lent A sensor network to profile the electrical power consumption of computer networks , 2010, 2010 IEEE Globecom Workshops.

[8]  Laurent Lefèvre,et al.  Smart scheduling for saving energy in grid computing , 2012, Expert Syst. Appl..

[9]  Albert Y. Zomaya,et al.  A hierarchical approach for energy-efficient scheduling of large workloads in multicore distributed systems , 2014, Sustain. Comput. Informatics Syst..

[10]  Gregor von Laszewski,et al.  QoS guided Min-Min heuristic for grid task scheduling , 2003, Journal of Computer Science and Technology.

[11]  Davide Morelli,et al.  A compositional model to characterize software and hardware from their resource usage , 2012, ICCSW.

[12]  A. Ayatollahi,et al.  A comparison between Genetic Algorithm and PSO for linear phase FIR digital filter design , 2008, 2008 9th International Conference on Signal Processing.

[13]  Changjun Jiang,et al.  A Novel Discrete Particle Swarm Optimization Algorithm for Job Scheduling in Grids , 2008, 2008 Fourth International Conference on Natural Computation.

[14]  Sébastien Varrette,et al.  Energy Efficiency on Scalable Computing Architectures , 2011, 2011 IEEE 11th International Conference on Computer and Information Technology.

[15]  Sharad Malik,et al.  Power analysis of embedded software: a first step towards software power minimization , 1994, IEEE Trans. Very Large Scale Integr. Syst..

[16]  Samee Ullah Khan,et al.  Energy-Aware Grid Scheduling of Independent Tasks and Highly Distributed Data , 2013, 2013 11th International Conference on Frontiers of Information Technology.

[17]  Albert Y. Zomaya,et al.  Author manuscript, published in "Journal of Parallel and Distributed Computing (2011)" A Parallel Bi-objective Hybrid Metaheuristic for Energy-aware Scheduling for Cloud Computing Systems , 2011 .

[18]  Russell C. Eberhart,et al.  Recent advances in particle swarm , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[19]  Sherief Reda,et al.  Power Modeling and Characterization of Computing Devices: A Survey , 2012, Found. Trends Electron. Des. Autom..

[20]  Fábio Coutinho,et al.  A Workflow Scheduling Algorithm for Optimizing Energy-Efficient Grid Resources Usage , 2011, 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing.

[21]  Pascal Bouvry,et al.  A two-phase heuristic for the energy-efficient scheduling of independent tasks on computational grids , 2012, Cluster Computing.

[22]  Giovanni Giuliani,et al.  Cloud computing and its interest in saving energy: the use case of a private cloud , 2012, Journal of Cloud Computing: Advances, Systems and Applications.

[23]  Ravi Sethi,et al.  The Complexity of Flowshop and Jobshop Scheduling , 1976, Math. Oper. Res..

[24]  Kai Li,et al.  The PARSEC benchmark suite: Characterization and architectural implications , 2008, 2008 International Conference on Parallel Architectures and Compilation Techniques (PACT).

[25]  Donald E. Grierson,et al.  Comparison among five evolutionary-based optimization algorithms , 2005, Adv. Eng. Informatics.

[26]  Samee Ullah Khan,et al.  An Energy-Efficient Task Scheduling Algorithm in DVFS-enabled Cloud Environment , 2015, Journal of Grid Computing.

[27]  Keqiu Li,et al.  Improving cloud computing energy efficiency , 2012, 2012 IEEE Asia Pacific Cloud Computing Congress (APCloudCC).

[28]  Albert Y. Zomaya,et al.  Survey on Grid Resource Allocation Mechanisms , 2014, Journal of Grid Computing.

[29]  Layuan Li,et al.  Utility-based scheduling for grid computing under constraints of energy budget and deadline , 2009, Comput. Stand. Interfaces.

[30]  Yskandar Hamam,et al.  Task allocation for maximizing reliability of distributed systems: A simulated annealing approach , 2006, J. Parallel Distributed Comput..

[31]  Ricardo Lent Analysis of an energy proportional data center , 2015, Ad Hoc Networks.

[32]  Yong Zhao,et al.  Cloud Computing and Grid Computing 360-Degree Compared , 2008, GCE 2008.

[33]  David P. Anderson,et al.  SETI@home-massively distributed computing for SETI , 2001, Comput. Sci. Eng..

[34]  James Kennedy,et al.  Particle swarm optimization , 2002, Proceedings of ICNN'95 - International Conference on Neural Networks.

[35]  Kang G. Shin,et al.  Profiling Software for Energy Consumption , 2012, 2012 IEEE International Conference on Green Computing and Communications.

[36]  Pascal Bouvry,et al.  Energy-Aware Scheduling on Multicore Heterogeneous Grid Computing Systems , 2013, Journal of Grid Computing.

[37]  Erol Gelenbe,et al.  Optimising Server Energy Consumption and Response Time , 2012 .

[38]  Bin Zhang,et al.  Task Scheduling in Grid Based on Particle Swarm Optimization , 2006, 2006 Fifth International Symposium on Parallel and Distributed Computing.

[39]  Shajulin Benedict,et al.  Energy-aware performance analysis methodologies for HPC architectures - An exploratory study , 2012, J. Netw. Comput. Appl..

[40]  B. Allen,et al.  Designing a Runtime System for Volunteer Computing , 2006, ACM/IEEE SC 2006 Conference (SC'06).

[41]  Nancy Wilkins-Diehr,et al.  XSEDE: Accelerating Scientific Discovery , 2014, Computing in Science & Engineering.

[42]  Albert Y. Zomaya,et al.  Energy Efficient Distributed Computing Systems , 2012 .

[43]  Albert Y. Zomaya,et al.  Priority-Based Scheduling for Large-Scale Distribute Systems with Energy Awareness , 2011, 2011 IEEE Ninth International Conference on Dependable, Autonomic and Secure Computing.

[44]  Erol Gelenbe,et al.  Trade-offs between energy and quality of service , 2012, 2012 Sustainable Internet and ICT for Sustainability (SustainIT).

[45]  Ruay-Shiung Chang,et al.  An ant algorithm for balanced job scheduling in grids , 2009, Future Gener. Comput. Syst..