Workflow scheduling on distributed systems

Growing evidence shows that in obtaining high performance, a well-managed time-constrained workflow scheduling is needed. Efficient workflow scheduling is critical for achieving high performance especially in heterogeneous computing system. However, it is a great challenge to improve performance and to optimize several objectives simultaneously. We propose a workflow scheduling algorithm that minimizes the makespan of the workflow application modeled by a Directed Acyclic Graph (DAG). The new proposed scheduling algorithm is named Multi Dependency Joint (MDJ) Algorithm. The performance of MDJ is compared with existing algorithms such as, Highest Level First with Estimated Time (HLFET), Modified Critical Path (MCP) and Earliest Time First (ETF). As a result, the experiments show that our proposed MDJ algorithm outperforms HLEFT, MCP, and EFT with a 7% lower overall completion time.

[1]  Radu Prodan,et al.  MOHEFT: A multi-objective list-based method for workflow scheduling , 2012, 4th IEEE International Conference on Cloud Computing Technology and Science Proceedings.

[2]  Jun Zhang,et al.  An Ant Colony Optimization Approach to a Grid Workflow Scheduling Problem With Various QoS Requirements , 2009, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[3]  Tei-Wei Kuo,et al.  An approximation scheme for energy-efficient scheduling of real-time tasks in heterogeneous multiprocessor systems , 2009, 2009 Design, Automation & Test in Europe Conference & Exhibition.

[4]  Shanlin Yang,et al.  An improved ant colony optimization for scheduling identical parallel batching machines with arbitrary job sizes , 2013, Appl. Soft Comput..

[5]  Albert Y. Zomaya,et al.  Energy-aware parallel task scheduling in a cluster , 2013, Future Gener. Comput. Syst..

[6]  Chia-Ming Wu,et al.  A green energy-efficient scheduling algorithm using the DVFS technique for cloud datacenters , 2014, Future Gener. Comput. Syst..

[7]  Fangpeng Dong.  Workflow Scheduling Algorithms in the Grid , 2009 .

[8]  Rajkumar Buyya,et al.  Energy-aware resource allocation heuristics for efficient management of data centers for Cloud computing , 2012, Future Gener. Comput. Syst..

[9]  Ciprian Dobre,et al.  Performance Analysis of Grid DAG Scheduling Algorithms using MONARC Simulation Tool , 2008, 2008 International Symposium on Parallel and Distributed Computing.

[10]  L. Y. Tseng,et al.  The anatomy study of high performance task scheduling algorithm for Grid computing system , 2009, Comput. Stand. Interfaces.

[11]  Rajesh Gupta,et al.  Energy-efficient deadline scheduling for heterogeneous systems , 2012, J. Parallel Distributed Comput..

[12]  Yong Wang,et al.  A novel deadline and budget constrained scheduling heuristics for computational grids , 2011 .

[13]  Dick H. J. Epema,et al.  Deadline-constrained workflow scheduling algorithms for Infrastructure as a Service Clouds , 2013, Future Gener. Comput. Syst..

[14]  Florin Pop.  Heuristics Analysis for Distributed Scheduling using MONARC Simulation Tool , 2012 .

[15]  Hyunjin Kim,et al.  Communication-aware task scheduling and voltage selection for total energy minimization in a multiprocessor system using Ant Colony Optimization , 2011, Inf. Sci..

[16]  Kenli Li,et al.  Adaptive energy-efficient scheduling for real-time tasks on DVS-enabled heterogeneous clusters , 2012, J. Parallel Distributed Comput..

[17]  Bertrand Granado,et al.  Multi-Objective Approach for Energy-Aware Workflow Scheduling in Cloud Computing Environments , 2013, TheScientificWorldJournal.

[18]  Valentin Cristea,et al.  Dynamic Scheduling Algorithms for Workflow Applications in Grid Environment , 2009, 2009 11th International Symposium on Symbolic and Numeric Algorithms for Scientific Computing.

[19]  T. Aaron Gulliver,et al.  Fast workflow scheduling for grid computing based on a multi-objective Genetic Algorithm , 2013, 2013 IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM).

[20]  Maozhen Li,et al.  Enhancing genetic algorithms for dependent job scheduling in grid computing environments , 2012, The Journal of Supercomputing.

[21]  Kenli Li,et al.  A Multiple Priority Queueing Genetic Algorithm for Task Scheduling on Heterogeneous Computing Systems , 2012, 2012 IEEE 14th International Conference on High Performance Computing and Communication & 2012 IEEE 9th International Conference on Embedded Software and Systems.

[22]  Fatos Xhafa,et al.  Genetic Algorithms for Energy-Aware Scheduling in Computational Grids , 2011, 2011 International Conference on P2P, Parallel, Grid, Cloud and Internet Computing.

[23]  Yi Guo,et al.  A DAG Scheduling Scheme on Heterogeneous Computing Systems Using Tuple-Based Chemical Reaction Optimization , 2014, TheScientificWorldJournal.

[24]  Jan Janeček,et al.  Static vs. Dynamic List-Scheduling Performance Comparison , 2003 .

[25]  Rizos Sakellariou,et al.  A hybrid heuristic for DAG scheduling on heterogeneous systems , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[26]  K. Mani Chandy,et al.  A comparison of list schedules for parallel processing systems , 1974, Commun. ACM.

[27]  Alexandru Iosup,et al.  Performance analysis of dynamic workflow scheduling in multicluster grids , 2010, HPDC '10.

[28]  Jian Li,et al.  Enhanced Energy-Efficient Scheduling for Parallel Applications in Cloud , 2012, 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012).

[29]  Rajkumar Buyya,et al.  A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[30]  Rajkumar Buyya,et al.  Failure-aware resource provisioning for hybrid Cloud infrastructure , 2012, J. Parallel Distributed Comput..

[31]  Reza Entezari-Maleki,et al.  A Hybrid Genetic Algorithm and Variable Neighborhood Search for Task Scheduling Problem in Grid Environment , 2012 .

[32]  Radu Prodan,et al.  Taxonomies of the Multi-Criteria Grid Workflow Scheduling Problem , 2008 .

[33]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[34]  Xiao Qin,et al.  EAD and PEBD: Two Energy-Aware Duplication Scheduling Algorithms for Parallel Tasks on Homogeneous Clusters , 2011, IEEE Transactions on Computers.

[35]  D. Dutta,et al.  A genetic: algorithm approach to cost-based multi-QoS job scheduling in cloud computing environment , 2011, ICWET.

[36]  Edward A. Lee,et al.  A Compile-Time Scheduling Heuristic for Interconnection-Constrained Heterogeneous Processor Architectures , 1993, IEEE Trans. Parallel Distributed Syst..