Bi-Criteria Scheduling of Scientific Grid Workflows

The drift towards new challenges in Grid computing including scientific workflow management implies the need for new, robust, multicriteria scheduling algorithms that can be applied by the user in an intuitive way. Currently existing bi-criteria scheduling approaches for scientific workflows are usually restricted to certain criterion pairs and require the user to define his preferences either as weights assigned each criterion or as fixed constraints defined for one criterion. The first approach has the drawback that combining multiple criteria into a single objective function is not always intuitive to the end-user, while the second requires a priori knowledge about the result of the first criteria scheduling result. We propose a new bi-criteria scheduling specification method defining for the secondary criterion a sliding constraint as a function of the primary criterion. We model the problem as an extension of the multiple-choice knapsack problem and propose a general bi-criteria scheduling heuristic called dynamic constraint algorithm (DCA) based on dynamic programming. We show through simulation that in most of the experimental cases DCA outperforms two existing algorithms designed for the same problem at the expense of an increased execution time, which is still relatively low for workflows of medium size. Finally, we confirm our simulation results for a real-world hydrological application executed in the Austrian Grid environment.

[1]  Mourad Hakem,et al.  Reliability and Scheduling on Systems Subject to Failures , 2007, 2007 International Conference on Parallel Processing (ICPP 2007).

[2]  Ian T. Foster,et al.  Globus Toolkit Version 4: Software for Service-Oriented Systems , 2005, Journal of Computer Science and Technology.

[3]  Rajkumar Buyya,et al.  Cost-based scheduling of scientific workflow applications on utility grids , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[4]  Rainer Schmidt,et al.  QoS support for time-critical grid workflow applications , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[5]  Alain Girault,et al.  A bi-criteria scheduling heuristic for distributed embedded systems under reliability and real-time constraints , 2004, International Conference on Dependable Systems and Networks, 2004.

[6]  Xipeng Xiao,et al.  Internet QoS: a big picture , 1999, IEEE Netw..

[7]  Rizos Sakellariou,et al.  An Experimental Investigation into the Rank Function of the Heterogeneous Earliest Finish Time Scheduling Algorithm , 2003, Euro-Par.

[8]  Xiao Qin,et al.  A dynamic and reliability-driven scheduling algorithm for parallel real-time jobs executing on heterogeneous clusters , 2005, J. Parallel Distributed Comput..

[9]  Atakan Dogan,et al.  Biobjective Scheduling Algorithms for Execution Time?Reliability Trade-off in Heterogeneous Computing Systems , 2005, Comput. J..

[10]  Karsten Jasper Hydrological modelling of alpine river catchments using output variables from atmospheric models , 2001 .

[11]  Jens Volkert Austrian Grid: Overview on the Project with Focus on Parallel Applications , 2006, 2006 Fifth International Symposium on Parallel and Distributed Computing.

[12]  Radu Prodan,et al.  Grid Computing, Experiment Management, Tool Integration, and Scientific Workflows , 2007, Lecture Notes in Computer Science.

[13]  Gideon Langholz,et al.  Multi-criteria scheduling optimization using fuzzy logic , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[14]  Füsun Özgüner,et al.  Parallelizing Existing Applications in a Distributed Heterogeneous Environment , 1995 .

[15]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[16]  Marios D. Dikaiakos,et al.  Scheduling Workflows with Budget Constraints , 2007, Grid 2007.

[17]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[18]  Edward A. Lee,et al.  A Compile-Time Scheduling Heuristic for Interconnection-Constrained Heterogeneous Processor Architectures , 1993, IEEE Trans. Parallel Distributed Syst..

[19]  Jun Qin,et al.  ASKALON: A Development and Grid Computing Environment for Scientific Workflows , 2007, Workflows for e-Science, Scientific Workflows for Grids.

[20]  Rajkumar Buyya,et al.  Multi-objective planning for workflow execution on Grids , 2007, 2007 8th IEEE/ACM International Conference on Grid Computing.

[21]  Rizos Sakellariou,et al.  An evaluation of heuristics for SLA based parallel job scheduling , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[22]  Radu Prodan,et al.  Taxonomies of the Multi-Criteria Grid Workflow Scheduling Problem , 2008 .

[23]  Jeffrey D. Ullman,et al.  NP-Complete Scheduling Problems , 1975, J. Comput. Syst. Sci..

[24]  DONALD MICHIE,et al.  “Memo” Functions and Machine Learning , 1968, Nature.

[25]  Emmanuel Jeannot,et al.  Bi-objective scheduling algorithms for optimizing makespan and reliability on heterogeneous systems , 2007, SPAA '07.