Taxonomies of the Multi-Criteria Grid Workflow Scheduling Problem

The workflow scheduling problem which is considered difficult on the Grid becomes even more challenging when multiple scheduling criteria are used for optimization. The existing approaches can address only certain variants of the multi-criteria workflow scheduling problem, usually considering up to two contradicting criteria being scheduled in some specific Grid environments. A comprehensive description of the problem can be an important step towards more general scheduling approaches. Based on the related work and on our own experience, we propose several novel taxonomies of the multi-criteria workflow scheduling problem, considering five facets which may have a major impact on the selection of an appropriate scheduling strategy: scheduling process, scheduling criteria, resource model, task model, and workflow model. We analyze different existing workflow scheduling approaches for the Grid, and classify them according to the proposed taxonomies, identifying the most common use cases and the areas which have not been sufficiently explored yet.

[1]  David K. Smith.  Theory of Linear and Integer Programming , 1987 .

[2]  D. B. Davis,et al.  Sun Microsystems Inc. , 1993 .

[3]  Carl F. Mela,et al.  Using fuzzy set theoretic techniques to identify preference rules from interactions in the linear model: an empirical study , 1995 .

[4]  Miron Livny,et al.  Checkpoint and Migration of UNIX Processes in the Condor Distributed Processing System , 1997 .

[5]  Alexander Schrijver,et al.  Theory of linear and integer programming , 1986, Wiley-Interscience series in discrete mathematics and optimization.

[6]  Xipeng Xiao,et al.  Internet QoS: a big picture , 1999, IEEE Netw..

[7]  N. R. Jennings,et al.  To appear in: Int Journal of Group Decision and Negotiation GDN2000 Keynote Paper Automated Negotiation: Prospects, Methods and Challenges , 2022 .

[8]  Jaspal Subhlok,et al.  Optimal Use of Mixed Task and Data Parallelism for Pipelined Computations , 2000, J. Parallel Distributed Comput..

[9]  Francine Berman,et al.  Heuristics for scheduling parameter sweep applications in grid environments , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[10]  Richard Wolski,et al.  Analyzing Market-Based Resource Allocation Strategies for the Computational Grid , 2001, Int. J. High Perform. Comput. Appl..

[11]  Arjan J. C. van Gemund,et al.  CPR: mixed task and data parallel scheduling for distributed systems , 2001, Proceedings 15th International Parallel and Distributed Processing Symposium. IPDPS 2001.

[12]  Daniel A. Reed,et al.  Performance Contracts: Predicting and Monitoring Grid Application Behavior , 2001, GRID.

[13]  David Abramson,et al.  Economic models for management of resources in peer-to-peer and grid computing , 2001, SPIE ITCom.

[14]  Philippe Baptiste,et al.  Constraint - based scheduling : applying constraint programming to scheduling problems , 2001 .

[15]  Ian T. Foster,et al.  The Anatomy of the Grid: Enabling Scalable Virtual Organizations , 2001, Int. J. High Perform. Comput. Appl..

[16]  Stephen F. Smith,et al.  A Constraint-Based Method for Project Scheduling with Time Windows , 2002, J. Heuristics.

[17]  Edward Tsang,et al.  Constraint Based Scheduling: Applying Constraint Programming to Scheduling Problems , 2003, J. Sched..

[18]  Rizos Sakellariou,et al.  An Experimental Investigation into the Rank Function of the Heterogeneous Earliest Finish Time Scheduling Algorithm , 2003, Euro-Par.

[19]  Miron Livny,et al.  Stork: making data placement a first class citizen in the grid , 2004, 24th International Conference on Distributed Computing Systems, 2004. Proceedings..

[20]  Grzegorz Waligóra,et al.  A metaheuristic approach to scheduling workflow jobs on a Grid , 2004 .

[21]  Rizos Sakellariou,et al.  A hybrid heuristic for DAG scheduling on heterogeneous systems , 2004, 18th International Parallel and Distributed Processing Symposium, 2004. Proceedings..

[22]  Jarek Nabrzyski,et al.  Grid resource management: state of the art and future trends , 2004 .

[23]  Henri Casanova,et al.  From Heterogeneous Task Scheduling to Heterogeneous Mixed Parallel Scheduling , 2004, Euro-Par.

[24]  Jacek Blazewicz,et al.  Scheduling Malleable Tasks on Parallel Processors to Minimize the Makespan , 2004, Ann. Oper. Res..

[25]  Yolanda Gil,et al.  Workflow management in GriPhyN , 2004 .

[26]  Matjaz B. Juric,et al.  Business process execution language for web services , 2004 .

[27]  M. D. R. Moreno.  Representing and planning tasks with time and resources (representación y planificación de tareas con tiempo y recursos) , 2004 .

[28]  Jack Dongarra,et al.  Scheduling in the Grid application development software project , 2004 .

[29]  Francine Berman,et al.  New Grid Scheduling and Rescheduling Methods in the GrADS Project , 2004, IPDPS Next Generation Software Program - NSFNGS - PI Workshop.

[30]  Norman W. Paton,et al.  A novel approach to resource scheduling for parallel query processing on computational grids , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.

[31]  Rainer Schmidt,et al.  QoS support for time-critical grid workflow applications , 2005, First International Conference on e-Science and Grid Computing (e-Science'05).

[32]  Daniel S. Katz,et al.  Pegasus: A framework for mapping complex scientific workflows onto distributed systems , 2005, Sci. Program..

[33]  Rajkumar Buyya,et al.  Critical-path and priority based algorithms for scheduling workflows with parameter sweep tasks on global grids , 2005, 17th International Symposium on Computer Architecture and High Performance Computing (SBAC-PAD'05).

[34]  Dick H. J. Epema,et al.  The Design and Implementation of the KOALA Co-allocating Grid Scheduler , 2005, EGC.

[35]  Han Hoogeveen,et al.  Multicriteria scheduling , 2005, Eur. J. Oper. Res..

[36]  Jun Qin,et al.  ASKALON: a Grid application development and computing environment , 2005, The 6th IEEE/ACM International Workshop on Grid Computing, 2005..

[37]  Jun Qin,et al.  Specification of grid workflow applications with AGWL: an Abstract Grid Workflow Language , 2005, CCGrid 2005. IEEE International Symposium on Cluster Computing and the Grid, 2005..

[38]  David Abramson,et al.  The Grid Economy , 2005, Proceedings of the IEEE.

[39]  Von-Wun Soo,et al.  Market-oriented multiple resource scheduling in grid computing environments , 2005, 19th International Conference on Advanced Information Networking and Applications (AINA'05) Volume 1 (AINA papers).

[40]  C. Tham,et al.  QoS-based Scheduling of Workflow Applications on Service Grids , 2005 .

[41]  Albertas Caplinskas,et al.  Techniques to Aggregate the Characteristics of Internal Quality of an IS Specification Language , 2005, Informatica.

[42]  Wolfgang Ziegler,et al.  A Meta-scheduling Service for Co-allocating Arbitrary Types of Resources , 2005, PPAM.

[43]  Jiadao Li,et al.  Negotiation Strategies for Grid Scheduling , 2006, GPC.

[44]  Rizos Sakellariou,et al.  Scheduling multiple DAGs onto heterogeneous systems , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[45]  Jiadao Li,et al.  Learning-based negotiation strategies for grid scheduling , 2006, Sixth IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06).

[46]  Selim G. Akl,et al.  Scheduling Algorithms for Grid Computing: State of the Art and Open Problems , 2006 .

[47]  Tchimou N'Takpé,et al.  Critical path and area based scheduling of parallel task graphs on heterogeneous platforms , 2006, 12th International Conference on Parallel and Distributed Systems - (ICPADS'06).

[48]  Carl Kesselman,et al.  Application-Level Resource Provisioning on the Grid , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[49]  Lu Tian,et al.  Resource Allocation in Streaming Environments , 2006, 2006 7th IEEE/ACM International Conference on Grid Computing.

[50]  Andreas Hoheisel,et al.  User tools and languages for graph‐based Grid workflows , 2006, Concurr. Comput. Pract. Exp..

[51]  Jiadao Li,et al.  Negotiation Model Supporting Co-Allocation for Grid Scheduling , 2006, 2006 7th IEEE/ACM International Conference on Grid Computing.

[52]  Uhp Nancy.  Critical Path and Area Based Scheduling of Parallel Task Graphs on Heterogeneous Platforms , 2006 .

[53]  R. Buyya,et al.  A budget constrained scheduling of workflow applications on utility Grids using genetic algorithms , 2006, 2006 Workshop on Workflows in Support of Large-Scale Science.

[54]  Rizos Sakellariou,et al.  Advance Reservation Policies for Workflows , 2006, JSSPP.

[55]  Radu Prodan,et al.  Applying Advance Reservation to Increase Predictability of Workflow Execution on the Grid , 2006, 2006 Second IEEE International Conference on e-Science and Grid Computing (e-Science'06).

[56]  Rajkumar Buyya,et al.  Scheduling scientific workflow applications with deadline and budget constraints using genetic algorithms , 2006, Sci. Program..

[57]  Ivona Brandic,et al.  Amadeus: A Holistic Service-oriented Environment for Grid Workflows , 2006, 2006 Fifth International Conference on Grid and Cooperative Computing Workshops.

[58]  Morteza Analoui,et al.  QoS-based scheduling of workflow applications on grids , 2007 .

[59]  T. Fahringer,et al.  Workflow Conversion and Processing in the ASKALON Grid Environment , 2007 .

[60]  Weisong Shi,et al.  An Adaptive Rescheduling Strategy for Grid Workflow Applications , 2007, 2007 IEEE International Parallel and Distributed Processing Symposium.

[61]  Marios D. Dikaiakos,et al.  Scheduling Workflows with Budget Constraints , 2007, Grid 2007.

[62]  Marco Danelutto,et al.  Integrated Research in Grid Computing , 2008 .