Online Scheduling to Maximize Resource Utilization of Deadline-Constrained Workflows on the Cloud

In this paper, we assume workflows under deadline constraints are submitted to the cloud from time to time. Every time a workflow is submitted, the cloud needs to determine whether it can agree with the specific constraint set by the user. If the cloud agrees to admit the workflow, cloud resources can be allocated for its execution in a way the deadline constraint can be met, while the existing load in the underlying resources is considered. The focus of this paper is how to schedule the tasks of each admitted workflow so that the resource utilization can be maximized. A variety of online scheduling algorithms have been proposed and evaluated using a simulator that manages to generate a stream of workflows for which an optimal schedule, with 100% resource utilization and without deadline violation, is guaranteed to exist.

[1]  G. Bruce Berriman,et al.  An Evaluation of the Cost and Performance of Scientific Workflows on Amazon EC2 , 2012, Journal of Grid Computing.

[2]  Jarek Nabrzyski,et al.  Cost- and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds , 2012, 2012 International Conference for High Performance Computing, Networking, Storage and Analysis.

[3]  Weisong Shi,et al.  A Planner-Guided Scheduling Strategy for Multiple Workflow Applications , 2008, 2008 International Conference on Parallel Processing - Workshops.

[4]  Emmanuel Jeannot,et al.  Comparative Evaluation Of The Robustness Of DAG Scheduling Heuristics , 2008, CoreGRID Integration Workshop.

[5]  David S. Johnson,et al.  Computers and In stractability: A Guide to the Theory of NP-Completeness. W. H Freeman, San Fran , 1979 .

[6]  Chao Xu,et al.  Online Scheduling of Multiple Deadline-Constrained Workflow Applications in Distributed Systems , 2015, 2015 Third International Conference on Advanced Cloud and Big Data.

[7]  Keqin Li,et al.  Energy management for multiple real-time workflows on cyber-physical cloud systems , 2017, Future Gener. Comput. Syst..

[8]  Kuo-Chan Huang,et al.  Scheduling online mixed-parallel workflows of rigid tasks in heterogeneous multi-cluster environments , 2016, Future Gener. Comput. Syst..

[9]  Kuo-Chan Huang,et al.  Online Scheduling of Workflow Applications in Grid Environment , 2010, GPC.

[10]  Putchong Uthayopas,et al.  Energy-aware scheduling of multiple workflows application on distributed systems , 2016, 2016 13th International Joint Conference on Computer Science and Software Engineering (JCSSE).

[11]  Andrei Tchernykh,et al.  Multiple Workflow Scheduling Strategies with User Run Time Estimates on a Grid , 2012, Journal of Grid Computing.

[12]  Albert Y. Zomaya,et al.  Online Multiple Workflow Scheduling under Privacy and Deadline in Hybrid Cloud Environment , 2014, 2014 IEEE 6th International Conference on Cloud Computing Technology and Science.

[13]  Albert Y. Zomaya,et al.  Adaptive multiple-workflow scheduling with task rearrangement , 2014, The Journal of Supercomputing.

[14]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[15]  Li Fu,et al.  Time and Energy Optimization Algorithms for the Static Scheduling of Multiple Workflows in Heterogeneous Computing System , 2017, Journal of Grid Computing.

[16]  Xin Shen,et al.  Real-time workflows oriented online scheduling in uncertain cloud environment , 2017, The Journal of Supercomputing.