A Flexible Scheduler for Workflow Ensembles

In this paper, we propose a flexible workflow scheduler that facilitates the replacement of the objective function according to the user's needs. The possibility of replacing the objective function extends the usability of the scheduler for a variety of objectives. The proposed flexible scheduler uses Particle Swarm Optimization (PSO) to assist the production of schedules on cloud resources. We perform the evaluation via simulation using a set of scientific workflows grouped into ensembles. Three conflicting objective functions were evaluated: minimization of the overall makespan, maximization of fairness, and minimization of monetary costs. Simulation results show that the flexibility of the proposed scheduler has been achieved since each function could produce schedules that satisfied its corresponding objective.

[1]  DeelmanEwa,et al.  Algorithms for cost- and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds , 2015 .

[2]  Ewa Deelman,et al.  Producing an Infrared Multiwavelength Galactic Plane Atlas Using Montage, Pegasus, and Amazon Web Services , 2014 .

[3]  Rizos Sakellariou,et al.  Energy-Constrained Provisioning for Scientific Workflow Ensembles , 2013, 2013 International Conference on Cloud and Green Computing.

[4]  Luiz Fernando Bittencourt,et al.  Workflow scheduling for SaaS / PaaS cloud providers considering two SLA levels , 2012, 2012 IEEE Network Operations and Management Symposium.

[5]  Rizos Sakellariou,et al.  Scheduling multiple DAGs onto heterogeneous systems , 2006, Proceedings 20th IEEE International Parallel & Distributed Processing Symposium.

[6]  Albert Y. Zomaya,et al.  Executing Large Scale Scientific Workflow Ensembles in Public Clouds , 2015, 2015 44th International Conference on Parallel Processing.

[7]  References , 1971 .

[8]  Luiz Fernando Bittencourt,et al.  Towards the Scheduling of Multiple Workflows on Computational Grids , 2010, Journal of Grid Computing.

[9]  Salim Hariri,et al.  Performance-Effective and Low-Complexity Task Scheduling for Heterogeneous Computing , 2002, IEEE Trans. Parallel Distributed Syst..

[10]  Terrance E. Boult,et al.  Towards Application-centric Fairness in Multi-tenant Clouds with Adaptive CPU Sharing Model , 2016, 2016 IEEE 9th International Conference on Cloud Computing (CLOUD).

[11]  Raj Jain,et al.  A Quantitative Measure Of Fairness And Discrimination For Resource Allocation In Shared Computer Systems , 1998, ArXiv.

[12]  Rajkumar Buyya,et al.  A Particle Swarm Optimization-Based Heuristic for Scheduling Workflow Applications in Cloud Computing Environments , 2010, 2010 24th IEEE International Conference on Advanced Information Networking and Applications.

[13]  Riccardo Poli,et al.  Particle swarm optimization , 1995, Swarm Intelligence.

[14]  Dennis Gannon,et al.  Workflows for e-Science, Scientific Workflows for Grids , 2014 .