Adaptive parallel job scheduling with resource admissible allocation on two-level hierarchical grids

We evaluate job scheduling algorithms that integrate both tasks of Grid scheduling: job allocation to Grid sites and local scheduling at the sites. We propose and analyze an adaptive job allocation scheme named admissible allocation. The main idea of this scheme is to set job allocation constraints, and dynamically adapt them to cope with different workloads and Grid properties. We present 3-approximation and 5-competitive algorithms named MLB"a+PS and MCT"a+PS for the case that all jobs fit to the smallest machine, while we derive an approximation factor of 9 and a competitive factor of 11 for the general case. To show practical applicability of our methods, we perform a comprehensive study of the practical performance of the proposed strategies and their derivatives using simulation. To this end, we use real workload traces and corresponding Grid configurations. We analyze nine scheduling strategies that require a different amount of information on three Grid scenarios. We demonstrate that our strategies perform well across ten metrics that reflect both user- and system-specific goals.

[1]  Uwe Schwiegelshohn,et al.  A system-centric metric for the evaluation of online job schedules , 2011, J. Sched..

[2]  Andrei Tchernykh,et al.  Two Level Job-Scheduling Strategies for a Computational Grid , 2005, PPAM.

[3]  Klaus Jansen,et al.  A Fast 5/2-Approximation Algorithm for Hierarchical Scheduling , 2010, Euro-Par.

[4]  E.L. Lawler,et al.  Optimization and Approximation in Deterministic Sequencing and Scheduling: a Survey , 1977 .

[5]  Ladislau Bölöni,et al.  A Comparison of Eleven Static Heuristics for Mapping a Class of Independent Tasks onto Heterogeneous Distributed Computing Systems , 2001, J. Parallel Distributed Comput..

[6]  Hui Li,et al.  A novel multi-objective optimization scheme for grid resource allocation , 2008, MGC '08.

[7]  Dan Tsafrir,et al.  Backfilling Using System-Generated Predictions Rather than User Runtime Estimates , 2007, IEEE Transactions on Parallel and Distributed Systems.

[8]  Ronald L. Graham,et al.  Bounds for Multiprocessor Scheduling with Resource Constraints , 1975, SIAM J. Comput..

[9]  Uwe Schwiegelshohn,et al.  Online scheduling in grids , 2008, 2008 IEEE International Symposium on Parallel and Distributed Processing.

[10]  Dennis Gannon,et al.  Workflows for e-Science, Scientific Workflows for Grids , 2014 .

[11]  Rajkumar Buyya,et al.  A taxonomy and survey on autonomic management of applications in grid computing environments , 2011 .

[12]  Ian T. Foster Globus Toolkit Version 4: Software for Service-Oriented Systems , 2005, NPC.

[13]  Francisco Vilar Brasileiro,et al.  Trading Cycles for Information: Using Replication to Schedule Bag-of-Tasks Applications on Computational Grids , 2003, Euro-Par.

[14]  Helen D. Karatza,et al.  Resource Allocation Strategies in a 2-Level Hierarchical Grid System , 2008, 41st Annual Simulation Symposium (anss-41 2008).

[15]  David Abramson,et al.  Economic models for resource management and scheduling in Grid computing , 2002, Concurr. Comput. Pract. Exp..

[16]  Francine Berman,et al.  A Decoupled Scheduling Approach for the GrADS Program Development Environment , 2002, ACM/IEEE SC 2002 Conference (SC'02).

[17]  Jarek Nabrzyski,et al.  Dynamic grid scheduling with job migration and rescheduling in the GridLab resource management system , 2004, Sci. Program..

[18]  Ramin Yahyapour,et al.  Design and evaluation of job scheduling strategies for grid computing , 2000, GRID.

[19]  Ruay-Shiung Chang,et al.  Improving job scheduling algorithms in a grid environment , 2011, Future Gener. Comput. Syst..

[20]  Uwe Schwiegelshohn,et al.  Job Allocation Strategies with User Run Time Estimates for Online Scheduling in Hierarchical Grids , 2011, Journal of Grid Computing.

[21]  Liana L. Fong,et al.  Grid broker selection strategies using aggregated resource information , 2010, Future Gener. Comput. Syst..

[22]  Liang-Teh Lee,et al.  An Adaptive Task Scheduling System for Grid Computing , 2006, The Sixth IEEE International Conference on Computer and Information Technology (CIT'06).

[23]  Rajkumar Buyya,et al.  A Taxonomy of Workflow Management Systems for Grid Computing , 2005, Proceedings of the 38th Annual Hawaii International Conference on System Sciences.

[24]  Rajkumar Buyya,et al.  Model-based simulation and performance evaluation of grid scheduling strategies , 2009, Future Gener. Comput. Syst..

[25]  Krzysztof Rzadca,et al.  Cooperation in Multi-organization Scheduling , 2009, Euro-Par.

[26]  Arutyun Avetisyan,et al.  Comparison of scheduling heuristics for grid resource broker , 2004, Proceedings of the Fifth Mexican International Conference in Computer Science, 2004. ENC 2004..

[27]  Akshai K. Aggarwal,et al.  An adaptive generalized scheduler for grid applications , 2005, 19th International Symposium on High Performance Computing Systems and Applications (HPCS'05).

[28]  Hong Peng,et al.  Static strategy and dynamic adjustment: An effective method for Grid task scheduling , 2009, Future Gener. Comput. Syst..

[29]  Uwe Schwiegelshohn,et al.  Online Hierarchical Job Scheduling on Grids , 2008 .

[30]  Uwe Schwiegelshohn,et al.  On an on-line scheduling problem for parallel jobs , 2002, Inf. Process. Lett..

[31]  Ilias Kotsireas,et al.  Proceedings, 19th International Symposium on High Performance Computing Systems and Applications, HPCS 2005 : 15-18 May 2005, Guelph, Ontario, Canada , 2005 .

[32]  U. Schwiegelshohn MISTA 2009 An Owner-centric Metric for the Evaluation of Online Job Schedules , 2009 .

[33]  David A. Lifka,et al.  The ANL/IBM SP Scheduling System , 1995, JSSPP.

[34]  Morteza Analoui,et al.  A Novel Process Mapping Strategy in Clustered Environments , 2012, Grid 2012.

[35]  Joseph Naor,et al.  On-Line Load Balancing in a Hierarchical Server Topology , 2002, SIAM J. Comput..

[36]  Uwe Schwiegelshohn,et al.  On-line hierarchical job scheduling on grids with admissible allocation , 2010, J. Sched..