Adaptive Processor Allocation with Estimated Job Execution Time in Heterogeneous Computing Grid

Many parallel computer systems installed in computing centers worldwide, which adopts backfilling based job scheduling policies, require that users should provide estimated job execution time when submitting a job to the system. This paper presents an approach, taking advantage of the estimated job execution time, to effectively allocating processors to jobs submitted to a heterogeneous computing grid. The proposed adaptive processor allocation approach was evaluated with simulation studies under various workload and processor speed conditions. The results indicate that the adaptive processor allocation approach can effectively improve the overall system performance, in terms of jobs’ average turnaround time, from two to four times under different conditions, compared to currently used methods.

[1]  Dror G. Feitelson,et al.  Utilization, Predictability, Workloads, and User Runtime Estimates in Scheduling the IBM SP2 with Backfilling , 2001, IEEE Trans. Parallel Distributed Syst..

[2]  Achim Streit,et al.  Enhanced Algorithms for Multi-site Scheduling , 2002, GRID.

[3]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[4]  Kuo-Chan Huang,et al.  An Integrated Processor Allocation and Job Scheduling Approach to Workload Management on Computing Grid , 2006, PDPTA.

[5]  Honbo Zhou,et al.  The EASY - LoadLeveler API Project , 1996, JSSPP.

[6]  Lionel M. Ni,et al.  Contention-Free 2D-Mesh Cluster Allocation in Hypercubes , 1995, IEEE Trans. Computers.

[7]  Ami Marowka,et al.  The GRID: Blueprint for a New Computing Infrastructure , 2000, Parallel Distributed Comput. Pract..

[8]  Dhiraj K. Pradhan,et al.  Processor Allocation in Hypercube Multicomputers: Fast and Efficient Strategies for Cubic and Noncubic Allocation , 1995, IEEE Trans. Parallel Distributed Syst..

[9]  Kuo-Chan Huang,et al.  Towards Feasible and Effective Load Sharing in a Heterogeneous Computational Grid , 2007, GPC.

[10]  Kyung-Yong Chwa,et al.  An Algorithm for Scheduling Jobs in Hypercube Systems , 1998, IEEE Trans. Parallel Distributed Syst..

[11]  Jong Kim,et al.  Real-time job scheduling in hypercube systems , 1997, Proceedings of the 1997 International Conference on Parallel Processing (Cat. No.97TB100162).

[12]  Larry Rudolph,et al.  Parallel Job Scheduling: Issues and Approaches , 1995, JSSPP.

[13]  Uwe Schwiegelshohn,et al.  Theory and Practice in Parallel Job Scheduling , 1997, JSSPP.

[14]  David A. Lifka,et al.  The ANL/IBM SP Scheduling System , 1995, JSSPP.

[15]  Ramin Yahyapour,et al.  Benefits of global grid computing for job scheduling , 2004, Fifth IEEE/ACM International Workshop on Grid Computing.