Scheduling real-time fork-join structures in cluster computing

Scheduling a large number of high performance computing applications on cluster computing environment is a complex task especially in real-time systems. Efficient scheduling strategies are critically important for achieving a good performance. A cluster scheduler should adequately manage the cluster resources. In this paper, we present an algorithm for scheduling real-time applications represented as parallel task graphs on a cluster. We utilise the available processing power on each processor to maximise the degree of parallelism while satisfying the required tasks' deadlines. The algorithm reduces the communication cost among tasks and the possibility of processing power fragmentation.

[1]  Daniel Mossé,et al.  Real-time scheduling using compact task graphs , 1996, Proceedings of 16th International Conference on Distributed Computing Systems.

[2]  Reda A. Ammar,et al.  A Model to Predict the Average Response Time of User Programs , 1989, Perform. Evaluation.

[3]  Vivek Sarkar,et al.  Partitioning and Scheduling Parallel Programs for Multiprocessing , 1989 .

[4]  Taylor L. Booth,et al.  Software performance modeling using computation structures , 1975, IEEE Transactions on Software Engineering.

[5]  Michael B. Jones,et al.  CPU reservations and time constraints: efficient, predictable scheduling of independent activities , 1997, SOSP.

[6]  Francine Berman,et al.  Heuristics for scheduling parameter sweep applications in grid environments , 2000, Proceedings 9th Heterogeneous Computing Workshop (HCW 2000) (Cat. No.PR00556).

[7]  Jörn Gehring,et al.  Scheduling a Metacomputer with Uncooperative Sub-schedulers , 1999, JSSPP.

[8]  Reda A. Ammar,et al.  Hierarchical performance modeling for distributed system architectures , 2000, Proceedings ISCC 2000. Fifth IEEE Symposium on Computers and Communications.

[9]  Krithi Ramamritham,et al.  Distributed Scheduling of Tasks with Deadlines and Resource Requirements , 1989, IEEE Trans. Computers.

[10]  Larry Rudolph,et al.  Gang Scheduling Performance Benefits for Fine-Grain Synchronization , 1992, J. Parallel Distributed Comput..

[11]  Pattie Maes,et al.  Challenger: a multi-agent system for distributed resource allocation , 1997, AGENTS '97.

[12]  Hesham H. Ali,et al.  Task scheduling in parallel and distributed systems , 1994, Prentice Hall series in innovative technology.

[13]  F. Berman,et al.  Adaptive Performance Prediction for Distributed Data-Intensive Applications , 1999, ACM/IEEE SC 1999 Conference (SC'99).

[14]  Francine Berman,et al.  Application-Level Scheduling on Distributed Heterogeneous Networks , 1996, Proceedings of the 1996 ACM/IEEE Conference on Supercomputing.

[15]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[16]  Ramin Yahyapour,et al.  Design and evaluation of job scheduling strategies for grid computing , 2000, GRID.

[17]  Uwe Schwiegelshohn,et al.  Theory and Practice in Parallel Job Scheduling , 1997, JSSPP.

[18]  Warren Smith,et al.  Predicting Application Run Times Using Historical Information , 1998, JSSPP.

[19]  Vivek Sarkar,et al.  Partitioning and scheduling parallel programs for execution on multiprocessors , 1987 .

[20]  Tao Yang,et al.  DSC: Scheduling Parallel Tasks on an Unbounded Number of Processors , 1994, IEEE Trans. Parallel Distributed Syst..

[21]  Michael B. Jones,et al.  Two case studies in predictable application scheduling using Rialto/NT , 2001, Proceedings Seventh IEEE Real-Time Technology and Applications Symposium.

[22]  Boontee Kruatrachue,et al.  Static task scheduling and grain packing in parallel processing systems , 1987 .

[23]  Michael B. Jones,et al.  Predictable Scheduling for Digital Audio , 2000 .

[24]  Edward D. Lazowska,et al.  A Comparison of Receiver-Initiated and Sender-Initiated Adaptive Load Sharing , 1986, Perform. Evaluation.

[25]  Debra A. Hensgen,et al.  Why the mean is inadequate for accurate scheduling decisions , 1999, Proceedings Fourth International Symposium on Parallel Architectures, Algorithms, and Networks (I-SPAN'99).

[26]  J.M. Schopf,et al.  Stochastic Scheduling , 1999, ACM/IEEE SC 1999 Conference (SC'99).