Design and Performance Analysis of Divisible Load Scheduling Strategies on Arbitrary Graphs

In this paper, we consider the problem of scheduling divisible loads on arbitrary graphs with the objective to minimize the total processing time of the entire load submitted for processing. We consider an arbitrary graph network comprising heterogeneous processors interconnected via heterogeneous links in an arbitrary fashion. The divisible load is assumed to originate at any processor in the network. We transform the problem into a multi-level unbalanced tree network and schedule the divisible load. We design systematic procedures to identify and eliminate any redundant processor–link pairs (those pairs whose consideration in scheduling will penalize the performance) and derive an optimal tree structure to obtain an optimal processing time, for a fixed sequence of load distribution. Since the algorithm thrives to determine an equivalent number of processors (resources) that can be used for processing the entire load, we refer to this approach as resource-aware optimal load distribution (RAOLD) algorithm. We extend our study by applying the optimal sequencing theorem proposed for single-level tree networks in the literature for multi-level tree for obtaining an optimal solution. We evaluate the performance for a wide range of arbitrary graphs with varying connectivity probabilities and processor densities. We also study the effect of network scalability and connectivity. We demonstrate the time performance when the point of load origination differs in the network and highlight certain key features that may be useful for algorithm and/or network system designers. We evaluate the time performance with rigorous simulation experiments under different system parameters for the ease of a complete understanding.

[1]  Keqin Li Managing Divisible Load on Partitionable Networks , 1998 .

[2]  Jacek Blazewicz,et al.  Divisible task scheduling - Concept and verification , 1999, Parallel Comput..

[3]  C. Siva Ram Murthy,et al.  Distributed computation for a hypercube network of sensor-driven processors with communication delays including setup time , 1998, IEEE Trans. Syst. Man Cybern. Part A.

[4]  Ophir Frieder,et al.  Parallel computation in biological sequence analysis , 1998 .

[5]  Jacek Blazewicz,et al.  Distributed Processing of Divisible Jobs with Communication Startup Costs , 1997, Discret. Appl. Math..

[6]  Maciej Drozdowski,et al.  Selected problems of scheduling tasks in multiprocessor computer systems , 1997 .

[7]  Bharadwaj Veeravalli,et al.  Efficient Scheduling Strategies for Processing Multiple Divisible Loads on Bus Networks , 2002, J. Parallel Distributed Comput..

[8]  R. K. Shyamasundar,et al.  Introduction to algorithms , 1996 .

[9]  Gerassimos D. Barlas Collection-Aware Optimum Sequencing of Operations and Closed-Form Solutions for the Distribution of a Divisible Load on Arbitrary Processor Trees , 1998, IEEE Trans. Parallel Distributed Syst..

[10]  Moon-Jung Chung,et al.  Linear Recursive Networks and Their Applications in Distributed Systems , 1997, IEEE Trans. Parallel Distributed Syst..

[11]  Bharadwaj Veeravalli,et al.  On the Influence of Start-Up Costs in Scheduling Divisible Loads on Bus Networks , 2000, IEEE Trans. Parallel Distributed Syst..

[12]  Thomas G. Robertazzi,et al.  Distributed computation for a tree network with communication delays , 1990 .

[13]  Zhiwei Xu,et al.  Scalable Parallel Computing: Technology, Architecture, Programming , 1998 .

[14]  Debasish Ghose,et al.  Distributed Computation with Communication Delays: Asymptotic Performance Analysis , 1994, J. Parallel Distributed Comput..

[15]  Dieter Kranzlmüller Scheduling and load balancing , 2003 .

[16]  Thomas G. Robertazzi,et al.  Distributed computation with communication delay (distributed intelligent sensor networks) , 1988 .

[17]  V Bharadwaj,et al.  Scheduling divisible loads in bus networks with arbitrary processor release times , 1996 .

[18]  Pawel Wolniewicz,et al.  Experiments with Scheduling Divisible Tasks in Clusters of Workstations , 2000, Euro-Par.

[19]  Debasish Ghose,et al.  Scheduling Divisible Loads in Parallel and Distributed Systems , 1996 .

[20]  Bharadwaj Veeravalli,et al.  Theoretical and experimental study on large size image processing applications using divisible load paradigm on distributed bus networks , 2002, Image Vis. Comput..

[21]  Debasish Ghose,et al.  Load Partitioning and Trade-Off Study for Large Matrix-Vector Computations in Multicast Bus Networks with Communication Delays , 1998, J. Parallel Distributed Comput..

[22]  Thomas G. Robertazzi,et al.  Scalable Scheduling in Parallel Processors , 2002 .

[23]  Debasish Ghose,et al.  Divisible Load Theory: A New Paradigm for Load Scheduling in Distributed Systems , 2004, Cluster Computing.

[24]  T.G. Robertazzi,et al.  Optimal divisible job load sharing for bus networks , 1996, IEEE Transactions on Aerospace and Electronic Systems.

[25]  Ali R. Hurson,et al.  Scheduling and Load Balancing in Parallel and Distributed Systems , 1995 .

[26]  Jacek Blazewicz,et al.  Scheduling a Divisible Task in a Two-dimensional Toroidal Mesh , 1999, Discret. Appl. Math..

[27]  Pangfeng Liu,et al.  Experiences with parallel N-body simulation , 1994, SPAA '94.

[28]  Bharadwaj Veeravalli,et al.  Access Time Minimization for Distributed Multimedia Applications , 2000, Multimedia Tools and Applications.