A Simulation Study of Two Distributed Task Allocation Procedures

The authors concentrate on the simulation study of two distributed task allocation procedures: the load balancing and the LOCO procedure. The first is widely used in general-purpose processing. The second was recently introduced and analyzed in the processing environment corresponding to the complex multitask jobs typical of some supercomputing and artificial-intelligence-oriented systems. Both procedures are simulated and compared in realistic situations, where both processing resources and interconnection network may represent the system bottleneck. Both were tested using carrier-sense multiple-access communications protocols. The CSMA/CD protocol performed better than TDMA with load balancing, but no difference was found with the LOCO procedure. For a large number of special-purpose processing resources and a large number of jobs in the system, LOCO produced better results than load balancing. >

[1]  Benjamin W. Wah,et al.  MANIP—A Multicomputer Architecture for Solving Combinatonal Extremum-Search Problems , 1984, IEEE Transactions on Computers.

[2]  Kenneth E. Batcher,et al.  Design of a Massively Parallel Processor , 1980, IEEE Transactions on Computers.

[3]  Hisashi Kobayashi,et al.  Modeling and analysis , 1978 .

[4]  Howard Jay Siegel,et al.  PASM: A Partitionable SIMD/MIMD System for Image Processing and Pattern Recognition , 1981, IEEE Transactions on Computers.

[5]  Jacob A. Abraham,et al.  Load Balancing in Distributed Systems , 1982, IEEE Transactions on Software Engineering.

[6]  Veljko M. Milutinovic,et al.  The Loco Approach to Distributed Task Allocation in AIDA by VERDI , 1985, ICDCS.

[7]  Yung-Terng Wang,et al.  Load Sharing in Distributed Systems , 1985, IEEE Transactions on Computers.

[8]  Howard Jay Siegel.  The Theory Underlying the Partitioning of Permutation Networks , 1980, IEEE Transactions on Computers.

[9]  Philip H. Enslow.  What is a "Distributed" Data Processing System? , 1978, Computer.

[10]  Kai Hwang,et al.  A Unix-Based Local Computer Network with Load Balancing , 1982, Computer.

[11]  Michael J. Flynn,et al.  Some Computer Organizations and Their Effectiveness , 1972, IEEE Transactions on Computers.

[12]  Benjamin W. Wah.  A Comparative Study of Distributed Resource Sharing on Multiprocessors , 1984, IEEE Trans. Computers.

[13]  Ralph Grishman,et al.  The NYU Ultracomputer—Designing an MIMD Shared Memory Parallel Computer , 1983, IEEE Transactions on Computers.

[14]  Salvatore J. Stolfo,et al.  DADO: A Tree-Structured Machine Architecture for Production Systems , 1982, AAAI.

[15]  Walter H. Kohler,et al.  Models for Dynamic Load Balancing in a Heterogeneous Multiple Processor System , 1979, IEEE Transactions on Computers.

[16]  Frederick Hayes-Roth,et al.  Building expert systems , 1983, Advanced book program.

[17]  Krithi Ramamritham,et al.  A review of current research and critical issues in distributed system software , 1987 .