Scalable Load Balancing by Diffusion

Abstract : High performance computing is in a transition between vector supercomputing and scalable multicomputing. The software strategies which are effective under these two paradigms are different. Scalable milticomputers require scalable algorithms. These are algorithms whose elapsed time complexities do not grow "unreasonably fast" as the problem size scales with the computer system.

[1]  Graham Horton,et al.  Multicomputer-Multigrid Solution of Parabolic Partial Differential Equations , 1994 .

[2]  John L. Gustafson,et al.  Reevaluating Amdahl's law , 1988, CACM.

[3]  Richard M. Karp,et al.  Reducibility Among Combinatorial Problems , 1972, 50 Years of Integer Programming.

[4]  Anna Hác.  Load balancing in distributed systems: a summary , 1989, PERV.

[5]  Larry D. Wittie,et al.  Wave Scheduling - Decentralized Scheduling of Task Forces in Multicomputers , 1984, IEEE Trans. Computers.

[6]  Jacques E. Boillat,et al.  Load Balancing and Poisson Equation in a Graph , 1990, Concurr. Pract. Exp..

[7]  Kemal Efe,et al.  Heuristic Models of Task Assignment Scheduling in Distributed Systems , 1982, Computer.

[8]  Stephen Taylor,et al.  A concurrent Navier-Stokes solver for implicit multibody calculations , 1995 .

[9]  Edward D. Lazowska,et al.  Adaptive load sharing in homogeneous distributed systems , 1986, IEEE Transactions on Software Engineering.

[10]  William J. Dally,et al.  Processor coupling: integrating compile time and runtime scheduling for parallelism , 1992, ISCA '92.

[11]  Charles L. Seitz,et al.  Mosaic C: An Experimental Fine-Grain Multicomputer , 1992, 25th Anniversary of INRIA.

[12]  Amnon Barak,et al.  A distributed load‐balancing policy for a multicomputer , 1985, Softw. Pract. Exp..

[13]  Robert M. Keller,et al.  The Gradient Model Load Balancing Method , 1987, IEEE Transactions on Software Engineering.

[14]  Dan C. Marinescu,et al.  Synchronization and load imbalance effects in distributed memory multi-processor systems , 1991, Concurr. Pract. Exp..

[15]  John N. Tsitsiklis,et al.  Parallel and distributed computation , 1989 .

[16]  H. Peter Hofstee,et al.  A Distributed Implementation of a Task Pool , 1991, Research Directions in High-Level Parallel Programming Languages.

[17]  Alex Pothen,et al.  PARTITIONING SPARSE MATRICES WITH EIGENVECTORS OF GRAPHS* , 1990 .

[18]  Z. C.,et al.  Analysis of The Generalized Dimension Exchange Method forDynamic Load Balancing , 1992 .

[19]  G. Amdhal,et al.  Validity of the single processor approach to achieving large scale computing capabilities , 1967, AFIPS '67 (Spring).

[20]  Walter H. Kohler,et al.  Models for Dynamic Load Balancing in a Heterogeneous Multiple Processor System , 1979, IEEE Transactions on Computers.

[21]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[22]  Reinhard von Hanxleden,et al.  Load Balancing on Message Passing Architectures , 1991, J. Parallel Distributed Comput..

[23]  S. L. Fornili,et al.  A distributed dynamic load balancer and its implementation on multi-transputer systems for molecular dynamics simulation , 1990 .

[24]  Joel H. Saltz,et al.  Dynamic Remapping of Parallel Computations with Varying Resource Demands , 1988, IEEE Trans. Computers.

[25]  Chong-Wei Xu,et al.  A Distributed Drafting Algorithm for Load Balancing , 1985, IEEE Transactions on Software Engineering.

[26]  Vipin Kumar,et al.  Scalable Load Balancing Techniques for Parallel Computers , 1994, J. Parallel Distributed Comput..

[27]  Michael D. Noakes,et al.  System design of the J-Machine , 1990 .

[28]  Charles L. Seitz,et al.  Multicomputers: message-passing concurrent computers , 1988, Computer.

[29]  Scott B. Baden,et al.  Programming Abstractions for Dynamically Partitioning and Coordinating Localized Scientific Calculations Running on Multiprocessors , 1991, SIAM J. Sci. Comput..

[30]  M. Chen,et al.  From Local to Global: An Analysis of Nearest Neighbor Balancing on Hypercubes , 1988, SIGMETRICS.

[31]  Shahid H. Bokhari,et al.  On the Mapping Problem , 1981, IEEE Transactions on Computers.

[32]  Vipin Kumar,et al.  Performance Properties of Large Scale Parallel Systems , 1993, J. Parallel Distributed Comput..

[33]  Andrew J. Conley.  Using a Transfer Function to Describe the Load-Balancing Problem , 1993 .

[34]  Roy D. Williams,et al.  Performance of dynamic load balancing algorithms for unstructured mesh calculations , 1991, Concurr. Pract. Exp..

[35]  Donald F. Towsley,et al.  Adaptive Load Sharing in Heterogeneous Distributed Systems , 1990, J. Parallel Distributed Comput..