Effective load balancing on highly parallel multicomputers based on superconcentrators

Tree and mesh architectures have been considered as two of the most highly scalable parallel multicomputers due to their scalabilities which are superior to those of hypercubes. However, the load balancing on these two multicomputer systems are not as well as we expected. The worst case of tree architecture requires O(M/spl times/p/spl times/logp) routing time for redistributing the workload over the system and it requires O(M/spl times//spl radic/p) for mesh architecture while pipelined packet routing scheme is used. In this paper, we propose an approach based on superconcentrators to reduce the above bounds to O(Mlogp) for both cases with only additional O(p) cost. Furthermore, by using this scheme, the underlying systems can leave the load balancing problem entirely to the superconcentrator so that there does not arise any additional workload of the systems. In addition, this scheme also adds extra communicating paths to the processors so that it not only increases the communication capacity among the processors but also could tolerate edge faults of the systems.

[1]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[2]  Robert M. Keller,et al.  The Gradient Model Load Balancing Method , 1987, IEEE Transactions on Software Engineering.

[3]  Donald F. Towsley,et al.  Analysis of the Effects of Delays on Load Sharing , 1989, IEEE Trans. Computers.

[4]  Shahid H. Bokhari,et al.  A Network Flow Model for Load Balancing in Circuit-Switched Multicomputers , 1993, IEEE Trans. Parallel Distributed Syst..

[5]  Stelios C. Orphanoudakis,et al.  Load Balancing Requirements in Parallel Implementations of Image Feature Extraction Tasks , 1993, IEEE Trans. Parallel Distributed Syst..

[6]  Kang G. Shin,et al.  Load Sharing in Distributed Real-Time Systems with State-Change Broadcasts , 1989, IEEE Trans. Computers.

[7]  Anthony P. Reeves,et al.  Strategies for Dynamic Load Balancing on Highly Parallel Computers , 1993, IEEE Trans. Parallel Distributed Syst..

[8]  Joel H. Saltz,et al.  Dynamic Remapping of Parallel Computations with Varying Resource Demands , 1988, IEEE Trans. Computers.

[9]  Eli Upfal,et al.  A Probabilistic Approach to the Load-Sharing Problem in Distributed Systems , 1987, J. Parallel Distributed Comput..

[10]  S. Zhou,et al.  A Trace-Driven Simulation Study of Dynamic Load Balancing , 1987, IEEE Trans. Software Eng..

[11]  Jeff Kramer,et al.  Methodical Analysis of Adaptive Load Sharing Algorithms , 1992, IEEE Trans. Parallel Distributed Syst..

[12]  Gene Eu Jan,et al.  Fast Self-Routing Permutation Switching on an Asymptotically Minimum Cost Network , 1993, IEEE Trans. Computers.