Complexity Analysis of Load Balance Problem for Synchronous Iterative Applications

Load balance technologies for tightly coupled applications on the large scale heterogeneous cluster systems are paid more and more attentions nowadays with the emergence of the Meta computing and Grid computing environment. Focusing on a class of representative tightly coupled applications, synchronous iterative applications, we formulate their load balance problem into a combination optimization problem. Meanwhile, we establish a complexity result that accesses the difficulty of the problem. The theory analysis result will do great help for the design of approximate algorithms.

[1]  Yves Robert,et al.  Algorithmic Issues on Heterogeneous Computing Platforms , 1999, Parallel Process. Lett..

[2]  Sathish S. Vadhiyar,et al.  A metascheduler for the Grid , 2002, Proceedings 11th IEEE International Symposium on High Performance Distributed Computing.

[3]  Chung-Ming Chen,et al.  On Parallelizing the EM Algorithm for PET Image Reconstruction , 1994, IEEE Trans. Parallel Distributed Syst..

[4]  M.F. Adams,et al.  A Distributed Memory Unstructured Gauss-Seidel Algorithm for Multigrid Smoothers , 2001, ACM/IEEE SC 2001 Conference (SC'01).

[5]  C.-H. Wei,et al.  Sequential decoding of convolutional codes by a compressed multiple queue algorithm , 1994 .

[6]  Edward Walker,et al.  Pipeline ring data-flow architecture for solving large iterative structures , 1994 .

[7]  Jon B. Weissman,et al.  Metascheduling: a scheduling model for metacomputing systems , 1998, Proceedings. The Seventh International Symposium on High Performance Distributed Computing (Cat. No.98TB100244).

[8]  Yves Robert,et al.  Load-Balancing Iterative Computations on Heterogeneous Clusters with Shared Communication Links , 2003, PPAM.

[9]  Laurence T. Yang,et al.  Data distribution and communication schemes for IQMR method on massively distributed memory computers , 2000, Proceedings 2000. International Workshop on Parallel Processing.

[10]  Yves Robert,et al.  Algorithmic Issues for (Distributed) Hetergeneous Computing Platforms , 1999, PDPTA.

[11]  Hélène Renard,et al.  Static Load-Balancing Techniques for Iterative Computation on Heterogeneous Clusters , 2003, Euro-Par.

[12]  Geoffrey C. Fox,et al.  Parallel Computing Works , 1994 .

[13]  Luděk Matyska,et al.  Metacomputing. New direction in high performance computing , 1997, Information Technology Applications in Biomedicine. ITAB '97. Proceedings of the IEEE Engineering in Medicine and Biology Society Region 8 International Conference.

[14]  Jean-Pierre Prost,et al.  Synchronization and Load Unbalance Effects of Parallel Iterative Algorithms , 1989, ICPP.

[15]  Ian Foster,et al.  The Grid 2 - Blueprint for a New Computing Infrastructure, Second Edition , 1998, The Grid 2, 2nd Edition.

[16]  Michael Allen,et al.  Parallel programming: techniques and applications using networked workstations and parallel computers , 1998 .

[17]  Michel Dubois,et al.  Performance of Synchronized Iterative Processes in Multiprocessor Systems , 1982, IEEE Transactions on Software Engineering.

[18]  Alan Weiss,et al.  Allocating Independent Subtasks on Parallel Processors , 1985, IEEE Transactions on Software Engineering.