Equilibrage et régulation de charge dans les machines parallèles à mémoire distribuée

Solving the load allocation problem is an important issue for using and operating parallel machines. We start with a state of arts of this problem for distributed memory architectures; we focus on dynamic allocation, more exactly on load balancing for regular load. An originalload balancing strategy based on a generalized prefix calculation is proposed. This strategy is correct, exact and independent on the processors interconnexion network. A load balancing kernel is implemented. We continue our study with an analysis of the execution time of this strategy. The main result is that a Gumbel distribution law modelizes the maximal execution time. Based on this results we infer a decision policy for initiating and running the load balancing process. So the proposed load balancing algorithm is efficient. An application for mechanical process simulation (large-strain deformation and recrystallization) is developed. For this dynamic application we use our load balancing kernel and the initiation and decision policies. In practice the " load balancing algorithm is always correct, stable and efficient.

[1]  Kwan Woo Ryu,et al.  Load Balancing and Routing on the Hypercube and Related Networks , 1992, J. Parallel Distributed Comput..

[2]  Chong-Wei Xu,et al.  A Distributed Drafting Algorithm for Load Balancing , 1985, IEEE Transactions on Software Engineering.

[3]  Shahid H. Bokhari,et al.  A Shortest Tree Algorithm for Optimal Assignments Across Space and Time in a Distributed Processor System , 1981, IEEE Transactions on Software Engineering.

[4]  Stelios C. Orphanoudakis,et al.  Load Balancing Requirements in Parallel Implementations of Image Feature Extraction Tasks , 1993, IEEE Trans. Parallel Distributed Syst..

[5]  Anthony P. Reeves,et al.  Strategies for Dynamic Load Balancing on Highly Parallel Computers , 1993, IEEE Trans. Parallel Distributed Syst..

[6]  Edward D. Lazowska,et al.  The limited performance benefits of migrating active processes for load sharing , 1988, SIGMETRICS '88.

[7]  Ehl Emile Aarts,et al.  Statistical cooling : a general approach to combinatorial optimization problems , 1985 .

[8]  Shantanu Dutt,et al.  Scalable Load Balancing Strategies for Parallel A* Algorithms , 1994, J. Parallel Distributed Comput..

[9]  G. Horton A Multi-Level Diffusion Method for Dynamic Load Balancing , 1993, Parallel Comput..

[10]  C. Murray Woodside,et al.  Fast Allocation of Processes in Distributed and Parallel Systems , 1993, IEEE Trans. Parallel Distributed Syst..

[11]  Thomas L. Casavant,et al.  A Taxonomy of Scheduling in General-Purpose Distributed Computing Systems , 1988, IEEE Trans. Software Eng..

[12]  Myunghwan Kim,et al.  Optimal Task Assignment in Linear Array Networks , 1992, IEEE Trans. Computers.

[13]  Shahid H. Bokhari,et al.  On the Mapping Problem , 1981, IEEE Transactions on Computers.

[14]  J. Hüsler,et al.  Laws of Small Numbers: Extremes and Rare Events , 1994 .

[15]  Zhen Liu,et al.  Effectiveness of Heuristics and Simulated Annealing for the Scheduling of Concurrent Tasks - An Empirical Comparison , 1993, PARLE.

[16]  Shahid H. Bokhari,et al.  Partitioning Problems in Parallel, Pipelined, and Distributed Computing , 1988, IEEE Trans. Computers.

[17]  Arif Ghafoor,et al.  On the Assignment Problem of Arbitrary Process Systems to Heterogeneous Distributed Computer Systems , 1992, IEEE Trans. Computers.

[18]  Mukesh Singhal,et al.  Load distributing for locally distributed systems , 1992, Computer.

[19]  Anoop Gupta,et al.  Modeling communication in parallel algorithms: a fruitful interaction between theory and systems? , 1994, SPAA '94.

[20]  Shahid H. Bokhari,et al.  Dual Processor Scheduling with Dynamic Reassignment , 1979, IEEE Transactions on Software Engineering.

[21]  Anna Hác Load balancing in distributed systems: a summary , 1989, PERV.

[22]  David J. Evans,et al.  A Parallel Simulation Model for Load Balancing in Clustered Distributed Systems , 1994, Parallel Comput..

[23]  Lars Lundberg,et al.  Optimal Scheduling Results for Parallel Computing , 1996, Applications on Advanced Architecture Computers.

[24]  El-Ghazali Talbi,et al.  Méthodes de placement statique des processus sur architectures parallèles , 1991 .

[25]  James B. Sinclair,et al.  Efficient Computation of Optimal Assignments for Distributed Tasks , 1987, J. Parallel Distributed Comput..

[26]  Theodore Johnson,et al.  Sensitivity Study of the Load Balancing Algorithm in a Distributed System , 1990, J. Parallel Distributed Comput..

[27]  Tomàs Margalef,et al.  A distributed diffusion method for dynamic load balancing on parallel computers , 1995, Proceedings Euromicro Workshop on Parallel and Distributed Processing.

[28]  Jean Roman,et al.  SCOTCH: A Software Package for Static Mapping by Dual Recursive Bipartitioning of Process and Architecture Graphs , 1996, HPCN Europe.

[29]  Ed Zaluska,et al.  Parallel Load-Balancing: An Extension to the Gradient Model , 1995, Parallel Comput..

[30]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[31]  Harold S. Stone,et al.  Multiprocessor Scheduling with the Aid of Network Flow Algorithms , 1977, IEEE Transactions on Software Engineering.

[32]  C. Ribeiro,et al.  A Tabu Search Approach to Task Scheduling on Heterogeneous Processors under Precedence Constraints , 1995, Int. J. High Speed Comput..

[33]  Z. C.,et al.  Analysis of The Generalized Dimension Exchange Method forDynamic Load Balancing , 1992 .

[34]  B. J. Lageweg,et al.  Multiprocessor scheduling with communication delays , 1990, Parallel Comput..

[35]  Eli Upfal,et al.  A Probabilistic Approach to the Load-Sharing Problem in Distributed Systems , 1987, J. Parallel Distributed Comput..

[36]  Shahid H. Bokhari,et al.  A Partitioning Strategy for Nonuniform Problems on Multiprocessors , 1987, IEEE Transactions on Computers.

[37]  Gregory Allen Kohring Dynamic Load Balancing for Parallelized Particle Simulations on MIMD Computers , 1995, Parallel Comput..

[38]  Larry D. Wittie,et al.  Wave Scheduling - Decentralized Scheduling of Task Forces in Multicomputers , 1984, IEEE Trans. Computers.

[39]  Jacques E. Boillat,et al.  Load Balancing and Poisson Equation in a Graph , 1990, Concurr. Pract. Exp..

[40]  Leïla Baccouche,et al.  Un mécanisme d'ordonnancement distribué de tâches temps réel , 1995 .

[41]  Günter Rudolph,et al.  Convergence analysis of canonical genetic algorithms , 1994, IEEE Trans. Neural Networks.

[42]  Jeffrey S. Rosenthal,et al.  Convergence Rates for Markov Chains , 1995, SIAM Rev..

[43]  Asser N. Tantawi,et al.  Optimal static load balancing in distributed computer systems , 1985, JACM.

[44]  M. Braga,et al.  Exploratory Data Analysis , 2018, Encyclopedia of Social Network Analysis and Mining. 2nd Ed..

[45]  Nadia Tawbi Parallelisation automatique : estimation des durees d'execution et allocation statique de processeurs , 1991 .

[46]  Guy Bernard,et al.  Placement et migration de processus dans les systèmes répartis faiblement couplés , 1991 .

[47]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[48]  A. E. Eiben,et al.  Global Convergence of Genetic Algorithms: A Markov Chain Analysis , 1990, PPSN.

[49]  Edward D. Lazowska,et al.  Adaptive load sharing in homogeneous distributed systems , 1986, IEEE Transactions on Software Engineering.