ADAPTIVE LOAD SHARING IN HETERGENEOUS SYSTEMS: POLICIES, MODIFICATIONS, AND SIMULATION

Distributed computing systems offer the potential for improved performance and resource sharing. In a real-time system, uncontrolled task arrivals may temporarily overload some nodes while leaving other nodes idle. Adaptive load sharing offers techniques for queue control in order to achieve optimal or near-optimal efficiency and performance. This paper discusses several adaptive load sharing algorithms for heterogeneous distributed computing systems, proposes some modifications to existing algorithms that will account for the delay in transferring tasks from one node to another, and verifies and validates those proposed changes with some of the simulation results obtained.

[1]  Robert M. Keller,et al.  Gradient Model: A Demand-Driven Load Balancing Scheme , 1986, ICDCS.

[2]  Jeffrey J. P. Tsai,et al.  Distributed Real-Time Systems , 1996 .

[3]  Stella Sofianopoulou,et al.  The Process Allocation Problem: a Survey of the Application of Graph-Theoretic and Integer Programming Approaches , 1992 .

[4]  Virginia Mary Lo,et al.  Heuristic Algorithms for Task Assignment in Distributed Systems , 1988, IEEE Trans. Computers.

[5]  Kang G. Shin,et al.  A Coordinated Location Policy for Load Sharing in Hypercube-Connected Multicomputers , 1995, IEEE Trans. Computers.

[6]  Donald F. Towsley,et al.  Analysis of the Effects of Delays on Load Sharing , 1989, IEEE Trans. Computers.

[7]  Edward D. Lazowska,et al.  Adaptive load sharing in homogeneous distributed systems , 1986, IEEE Transactions on Software Engineering.

[8]  Francis C. M. Lau,et al.  Load balancing in parallel computers - theory and practice , 1996, The Kluwer international series in engineering and computer science.

[9]  Jeff Kramer,et al.  Methodical Analysis of Adaptive Load Sharing Algorithms , 1992, IEEE Trans. Parallel Distributed Syst..

[10]  Martin Berzins,et al.  A comparison of some dynamic load-balancing algorithms for a parallel adaptive flow solver , 2000, Parallel Comput..

[11]  Anna Hác,et al.  Dynamic Load Balancing in a Distributed System Using a Sender-Initiated Algorithm , 1987, SIGMETRICS Perform. Evaluation Rev..

[12]  Kemal Efe,et al.  Heuristic Models of Task Assignment Scheduling in Distributed Systems , 1982, Computer.

[13]  Kang G. Shin,et al.  Evaluation of Load Sharing in HARTS with Consideration of Its Communication Activities , 1996, IEEE Trans. Parallel Distributed Syst..

[14]  Domenico Ferrari,et al.  A Measurement Study of Load Balancing Performance , 1987, IEEE International Conference on Distributed Computing Systems.

[15]  Dieter K. Hammer,et al.  Distributed Real-Time Systems , 1995 .

[16]  Kang G. Shin,et al.  Load sharing with consideration of future task arrivals in heterogeneous distributed real-time systems , 1991, [1991] Proceedings Twelfth Real-Time Systems Symposium.

[17]  Benjamin W. Wah,et al.  Computer scheduling algorithms: Past, present and future , 1991, Inf. Sci..

[18]  Scott Shenker,et al.  The Optimal Control of Heterogeneous Queueing Systems: A Paradigm for Load-Sharing and Routing , 1989, IEEE Trans. Computers.

[19]  H. G. Rotithor.  Taxonomy of dynamic task scheduling schemes in distributed computing systems , 1994 .

[20]  Samuel T. Chanson,et al.  Improved Strategies for Dynamic Load Balancing , 1999, IEEE Concurr..

[21]  A. J. Harget,et al.  Load balancing algorithms in loosely-coupled distributed systems: a survey , 1990 .

[22]  Sajal K. Das,et al.  Adaptive Load-Balancing Algorithms Using Symmetric Broadcast Networks , 2002, J. Parallel Distributed Comput..

[23]  James Aweya,et al.  An adaptive load balancing scheme for web servers , 2002, Int. J. Netw. Manag..

[24]  Thomas L. Casavant,et al.  A Taxonomy of Scheduling in General-Purpose Distributed Computing Systems , 1988, IEEE Trans. Software Eng..

[25]  Phillip Krueger,et al.  A comparison of preemptive and non-preemptive load distributing , 1988, [1988] Proceedings. The 8th International Conference on Distributed.

[26]  Jian Xu,et al.  Heuristic methods for dynamic load balancing in a message-passing supercomputer , 1990, Supercomputing '90.

[27]  Helen D. Karatza.  Job scheduling in heterogeneous distributed systems , 2001, J. Syst. Softw..

[28]  Yeh-Ching Chung,et al.  Tree-Based Parallel Load-Balancing Methods for Solution-Adaptive Finite Element Graphs on Distributed Memory Multicomputers , 1999, IEEE Trans. Parallel Distributed Syst..

[29]  Cauligi S. Raghavendra,et al.  A Dynamic Load-Balancing Policy With a Central Job Dispatcher (LBC) , 1992, IEEE Trans. Software Eng..

[30]  Kang G. Shin,et al.  Analytic Models of Adaptive Load Sharing Schemes in Distributed Real-Time Systems , 1993, IEEE Trans. Parallel Distributed Syst..

[31]  Y. F. Hu,et al.  An improved diffusion algorithm for dynamic load balancing , 1999, Parallel Comput..

[32]  Donald F. Towsley,et al.  A comparison of sender-initiated and receiver-initiated reliable multicast protocols , 1994, IEEE J. Sel. Areas Commun..

[33]  Philip S. Yu,et al.  An Adaptive Strategy for Load Sharing in Distributed Database Environment with Information Lags , 1991, J. Parallel Distributed Comput..

[34]  Lois M. L. Delcambre,et al.  Load balancing with network cooperation , 1991, [1991] Proceedings. 11th International Conference on Distributed Computing Systems.

[35]  Franco Zambonelli,et al.  Diffusive load-balancing policies for dynamic applications , 1999, IEEE Concurr..

[36]  S. Zhou,et al.  A Trace-Driven Simulation Study of Dynamic Load Balancing , 1987, IEEE Trans. Software Eng..

[37]  A. Weinrib,et al.  Greed is not enough: adaptive load sharing in large heterogeneous systems , 1988, IEEE INFOCOM '88,Seventh Annual Joint Conference of the IEEE Computer and Communcations Societies. Networks: Evolution or Revolution?.

[38]  Shahid H. Bokhari,et al.  On the Mapping Problem , 1981, IEEE Transactions on Computers.