A Reasonable Approach for Defining Load Index in Parallel Computing

Load balancing plays a key role in workload scheduling policies which count in the performance improvement of parallel applications. A critical problem of load balancing is to make a reasonable definition of load index. Unfortunately, few studies provided enough scientific justifications for the choice of load indices. In this paper, a reasonable approach for defining a load index based on factor analysis theory is introduced, which is helpful to reasonable designs of workload scheduling algorithms. An example testing on an accounting log of the CM-5 parallel machine is presented to show the usage of this method.

[1]  Edward D. Lazowska,et al.  Adaptive load sharing in homogeneous distributed systems , 1986, IEEE Transactions on Software Engineering.

[2]  Margaret A. Nemeth,et al.  Applied Multivariate Methods for Data Analysis , 1998, Technometrics.

[3]  Cyril Fonlupt,et al.  Data-Parallel Load Balancing Strategies , 1998, Parallel Comput..

[4]  Mark A. Franklin,et al.  A General Matrix Iterative Model for Dynamic Load Balancing , 1996, Parallel Comput..

[5]  Robert M. Keller,et al.  The Gradient Model Load Balancing Method , 1987, IEEE Transactions on Software Engineering.

[6]  Rafael Alonso.  Query Optimization in Distributed Databases through Load Balancing. , 1987 .

[7]  Dror G. Feitelson,et al.  Memory Usage in the LANL CM-5 Workload , 1997, JSSPP.

[8]  Walter H. Kohler,et al.  Models for Dynamic Load Balancing in a Heterogeneous Multiple Processor System , 1979, IEEE Transactions on Computers.

[9]  Francis C. M. Lau,et al.  Load balancing in parallel computers - theory and practice , 1996, The Kluwer international series in engineering and computer science.

[10]  Thomas Kunz,et al.  The Influence of Different Workload Descriptions on a Heuristic Load Balancing Scheme , 1991, IEEE Trans. Software Eng..

[11]  Edward D. Lazowska,et al.  A Comparison of Receiver-Initiated and Sender-Initiated Adaptive Load Sharing , 1986, Perform. Evaluation.

[12]  Domenico Ferrari,et al.  An Empirical Investigation of Load Indices for Load Balancing Applications , 1987, Performance.

[13]  Kai Hwang,et al.  A Unix-Based Local Computer Network with Load Balancing , 1982, Computer.

[14]  Ahmed K. Ezzat,et al.  Load Balancing in NEST: A Network of Workstations , 1986, FJCC.

[15]  Benjamin W. Wah,et al.  Automated Learning of Workload Measures for Load Balancing on a Distributed System , 1993, 1993 International Conference on Parallel Processing - ICPP'93.

[16]  Edward D. Lazowska,et al.  Dynamic load sharing in homogenous distributed systems , 1985 .

[17]  Kalinka Lucas Jaquie Castelo Regina,et al.  Load Indices - Past, Present and Future , 2006 .