Measuring the scalability of parallel computer systems

This paper discusses scalability and outlines a specific approach to measuring the scalability of parallel computer systems. The relationship between scalability and speedup is described. It is shown that a parallel system is scalable for a given algorithm if and only if its speedup is unbounded. A technique is proposed that can be used to help determine whether a candidate model is correct, that is, whether it adequately approximates the system's scalability. Experimental results illustrate this technique for both a poorly scalable and a very scalable system.

[1]  Dietrich Stauffer,et al.  A Simple Introduction to Monte Carlo Simulation and Some Specialized Topics (With 6 Figures) , 1984 .

[2]  W. Daniel Hillis,et al.  The connection machine , 1985 .

[3]  Timothy S. Axelrod,et al.  Effects of synchronization barriers on multiprocessor performance , 1986, Parallel Comput..

[4]  Charles M. Rader,et al.  Fast transforms: Algorithms, analyses, applications , 1984 .

[5]  Constantine D. Polychronopoulos,et al.  Processor Allocation for Horizontal and Vertical Parallelism and Related Speedup Bounds , 1987, IEEE Transactions on Computers.

[6]  Zarka Cvetanovic,et al.  The Effects of Problem Partitioning, Allocation, and Granularity on the Performance of Multiple-Processor Systems , 1987, IEEE Transactions on Computers.

[7]  Michael J. Quinn,et al.  Designing Efficient Algorithms for Parallel Computers , 1987 .

[8]  Monica Beltrametti,et al.  The control mechanism for the Myrias parallel computer system , 1988, CARN.

[9]  N. Ahmed,et al.  FAST TRANSFORMS, algorithms, analysis, applications , 1983, Proceedings of the IEEE.

[10]  Peter C. Patton.  Multiprocessors: Architecture and Applications , 1985, Computer.

[11]  Roy M. Jenevein,et al.  Scaleability of a Binary Tree on a Hypercube , 1986, ICPP.

[12]  Edward F. Gehringer,et al.  Superlinear Speedup Through Randomized Algorithms , 1985, International Conference on Parallel Processing.

[13]  Robert E. Benner,et al.  Development of Parallel Methods for a $1024$-Processor Hypercube , 1988 .