On “Exploiting” Node-Heterogeneous Clusters Optimally

Abstract It is proved that “FIFO” worksharing protocols provide asymptotically optimal solutions to two problems related to sharing large collections of independent tasks in a heterogeneous network of workstations (HNOW) $\mathcal{N}$ . In the $\mathsf{HNOW-Exploitation Problem}$ , one seeks to accomplish as much work as possible on $\mathcal{N}$ during a prespecified fixed period of L time units. In the $\mathsf{HNOW-Rental Problem}$ , one seeks to complete W units of work by “renting” $\mathcal{N}$ for as short a time as necessary. The worksharing protocols we study are crafted within an architectural model that characterizes $\mathcal {N}$ via parameters that measure $\mathcal{N}$ ’s workstations’ computational and communicational powers. All valid protocols are self-scheduling, in the sense that they determine completely both an amount of work to allocate to each of $\mathcal{N}$ ’s workstations and a schedule for all related interworkstation communications. The schedules provide either a value for W given L, or a value for L given W, hence solve both of the motivating problems. A protocol observes a FIFO regimen if it has $\mathcal{N}$ ’s workstations finish their assigned work, and return their results, in the same order in which they are supplied with their workloads. The proven optimality of FIFO protocols resides in the fact that they accomplish at least as much work as any other protocol during all sufficiently long worksharing episodes, and that they complete sufficiently large given collections of tasks at least as fast as any other protocol. Simulation experiments illustrate that the superiority of FIFO protocols is often observed during worksharing episodes of only a few minutes’ duration.