Complexity of Task Graph Scheduling with Fixed Communication Capacity

Consider a scheduling problem of parallel computations in multiprocessor systems. Let a parallel program be modeled by a task graph, where vertices represent tasks and arcs the communications between tasks. An interprocessor communication time incurs when two tasks assigned to two different processors have to communicate. Such a scheduling problem has recently been studied in the literature, mostly for the case where interprocessor communication times are fully determined. In this paper, we consider the scheduling problem with communication resource constraints. More specifically, we consider the case where all interprocessor communications take place on a network of bounded capacity. We consider two variants of the problem: communications with independent-data semantics and common-data semantics. We show that even for very specific subproblems, viz. scheduling of general graphs on two processors and scheduling of binary trees on an infinite number of processors, the minimization of the makespan of parallel programs in such a multiprocessor system is strongly -hard. We first establish the results for the case of capacity 1, referred to as the single-bus system. We then extend the results to the more general case of fixed communication capacities. As a consequence, the general scheduling problem of parallel programs with communication resource constraints is strongly -hard. These results are to be contrasted with the corresponding scheduling problems without contraint on the communication capacity, where the two-processor case has unknown time complexity and the infinite-processor case is polynomial. Our results are also extended to the case of broadcasting communications, and can be applied to multiprocessor systems with shared memory.

[1]  George Papageorgiou,et al.  Scheduling Dags to Minimize Time and Communication , 1988, AWOC.

[2]  Jan Karel Lenstra,et al.  The Complexity of Scheduling Trees with Communication Delays , 1996, J. Algorithms.

[3]  B. J. Lageweg,et al.  Multiprocessor scheduling with communication delays , 1990, Parallel Comput..

[4]  Edward A. Lee,et al.  A Compile-Time Scheduling Heuristic for Interconnection-Constrained Heterogeneous Processor Architectures , 1993, IEEE Trans. Parallel Distributed Syst..

[5]  Han Hoogeveen,et al.  Complexity of Scheduling Multiprocessor Tasks with Prespecified Processor Allocations , 1994, Discret. Appl. Math..

[6]  David S. Johnson,et al.  Computers and Intractability: A Guide to the Theory of NP-Completeness , 1978 .

[7]  Jan Karel Lenstra,et al.  Computing near-optimal schedules , 1995 .

[8]  Mihalis Yannakakis,et al.  Towards an architecture-independent analysis of parallel algorithms , 1990, STOC '88.

[9]  Jing-Jang Hwang,et al.  Deterministic scheduling in systems with interprocessor communication times , 1987 .

[10]  J. Labetoulle,et al.  A heuristic method for loading and scheduling flexible manufacturing systems , 1988 .

[11]  Zhen Liu,et al.  A Note on Graham's Bound , 1990, Inf. Process. Lett..

[12]  Evripidis Bampis,et al.  Scheduling UET-UCT Series-Parallel Graphs on Two Processors , 1996, Theor. Comput. Sci..

[13]  Han Hoogeveen,et al.  Three, four, five, six, or the complexity of scheduling with communication delays , 1994, Oper. Res. Lett..

[14]  Zhen Liu,et al.  Scheduling of Parallel Programs in Single-Bus Multiprocessor Systems , 1994 .

[15]  Christophe Picouleau New Complexity Results on Scheduling with Small Communication Delays , 1995, Discret. Appl. Math..

[16]  Christophe Picouleau Etude de problemes d'optimisation dans les systemes distribues , 1992 .

[17]  P. Chrétienne A polynomial algorithm to optimally schedule tasks on a virtual distributed system under tree-like precedence constraints , 1989 .

[18]  Marsha Lise Prastein,et al.  Precedence-Constrained Scheduling with Minimum Time and Communication , 1987 .

[19]  G. J. Janacek,et al.  Scheduling Parallel Programs assuming Preallocation , 1995 .

[20]  Victor J. Rayward-Smith,et al.  UET scheduling with unit interprocessor communication delays , 1987, Discret. Appl. Math..

[21]  Rolf H. Möhring,et al.  M-Machine Unit Time Scheduling: A Report on Ongoing Research , 1988 .

[22]  Eugene L. Lawler,et al.  Scheduling In and Out Forests in the Presence of Communication Delays , 1996, IEEE Trans. Parallel Distributed Syst..