The communication complexity of distributed task allocation

We consider a distributed task allocation problem in which <i>m</i> players must divide a set of <i>n</i> tasks between them. Each player <i>i</i> receives as input a set <i>X<sub>i</sub></i> of tasks such that the union of all input sets covers the task set. The goal is for each player to output a subset <i>Y<sub>i</sub></i> ⊆ <i>X<sub>i</sub></i>, such that the outputs (<i>Y<sub>1</sub></i>,...,<i>Y<sub>m</sub></i>) form a partition of the set of tasks. The problem can be viewed as a distributed one-shot variant of the well-known <i>k</i>-server problem, and we also show that it is closely related to the problem of finding a rooted spanning tree in directed broadcast networks. We study the communication complexity and round complexity of the task allocation problem. We begin with the classical two-player communication model, and show that the randomized communication complexity of task allocation is Ω(<i>n</i>), even when the set of tasks is known to the players in advance. For the multi-player setting with <i>m</i> = <i>O</i>(<i>n</i>) we give two upper bounds in the shared-blackboard model of communication. We show that the problem can be solved in <i>O</i>(log <i>n</i>) rounds and <i>O</i>(<i>n</i> log <i>n</i>) total bits for arbitrary inputs; moreover, if for any set <i>X</i> of tasks, there are at least α|<i>X</i>| players that have at least one task from <i>X</i> in their inputs, then <i>O</i>((1/α + log <i>m</i>)log <i>n</i>) rounds suffice even if each player can only write <i>O</i>(log <i>n</i>) bits on the blackboard in each round. Finally, we extend our results to the case where the players communicate over an arbitrary directed communication graph instead of a shared blackboard. As an application of these results, we also consider the related problem of constructing a directed spanning tree in strongly-connected directed networks and we show lower and upper bounds for that problem.

[1]  Adi Rosén,et al.  The Distributed k-Server Problem - A Competitive Distributed Translator for k-Server Algorithms , 1997, J. Algorithms.

[2]  Fabian Kuhn,et al.  The Complexity of Data Aggregation in Directed Networks , 2011, DISC.

[3]  Alexander A. Razborov,et al.  On the Distributional Complexity of Disjointness , 1992, Theor. Comput. Sci..

[4]  Avi Wigderson,et al.  Monotone circuits for connectivity require super-logarithmic depth , 1990, STOC '88.

[5]  Aloysius K. Mok,et al.  Multiprocessor On-Line Scheduling of Hard-Real-Time Tasks , 1989, IEEE Trans. Software Eng..

[6]  Josh Aas Understanding the Linux 2.6.8.1 CPU Scheduler , 2005 .

[7]  Alan Burns,et al.  A survey of hard real-time scheduling for multiprocessor systems , 2011, CSUR.

[8]  Elias Koutsoupias,et al.  The k-server problem , 2009, Comput. Sci. Rev..

[9]  Donald M. Topkis,et al.  Concurrent Broadcast for Information Dissemination , 1985, IEEE Transactions on Software Engineering.

[10]  A. Razborov Communication Complexity , 2011 .

[11]  Nancy A. Lynch,et al.  Distributed computation in dynamic networks , 2010, STOC '10.

[12]  Boaz Patt-Shamir A note on efficient aggregate queries in sensor networks , 2004, PODC '04.

[13]  T. S. Jayram Information complexity: a tutorial , 2010, PODS '10.

[14]  James W. Layland,et al.  Scheduling Algorithms for Multiprogramming in a Hard-Real-Time Environment , 1989, JACM.

[15]  Chryssis Georgiou,et al.  Cooperative Task-Oriented Computing: Algorithms and Complexity , 2011, Synthesis Lectures on Distributed Computing Theory.

[16]  Matteo Frigo,et al.  The implementation of the Cilk-5 multithreaded language , 1998, PLDI.

[17]  T. S. Jayram Hellinger Strikes Back: A Note on the Multi-party Information Complexity of AND , 2009, APPROX-RANDOM.

[18]  André Gronemeier,et al.  Asymptotically Optimal Lower Bounds on the NIH-Multi-Party Information Complexity of the AND-Function and Disjointness , 2009, STACS.

[19]  Baruch Awerbuch,et al.  Competitive distributed job scheduling (extended abstract) , 1992, STOC '92.

[20]  Roger Wattenhofer,et al.  Networks cannot compute their diameter in sublinear time , 2012, SODA.

[21]  Yuval Rabani,et al.  Competitive k-server algorithms , 1990, Proceedings [1990] 31st Annual Symposium on Foundations of Computer Science.