Two-Party Direct-Sum Questions Through the Lens of Multiparty Communication Complexity

Direct-sum questions in (two-party) communication complexity ask whether two parties, Alice and Bob, can compute the value of a function f on l inputs (x_1,y_1),...,(x_l,y_l) more efficiently than by applying the best protocol for f, independently on each input (x_i,y_i). In spite of significant efforts to understand these questions (under various communication-complexity measures), the general question is still far from being well understood. In this paper, we offer a multiparty view of these questions: The direct-sum setting is just a two-player system with Alice having inputs x_1,...,x_l, Bob having inputs y_1,...,y_l and the desired output is f(x_1,y_1),...,f(x_l,y_l). The naive solution of solving the l problems independently, is modeled by a network with l (disconnected) pairs of players Alice i and Bob i, with inputs x_i,y_i respectively, and communication only within each pair. Then, we consider an intermediate ("star") model, where there is one Alice having l inputs x_1,...,x_l and l players Bob_1,...,Bob_l holding y_1,...,y_l, respectively (in fact, we consider few variants of this intermediate model, depending on whether communication between each Bob i and Alice is point-to-point or whether we allow broadcast). Our goal is to get a better understanding of the relation between the two extreme models (i.e., of the two-party direct-sum question). If, for instance, Alice and Bob can do better (for some complexity measure) than solving the l problems independently, we wish to understand what intermediate model already allows to do so (hereby understanding the "source" of such savings). If, on the other hand, we wish to prove that there is no better solution than solving the l problems independently, then our approach gives a way of breaking the task of proving such a statement into few (hopefully, easier) steps. We present several results of both types. Namely, for certain complexity measures, communication problems f and certain pairs of models, we can show gaps between the complexity of solving f on l instances in the two models in question; while, for certain other complexity measures and pairs of models, we can show that such gaps do not exist (for any communication problem f). For example, we prove that if only point-to-point communication is allowed in the intermediate "star" model, then significant savings are impossible in the public-coin randomized setting. On the other hand, in the private-coin randomized setting, if Alice is allowed to broadcast messages to all Bobs in the "star" network, then some savings are possible. While this approach does not lead yet to new results on the original two-party direct-sum question, we believe that our work gives new insights on the already-known direct-sum results, and may potentially lead to more such results in the future.

[1]  Rahul Jain,et al.  A Direct Product Theorem for Two-Party Bounded-Round Public-Coin Communication Complexity , 2012, Algorithmica.

[2]  Alon Orlitsky,et al.  Worst-case interactive communication - II: Two messages are not optimal , 1991, IEEE Trans. Inf. Theory.

[3]  Nathan Linial,et al.  Locality in Distributed Graph Algorithms , 1992, SIAM J. Comput..

[4]  Ilan Newman,et al.  Private vs. Common Random Bits in Communication Complexity , 1991, Inf. Process. Lett..

[5]  Subhash Khot,et al.  Near-optimal lower bounds on the multi-party communication complexity of set disjointness , 2003, 18th IEEE Annual Conference on Computational Complexity, 2003. Proceedings..

[6]  Richard J. Lipton,et al.  Lower bounds for VLSI , 1981, STOC '81.

[7]  Hartmut Klauck,et al.  Communication Complexity Method for Measuring Nondeterminism in Finite Automata , 2002, Inf. Comput..

[8]  Ran Raz,et al.  Exponential Separation of Information and Communication , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[9]  Mark Braverman,et al.  Direct Products in Communication Complexity , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[10]  Avi Wigderson,et al.  Monotone circuits for connectivity require super-logarithmic depth , 1990, STOC '88.

[11]  Pierre A. Humblet,et al.  A Distributed Algorithm for Minimum-Weight Spanning Trees , 1979, TOPL.

[12]  Noam Nisan,et al.  Multiparty Protocols, Pseudorandom Generators for Logspace, and Time-Space Trade-Offs , 1992, J. Comput. Syst. Sci..

[13]  Qin Zhang,et al.  Communication Complexity of Approximate Maximum Matching in Distributed Graph Data , 2013 .

[14]  David P. Woodruff,et al.  On the Communication Complexity of Linear Algebraic Problems in the Message Passing Model , 2014, DISC.

[15]  Danny Dolev,et al.  Multiparty communication complexity , 1989, 30th Annual Symposium on Foundations of Computer Science.

[16]  Ran Raz,et al.  Exponential separation of communication and external information , 2015, STOC.

[17]  Eyal Kushilevitz,et al.  Fractional covers and communication complexity , 1992, [1992] Proceedings of the Seventh Annual Structure in Complexity Theory Conference.

[18]  Ran Raz,et al.  Monotone circuits for matching require linear depth , 1990, STOC '90.

[19]  Richard J. Lipton,et al.  Multi-party protocols , 1983, STOC.

[20]  David P. Woodruff,et al.  When distributed computation is communication expensive , 2013, Distributed Computing.

[21]  David P. Woodruff,et al.  Tight bounds for distributed functional monitoring , 2011, STOC '12.

[22]  Harry Buhrman,et al.  Nondeterministic Quantum Communication Complexity: the Cyclic Equality Game and Iterated Matrix Multiplication , 2016, ITCS.

[23]  Andrew Chi-Chih Yao,et al.  Informational complexity and the direct sum problem for simultaneous message complexity , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[24]  Andrew V. Goldberg,et al.  Parallel ((Greek D)D+1)-Coloring of Constant-Degree Graphs , 1987, Inf. Process. Lett..

[25]  Eyal Kushilevitz,et al.  On the Power of Multiplexing in Number-on-the-Forehead Protocols , 2014, ArXiv.

[26]  Eyal Kushilevitz,et al.  Partition arguments in multiparty communication complexity , 2009, Theor. Comput. Sci..

[27]  Alexander A. Razborov,et al.  On the Distributional Complexity of Disjointness , 1992, Theor. Comput. Sci..

[28]  Peter Bro Miltersen,et al.  On data structures and asymmetric communication complexity , 1994, STOC '95.

[29]  Joshua Brody,et al.  Property Testing Lower Bounds via Communication Complexity , 2011, 2011 IEEE 26th Annual Conference on Computational Complexity.

[30]  Noga Alon,et al.  Testing Equality in Communication Graphs , 2016, IEEE Transactions on Information Theory.

[31]  Mark Braverman Interactive information complexity , 2012, STOC '12.

[32]  José D. P. Rolim,et al.  Lower Bounds on the Multiparty Communication Complexity , 1998, J. Comput. Syst. Sci..

[33]  E. Kushilevitz,et al.  Communication Complexity: Basics , 1996 .

[34]  Alfred V. Aho,et al.  On notions of information transfer in VLSI circuits , 1983, STOC.

[35]  Andrew C. Yao,et al.  Lower bounds by probabilistic arguments , 1983, 24th Annual Symposium on Foundations of Computer Science (sfcs 1983).

[36]  Michael Luby,et al.  A simple parallel algorithm for the maximal independent set problem , 1985, STOC '85.

[37]  N. Nisan The communication complexity of threshold gates , 1993 .

[38]  David Peleg,et al.  Distributed Computing: A Locality-Sensitive Approach , 1987 .

[39]  Ravi Kumar,et al.  An information statistics approach to data stream and communication complexity , 2004, J. Comput. Syst. Sci..

[40]  Atri Rudra,et al.  Topology Matters in Communication , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[41]  C. Thomborson Area-Time Complexity for VLSI , 1979, STOC.

[42]  Ran Raz,et al.  Super-logarithmic depth lower bounds via the direct sum in communication complexity , 1995, computational complexity.

[43]  David P. Woodruff,et al.  An Optimal Lower Bound for Distinct Elements in the Message Passing Model , 2014, SODA.

[44]  D. Huffman A Method for the Construction of Minimum-Redundancy Codes , 1952 .

[45]  Noga Alon,et al.  The Space Complexity of Approximating the Frequency Moments , 1999 .

[46]  Qin Zhang,et al.  Lower Bounds for Number-in-Hand Multiparty Communication Complexity, Made Easy , 2011, SIAM J. Comput..

[47]  Moni Naor,et al.  Amortized Communication Complexity , 1995, SIAM J. Comput..

[48]  Mark Braverman,et al.  Information Equals Amortized Communication , 2011, IEEE Transactions on Information Theory.

[49]  Mark Braverman,et al.  Tight Bounds for Set Disjointness in the Message Passing Model , 2013, ArXiv.

[50]  Vinod M. Prabhakaran,et al.  On the Communication Complexity of Secure Computation , 2013, IACR Cryptol. ePrint Arch..

[51]  Peter Bro Miltersen On the Cell Probe Complexity of Polynomial Evaluation , 1995, Theor. Comput. Sci..

[52]  Sagnik Mukhopadhyay Tribes Is Hard in the Message Passing Model , 2015, Electron. Colloquium Comput. Complex..

[53]  Mark Braverman,et al.  The Communication Complexity of Number-In-Hand Set Disjointness with No Promise , 2015, Electron. Colloquium Comput. Complex..

[54]  Alon Orlitsky,et al.  Worst-case interactive communication I: Two messages are almost optimal , 1990, IEEE Trans. Inf. Theory.

[55]  Kate Thurmer Worst case interactive communication among three parties , 2014 .

[56]  Bala Kalyanasundaram,et al.  The Probabilistic Communication Complexity of Set Intersection , 1992, SIAM J. Discret. Math..

[57]  Xi Chen,et al.  Direct Sums in Randomized Communication Complexity , 2009, Electron. Colloquium Comput. Complex..