Tribes Is Hard in the Message Passing Model

We consider the point-to-point message passing model of communication in which there are $k$ processors with individual private inputs, each $n$-bit long. Each processor is located at the node of an underlying undirected graph and has access to private random coins. An edge of the graph is a private channel of communication between its endpoints. The processors have to compute a given function of all their inputs by communicating along these channels. While this model has been widely used in distributed computing, strong lower bounds on the amount of communication needed to compute simple functions have just begun to appear. In this work, we prove a tight lower bound of $\Omega(kn)$ on the communication needed for computing the Tribes function, when the underlying graph is a star of $k+1$ nodes that has $k$ leaves with inputs and a center with no input. Lower bound on this topology easily implies comparable bounds for others. Our lower bounds are obtained by building upon the recent information theoretic techniques of Braverman et.al (FOCS'13) and combining it with the earlier work of Jayram, Kumar and Sivakumar (STOC'03). This approach yields information complexity bounds that is of independent interest.

[1]  A. Razborov Communication Complexity , 2011 .

[2]  Toniann Pitassi,et al.  The story of set disjointness , 2010, SIGA.

[3]  Danny Dolev,et al.  Determinism vs. Nondeterminism in Multiparty Communication Complexity , 1992, SIAM J. Comput..

[4]  Qin Zhang,et al.  Lower Bounds for Number-in-Hand Multiparty Communication Complexity, Made Easy , 2011, SIAM J. Comput..

[5]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[6]  Jianhua Lin,et al.  Divergence measures based on the Shannon entropy , 1991, IEEE Trans. Inf. Theory.

[7]  Maria-Florina Balcan,et al.  Distributed Learning, Communication Complexity and Privacy , 2012, COLT.

[8]  David P. Woodruff,et al.  An Optimal Lower Bound for Distinct Elements in the Message Passing Model , 2014, SODA.

[9]  Ravi Kumar,et al.  Two applications of information complexity , 2003, STOC '03.

[10]  Mark Braverman,et al.  Tight Bounds for Set Disjointness in the Message Passing Model , 2013, ArXiv.

[11]  Ziv Bar-Yossef,et al.  An information statistics approach to data stream and communication complexity , 2002, The 43rd Annual IEEE Symposium on Foundations of Computer Science, 2002. Proceedings..

[12]  Fabian Kuhn,et al.  The communication complexity of distributed task allocation , 2012, PODC '12.

[13]  José D. P. Rolim,et al.  Lower Bounds on the Multiparty Communication Complexity , 1998, J. Comput. Syst. Sci..

[14]  Sergei Vassilvitskii,et al.  A model of computation for MapReduce , 2010, SODA '10.

[15]  Qin Zhang,et al.  Sorting, Searching, and Simulation in the MapReduce Framework , 2011, ISAAC.

[16]  D P RolimJosé,et al.  Lower Bounds on the Multiparty Communication Complexity , 1998 .

[17]  David P. Woodruff,et al.  When distributed computation is communication expensive , 2013, Distributed Computing.

[18]  David P. Woodruff,et al.  Tight bounds for distributed functional monitoring , 2011, STOC '12.

[19]  Dan Suciu,et al.  Parallel evaluation of conjunctive queries , 2011, PODS.

[20]  Andrew Chi-Chih Yao,et al.  Some complexity questions related to distributive computing(Preliminary Report) , 1979, STOC.

[21]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .