Certifying Equality With Limited Interaction

The equality problem is usually one’s first encounter with communication complexity and is one of the most fundamental problems in the field. Although its deterministic and randomized communication complexity were settled decades ago, we find several new things to say about the problem by focusing on three subtle aspects. The first is to consider the expected communication cost (at a worst-case input) for a protocol that uses limited interaction—i.e., a bounded number of rounds of communication—and whose error probability is zero or close to it. The second is to treat the false negative error rate separately from the false positive error rate. The third is to consider the information cost of such protocols. We obtain asymptotically optimal rounds-versus-cost tradeoffs for equality: both expected communication complexity and information complexity scale as $$\Theta ({{\mathrm{ilog}}}^{r-1} n)$$Θ(ilogr-1n), where r is the number of rounds and $${{\mathrm{ilog}}}^k n = \log \log \cdots \log n$$ilogkn=loglog⋯logn, with k logs. These bounds hold even when the false negative rate approaches 1. For the case of zero-error communication cost, we obtain essentially matching bounds, up to a tiny additive constant. We also provide some applications. As an application of our information cost bounds, we obtain new bounded-round randomized lower bounds for the Intersection problem, in which there are two players who hold subsets $$S,T \subseteq [n]$$S,T⊆[n]. In many realistic scenarios, the sizes of S and T are significantly smaller than n, so we impose the constraint that $$|S|, |T| \le k$$|S|,|T|≤k. We study the minimum number of bits the parties need to communicate in order to compute the entire intersection set $$S \cap T$$S∩T, using r rounds. We show that any r-round protocol has information cost (and thus communication cost) $$\Omega (k {{\mathrm{ilog}}}^r k)$$Ω(kilogrk) bits. We also give an O(r)-round protocol achieving $$O(k{{\mathrm{ilog}}}^r k)$$O(kilogrk) bits, which for $$r = \log ^* k$$r=log∗k gives a protocol with O(k) bits of communication. This is in contrast to other basic problems such as computing the union or symmetric difference, for which $$\Omega (k\log (n/k))$$Ω(klog(n/k)) bits of communication is required for any number of rounds.

[1]  Rahul Jain,et al.  New Strong Direct Product Results in Communication Complexity , 2015, Electron. Colloquium Comput. Complex..

[2]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .

[3]  Claire Mathieu,et al.  Recognizing well-parenthesized expressions in the streaming model , 2009, STOC '10.

[4]  Mark Braverman,et al.  Direct Product via Round-Preserving Compression , 2013, ICALP.

[5]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[6]  E. Kushilevitz,et al.  Communication Complexity: Basics , 1996 .

[7]  Xi Chen,et al.  How to Compress Interactive Communication , 2013, SIAM J. Comput..

[8]  János Komlós,et al.  Storing a sparse table with O(1) worst case access time , 1982, 23rd Annual Symposium on Foundations of Computer Science (sfcs 1982).

[9]  Ravi Kumar,et al.  An information statistics approach to data stream and communication complexity , 2004, J. Comput. Syst. Sci..

[10]  Amit Chakrabarti,et al.  Everywhere-Tight Information Cost Tradeoffs for Augmented Index , 2011, APPROX-RANDOM.

[11]  Avi Wigderson,et al.  The Randomized Communication Complexity of Set Disjointness , 2007, Theory Comput..

[12]  Jaikumar Radhakrishnan,et al.  Optimal Direct Sum and Privacy Trade-off Results for Quantum and Classical Communication Complexity , 2008, ArXiv.

[13]  Andrew Chi-Chih Yao,et al.  Informational complexity and the direct sum problem for simultaneous message complexity , 2001, Proceedings 2001 IEEE International Conference on Cluster Computing.

[14]  Moni Naor,et al.  Oblivious Polynomial Evaluation , 2006, SIAM J. Comput..

[15]  David P. Woodruff,et al.  Beating the Direct Sum Theorem in Communication Complexity with Implications for Sketching , 2013, SODA.

[16]  Kurt Mehlhorn,et al.  Las Vegas is better than determinism in VLSI and distributed computing (Extended Abstract) , 1982, STOC '82.

[17]  Rahul Jain,et al.  A Direct Product Theorem for Two-Party Bounded-Round Public-Coin Communication Complexity , 2016, 2012 IEEE 53rd Annual Symposium on Foundations of Computer Science.

[18]  Andrew Chi-Chih Yao,et al.  Some complexity questions related to distributive computing(Preliminary Report) , 1979, STOC.

[19]  Peter Winkler,et al.  Comparing information without leaking it , 1996, CACM.

[20]  Mark Braverman,et al.  Information Equals Amortized Communication , 2011, IEEE Transactions on Information Theory.

[21]  S. Muthukrishnan,et al.  Estimating Rarity and Similarity over Data Stream Windows , 2002, ESA.

[22]  Subhash Khot,et al.  Near-optimal lower bounds on the multi-party communication complexity of set disjointness , 2003, 18th IEEE Annual Conference on Computational Complexity, 2003. Proceedings..

[23]  Jaikumar Radhakrishnan,et al.  The Communication Complexity of Correlation , 2007, Twenty-Second Annual IEEE Conference on Computational Complexity (CCC'07).

[24]  Bala Kalyanasundaram,et al.  The Probabilistic Communication Complexity of Set Intersection , 1992, SIAM J. Discret. Math..

[25]  Ronald de Wolf,et al.  The non-adaptive query complexity of testing k-parities , 2013, Chic. J. Theor. Comput. Sci..

[26]  André Gronemeier,et al.  Asymptotically Optimal Lower Bounds on the NIH-Multi-Party Information Complexity of the AND-Function and Disjointness , 2009, STACS.

[27]  Peter Bro Miltersen,et al.  On data structures and asymmetric communication complexity , 1994, STOC '95.

[28]  Joshua Brody,et al.  Property Testing Lower Bounds via Communication Complexity , 2011, 2011 IEEE 26th Annual Conference on Computational Complexity.

[29]  Noga Alon,et al.  The space complexity of approximating the frequency moments , 1996, STOC '96.

[30]  Ashwin Nayak,et al.  Optimal lower bounds for quantum automata and random access codes , 1999, 40th Annual Symposium on Foundations of Computer Science (Cat. No.99CB37039).

[31]  Anna Shubina,et al.  Nearly Private Information Retrieval , 2007, MFCS.

[32]  Mark Braverman,et al.  From information to exact communication , 2013, STOC '13.

[33]  Ilan Newman,et al.  Private vs. Common Random Bits in Communication Complexity , 1991, Inf. Process. Lett..

[34]  Andrew Chi-Chih Yao,et al.  Probabilistic computations: Toward a unified measure of complexity , 1977, 18th Annual Symposium on Foundations of Computer Science (sfcs 1977).

[35]  Benny Pinkas,et al.  Efficient Private Matching and Set Intersection , 2004, EUROCRYPT.

[36]  Anirban Dasgupta,et al.  Sparse and Lopsided Set Disjointness via Information Theory , 2012, APPROX-RANDOM.

[37]  Eyal Kushilevitz,et al.  The Communication Complexity of Set-Disjointness with Small Sets and 0-1 Intersection , 2009, 2009 50th Annual IEEE Symposium on Foundations of Computer Science.

[38]  Rusins Freivalds,et al.  Probabilistic Machines Can Use Less Running Time , 1977, IFIP Congress.

[39]  Rahul Jain,et al.  A Direct Product Theorem for Two-Party Bounded-Round Public-Coin Communication Complexity , 2012, Algorithmica.

[40]  Ronald de Wolf,et al.  Exponential lower bound for 2-query locally decodable codes via a quantum argument , 2002, STOC '03.

[41]  David P. Woodruff,et al.  On the exact space complexity of sketching and streaming small norms , 2010, SODA '10.

[42]  Joshua Brody,et al.  Certifying Equality With Limited Interaction , 2014, APPROX-RANDOM.

[43]  Mihai Pa caron,et al.  Unifying the Landscape of Cell-Probe Lower Bounds , 2011 .

[44]  Mark Braverman,et al.  An information complexity approach to extended formulations , 2013, STOC '13.

[45]  Farid M. Ablayev,et al.  Lower Bounds for One-Way Probabilistic Communication Complexity and Their Application to Space Complexity , 1996, Theor. Comput. Sci..

[46]  János Komlós,et al.  Storing a sparse table with O(1) worst case access time , 1982, 23rd Annual Symposium on Foundations of Computer Science (sfcs 1982).

[47]  Gábor Tardos,et al.  On the Communication Complexity of Sparse Set Disjointness and Exists-Equal Problems , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[48]  Mark Braverman,et al.  Tight Bounds for Set Disjointness in the Message Passing Model , 2013, ArXiv.

[49]  Alexander A. Razborov,et al.  On the Distributional Complexity of Disjointness , 1992, Theor. Comput. Sci..

[50]  Mark Braverman Interactive information complexity , 2012, STOC '12.

[51]  Hartmut Klauck On Quantum and Approximate Privacy , 2002, STACS.

[52]  Qin Zhang,et al.  Lower Bounds for Number-in-Hand Multiparty Communication Complexity, Made Easy , 2011, SIAM J. Comput..

[53]  Moni Naor,et al.  Amortized Communication Complexity , 1995, SIAM J. Comput..

[54]  Toniann Pitassi,et al.  The Hardness of Being Private , 2012, 2012 IEEE 27th Conference on Computational Complexity.

[55]  Mihai Patrascu,et al.  Unifying the Landscape of Cell-Probe Lower Bounds , 2010, SIAM J. Comput..

[56]  Graham Cormode,et al.  Information Cost Tradeoffs for Augmented Index and Streaming Language Recognition , 2010, 2010 IEEE 51st Annual Symposium on Foundations of Computer Science.