Constant-rate coding for multiparty interactive communication is impossible

We study coding schemes for multiparty interactive communication over synchronous networks that suffer from stochastic noise, where each bit is independently flipped with probability ε. We analyze the minimal overhead that must be added by the coding scheme in order to succeed in performing the computation despite the noise. Our main result is a lower bound on the communication of any noise-resilient protocol over a synchronous star network with n-parties (where all parties communicate in every round). Specifically, we show a task that can be solved by communicating T bits over the noise-free network, but for which any protocol with success probability of 1-o(1) must communicate at least Ω(T log n / log log n) bits when the channels are noisy. By a 1994 result of Rajagopalan and Schulman, the slowdown we prove is the highest one can obtain on any topology, up to a log log n factor. We complete our lower bound with a matching coding scheme that achieves the same overhead; thus, the capacity of (synchronous) star networks is Θ(log log n / log n). Our bounds prove that, despite several previous coding schemes with rate Ω(1) for certain topologies, no coding scheme with constant rate Ω(1) exists for arbitrary n-party noisy networks.

[1]  R. A. Leibler,et al.  On Information and Sufficiency , 1951 .

[2]  Mark Braverman,et al.  Towards deterministic tree code constructions , 2012, ITCS '12.

[3]  João Barros,et al.  Topology matters in network coding , 2012, Telecommun. Syst..

[4]  Amit Sahai,et al.  Efficient and Explicit Coding for Interactive Communication , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[5]  Leonard J. Schulman,et al.  Communication on noisy channels: a coding theorem for computation , 1992, Proceedings., 33rd Annual Symposium on Foundations of Computer Science.

[6]  Charles F. Hockett,et al.  A mathematical theory of communication , 1948, MOCO.

[7]  Mark Braverman,et al.  Toward Coding for Maximum Errors in Interactive Communication , 2011, IEEE Transactions on Information Theory.

[8]  Allison Bishop,et al.  Balancing Communication for Multi-party Interactive Coding , 2015, ArXiv.

[9]  Ran Raz,et al.  Interactive channel capacity , 2013, STOC '13.

[10]  Leonard J. Schulman,et al.  The Adversarial Noise Threshold for Distributed Protocols , 2014, SODA.

[11]  Amit Sahai,et al.  Private Interactive Communication Across an Adversarial Channel , 2015, IEEE Trans. Inf. Theory.

[12]  Robert G. Gallager,et al.  Finding parity in a simple broadcast network , 1988, IEEE Trans. Inf. Theory.

[13]  Avi Wigderson,et al.  Towards Optimal Deterministic Coding for Interactive Communication , 2016, SODA.

[14]  Bernhard Haeupler,et al.  Interactive Channel Capacity Revisited , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[15]  Yael Tauman Kalai,et al.  Fast Interactive Coding against Adversarial Noise , 2014, JACM.

[16]  Yael Tauman Kalai,et al.  Interactive Coding for Multiparty Protocols , 2015, ITCS.

[17]  Rafail Ostrovsky,et al.  Optimal Coding for Streaming Authentication and Interactive Communication , 2015, IEEE Trans. Inf. Theory.

[18]  Klim Efremenko,et al.  Maximal Noise in Interactive Communication Over Erasure Channels and Channels With Feedback , 2015, IEEE Transactions on Information Theory.

[19]  Madhu Sudan,et al.  Optimal error rates for interactive coding I: adaptivity and other settings , 2013, STOC.

[20]  Bernhard Haeupler,et al.  Optimal Error Rates for Interactive Coding II: Efficiency and List Decoding , 2013, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[21]  Atri Rudra,et al.  Topology Matters in Communication , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[22]  Kai-Min Chung,et al.  Knowledge-Preserving Interactive Coding , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[23]  Amit Sahai,et al.  Efficient Coding for Interactive Communication , 2014, IEEE Transactions on Information Theory.

[24]  Leonard J. Schulman Coding for interactive communication , 1996, IEEE Trans. Inf. Theory.

[25]  Mark Braverman,et al.  List and Unique Coding for Interactive Communication in the Presence of Adversarial Noise , 2014, FOCS.

[26]  Guy Kindler,et al.  Lower Bounds for the Noisy Broadcast Problem , 2008, SIAM J. Comput..

[27]  Leonard J. Schulman,et al.  Deterministic coding for interactive communication , 1993, STOC.

[28]  Ran Gelles,et al.  Coding for Interactive Communication: A Survey , 2017, Found. Trends Theor. Comput. Sci..

[29]  Ran Gelles,et al.  Capacity of Interactive Communication over Erasure Channels and Channels with Feedback , 2015, SIAM J. Comput..

[30]  Amit Sahai,et al.  Adaptive protocols for interactive communication , 2013, 2016 IEEE International Symposium on Information Theory (ISIT).

[31]  Leonard J. Schulman,et al.  A coding theorem for distributed computation , 1994, STOC '94.