Constant-Rate Coding for Multiparty Interactive Communication Is Impossible

We study coding schemes for multiparty interactive communication over synchronous networks that suffer from stochastic noise, where each bit is independently flipped with probability ε. We analyze the minimal overhead that must be added by the coding scheme to succeed in performing the computation despite the noise. Our main result is a lower bound on the communication of any noise-resilient protocol over a synchronous star network with n parties (where all parties communicate in every round). Specifically, we show a task that can be solved by communicating T bits over the noise-free network, but for which any protocol with success probability of 1-o(1) must communicate at least Ω (T /log n log log n) bits when the channels are noisy. By a 1994 result of Rajagopalan and Schulman, the slowdown we prove is the highest one can obtain on any topology, up to a log log n factor. We complete our lower bound with a matching coding scheme that achieves the same overhead; thus, the capacity of (synchronous) star networks is Θ (log log n/log n). Our bounds prove that, despite several previous coding schemes with rate Ω (1) for certain topologies, no coding scheme with constant rate Ω (1) exists for arbitrary n-party noisy networks.

[1]  Ran Gelles,et al.  Capacity of Interactive Communication over Erasure Channels and Channels with Feedback , 2015, SIAM J. Comput..

[2]  Allison Bishop,et al.  Balancing Communication for Multi-party Interactive Coding , 2015, ArXiv.

[3]  Amit Sahai,et al.  Adaptive protocols for interactive communication , 2013, 2016 IEEE International Symposium on Information Theory (ISIT).

[4]  Avi Wigderson,et al.  Towards Optimal Deterministic Coding for Interactive Communication , 2016, SODA.

[5]  Yael Tauman Kalai,et al.  Interactive Coding for Multiparty Protocols , 2015, ITCS.

[6]  Noga Alon,et al.  Reliable communication over highly connected noisy networks , 2016, Distributed Computing.

[7]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[8]  Amiel Feinstein,et al.  Information and information stability of random variables and processes , 1964 .

[9]  Yael Tauman Kalai,et al.  Fast Interactive Coding against Adversarial Noise , 2014, JACM.

[10]  Klim Efremenko,et al.  Maximal Noise in Interactive Communication Over Erasure Channels and Channels With Feedback , 2015, IEEE Transactions on Information Theory.

[11]  Noam Nisan,et al.  Rounds in communication complexity revisited , 1991, STOC '91.

[12]  Mark Braverman,et al.  Constant-rate coding for multiparty interactive communication is impossible , 2016, STOC.

[13]  Thomas M. Cover,et al.  Elements of information theory (2. ed.) , 2006 .

[14]  Amit Sahai,et al.  Efficient and Explicit Coding for Interactive Communication , 2011, 2011 IEEE 52nd Annual Symposium on Foundations of Computer Science.

[15]  Ran Gelles,et al.  Constant-Rate Interactive Coding Is Impossible, Even in Constant-Degree Networks , 2019, IEEE Transactions on Information Theory.

[16]  Mark Braverman,et al.  Towards deterministic tree code constructions , 2012, ITCS '12.

[17]  Madhu Sudan,et al.  Optimal error rates for interactive coding I: adaptivity and other settings , 2013, STOC.

[18]  Robert G. Gallager,et al.  Finding parity in a simple broadcast network , 1988, IEEE Trans. Inf. Theory.

[19]  Bernhard Haeupler,et al.  Optimal Error Rates for Interactive Coding II: Efficiency and List Decoding , 2013, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[20]  João Barros,et al.  Topology matters in network coding , 2012, Telecommun. Syst..

[21]  Jaikumar Radhakrishnan,et al.  The Communication Complexity of Pointer Chasing , 2001, J. Comput. Syst. Sci..

[22]  Leonard J. Schulman,et al.  Communication on noisy channels: a coding theorem for computation , 1992, Proceedings., 33rd Annual Symposium on Foundations of Computer Science.

[23]  Rafail Ostrovsky,et al.  Optimal Coding for Streaming Authentication and Interactive Communication , 2015, IEEE Transactions on Information Theory.

[24]  Ran Raz,et al.  Interactive channel capacity , 2013, STOC '13.

[25]  Mark Braverman,et al.  Toward Coding for Maximum Errors in Interactive Communication , 2011, IEEE Transactions on Information Theory.

[26]  Huaiyu Zhu On Information and Sufficiency , 1997 .

[27]  Leonard J. Schulman,et al.  The Adversarial Noise Threshold for Distributed Protocols , 2014, SODA.

[28]  Atri Rudra,et al.  Topology Matters in Communication , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[29]  Kai-Min Chung,et al.  Knowledge-Preserving Interactive Coding , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[30]  Amit Sahai,et al.  Efficient Coding for Interactive Communication , 2014, IEEE Transactions on Information Theory.

[31]  Leonard J. Schulman Coding for interactive communication , 1996, IEEE Trans. Inf. Theory.

[32]  Ran Gelles,et al.  Coding for Interactive Communication: A Survey , 2017, Found. Trends Theor. Comput. Sci..

[33]  Abbas El Gamal Reliable Communication of Highly Distributed Information , 1987 .

[34]  The Research Leading to These Results Has Received Funding from the European Community's Seventh Framework Programme [fp7/2007-2013] under Grant Agreement No. 257593 , .

[35]  Bernhard Haeupler,et al.  Interactive Channel Capacity Revisited , 2014, 2014 IEEE 55th Annual Symposium on Foundations of Computer Science.

[36]  Mark Braverman,et al.  List and Unique Coding for Interactive Communication in the Presence of Adversarial Noise , 2014, FOCS.

[37]  Guy Kindler,et al.  Lower Bounds for the Noisy Broadcast Problem , 2008, SIAM J. Comput..

[38]  Mark Braverman,et al.  Coding for Interactive Communication Correcting Insertions and Deletions , 2017, IEEE Transactions on Information Theory.

[39]  Leonard J. Schulman,et al.  Deterministic coding for interactive communication , 1993, STOC.

[40]  Leonard J. Schulman,et al.  A coding theorem for distributed computation , 1994, STOC '94.