The Interplay of Causality and Myopia in Adversarial Channel Models

The difference in capacity formulae between worst-case and average-case channel noise models has been part of information theory since the early days of the field. This paper continues a line of work studying intermediate models in which the channel behavior can depend partially on the transmitted codeword. In particular, we consider a model in which a binary erasure channel (with maximum fraction of erasures p) is controlled by an adversary who can observe the transmitted codeword through an independent and memoryless erasure channel (with erasure probability q). Upper and lower bounds on the capacity are given for two models: a noncausal model, in which the adversary can choose their erasures based on the entire (partially observed) codeword, and a causal model, in which at each time the adversary must choose its erasures based on the current and previously observed codeword bits. The achievable rate for the noncausal case is larger than the Gilbert-Varshamov bound and for some parameter ranges exceeds the linear programming (LP) bound; we also provide a non-trivial outer bound on the capacity. For the causal case, we show the capacity is 1−2p+q for p ≥ q (prior work shows the capacity to equal 1−p when p<q). Our code construction in both scenarios are novel, requiring the encoder to carefully add “low-weight correlated noise” to its transmission.

[1]  Michael Langberg,et al.  The Capacity of Online (Causal) $q$ -Ary Error-Erasure Channels , 2019, IEEE Transactions on Information Theory.

[2]  Anand D. Sarwate,et al.  Upper Bounds on the Capacity of Binary Channels With Causal Adversaries , 2012, IEEE Transactions on Information Theory.

[3]  Mayank Bakshi,et al.  Coding against a limited-view adversary: The effect of causality and feedback , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[4]  Anand D. Sarwate,et al.  Coding against delayed adversaries , 2010, 2010 IEEE International Symposium on Information Theory.

[5]  Michael Langberg,et al.  Binary causal-adversary channels , 2009, 2009 IEEE International Symposium on Information Theory.

[6]  Robert J. McEliece,et al.  New upper bounds on the rate of a code via the Delsarte-MacWilliams inequalities , 1977, IEEE Trans. Inf. Theory.

[7]  Raef Bassily,et al.  Causal Erasure Channels , 2014, SODA.

[8]  Anand D. Sarwate,et al.  The benefit of a 1-bit jump-start, and the necessity of stochastic encoding, in jamming channels , 2016, ArXiv.

[9]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[10]  Michael Langberg,et al.  Codes against online adversaries , 2008, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[11]  Michael Langberg,et al.  A Characterization of the Capacity of Online (causal) Binary Channels , 2014, STOC.

[12]  D. Blackwell,et al.  The Capacities of Certain Channel Classes Under Random Coding , 1960 .

[13]  Anand D. Sarwate,et al.  Quadratically Constrained Channels with Causal Adversaries , 2018, 2018 IEEE International Symposium on Information Theory (ISIT).

[14]  Anand D. Sarwate,et al.  Coding against myopic adversaries , 2010, 2010 IEEE Information Theory Workshop.

[15]  E. Gilbert A comparison of signalling alphabets , 1952 .

[16]  Michael Langberg,et al.  Sufficiently myopic adversaries are blind , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[17]  Anand D. Sarwate,et al.  A bit of delay is sufficient and stochastic encoding is necessary to overcome online adversarial erasures , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).