The benefit of a 1-bit jump-start, and the necessity of stochastic encoding, in jamming channels

We consider the problem of communicating a message $m$ in the presence of a malicious jamming adversary (Calvin), who can erase an arbitrary set of up to $pn$ bits, out of $n$ transmitted bits $(x_1,\ldots,x_n)$. The capacity of such a channel when Calvin is exactly causal, i.e. Calvin's decision of whether or not to erase bit $x_i$ depends on his observations $(x_1,\ldots,x_i)$ was recently characterized to be $1-2p$. In this work we show two (perhaps) surprising phenomena. Firstly, we demonstrate via a novel code construction that if Calvin is delayed by even a single bit, i.e. Calvin's decision of whether or not to erase bit $x_i$ depends only on $(x_1,\ldots,x_{i-1})$ (and is independent of the "current bit" $x_i$) then the capacity increases to $1-p$ when the encoder is allowed to be stochastic. Secondly, we show via a novel jamming strategy for Calvin that, in the single-bit-delay setting, if the encoding is deterministic (i.e. the transmitted codeword is a deterministic function of the message $m$) then no rate asymptotically larger than $1-2p$ is possible with vanishing probability of error, hence stochastic encoding (using private randomness at the encoder) is essential to achieve the capacity of $1-p$ against a one-bit-delayed Calvin.

[1]  Imre Csiszár,et al.  The capacity of the arbitrarily varying channel revisited: Positivity, constraints , 1988, IEEE Trans. Inf. Theory.

[2]  Adam D. Smith Scrambling adversarial errors using few random bits, optimal information reconciliation, and better private codes , 2007, SODA '07.

[3]  Anand D. Sarwate,et al.  Rateless Codes for AVC Models , 2007, IEEE Transactions on Information Theory.

[4]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[5]  Michael Langberg,et al.  A Characterization of the Capacity of Online (causal) Binary Channels , 2014, STOC.

[6]  Anand D. Sarwate,et al.  Improved upper bounds on the capacity of binary channels with causal adversaries , 2012, ISIT.

[7]  D. Blackwell,et al.  The Capacities of Certain Channel Classes Under Random Coding , 1960 .

[8]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[9]  A. D. Wyner,et al.  The wire-tap channel , 1975, The Bell System Technical Journal.

[10]  Michael Langberg,et al.  Private codes or succinct random codes that are (almost) perfect , 2004, 45th Annual IEEE Symposium on Foundations of Computer Science.

[11]  Prakash Narayan,et al.  Reliable Communication Under Channel Uncertainty , 1998, IEEE Trans. Inf. Theory.

[12]  Raef Bassily,et al.  Causal Erasure Channels , 2014, SODA.

[13]  Robert J. McEliece,et al.  New upper bounds on the rate of a code via the Delsarte-MacWilliams inequalities , 1977, IEEE Trans. Inf. Theory.

[14]  Michael Langberg,et al.  Binary causal-adversary channels , 2009, 2009 IEEE International Symposium on Information Theory.

[15]  Anand D. Sarwate,et al.  Upper Bounds on the Capacity of Binary Channels With Causal Adversaries , 2012, IEEE Transactions on Information Theory.

[16]  Rudolf Ahlswede,et al.  Correlated Decoding for Channels with Arbitrarily Varying Channel Probability Functions , 1969, Inf. Control..

[17]  Imre Csiszár,et al.  Arbitrarily varying channels with constrained inputs and states , 1988, IEEE Trans. Inf. Theory.

[18]  R. Ahlswede Elimination of correlation in random codes for arbitrarily varying channels , 1978 .

[19]  E. Gilbert A comparison of signalling alphabets , 1952 .

[20]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .