Coding against deletions in oblivious and online models

We consider binary error correcting codes when errors are deletions. A basic challenge concerning deletion codes is determining $p_0^{(adv)}$, the zero-rate threshold of adversarial deletions, defined to be the supremum of all $p$ for which there exists a code family with rate bounded away from 0 capable of correcting a fraction $p$ of adversarial deletions. A recent construction of deletion-correcting codes [Bukh et al 17] shows that $p_0^{(adv)} \ge \sqrt{2}-1$, and the trivial upper bound, $p_0^{(adv)}\le\frac{1}{2}$, is the best known. Perhaps surprisingly, we do not know whether or not $p_0^{(adv)} = 1/2$. In this work, to gain further insight into deletion codes, we explore two related error models: oblivious deletions and online deletions, which are in between random and adversarial deletions in power. In the oblivious model, the channel can inflict an arbitrary pattern of $pn$ deletions, picked without knowledge of the codeword. We prove the existence of binary codes of positive rate that can correct any fraction $p < 1$ of oblivious deletions, establishing that the associated zero-rate threshold $p_0^{(obliv)}$ equals $1$. For online deletions, where the channel decides whether to delete bit $x_i$ based only on knowledge of bits $x_1x_2\dots x_i$, define the deterministic zero-rate threshold for online deletions $p_0^{(on,d)}$ to be the supremum of $p$ for which there exist deterministic codes against an online channel causing $pn$ deletions with low average probability of error. That is, the probability that a randomly chosen codeword is decoded incorrectly is small. We prove $p_0^{(adv)}=\frac{1}{2}$ if and only if $p_0^{(on,d)}=\frac{1}{2}$.

[1]  Anand D. Sarwate,et al.  Upper Bounds on the Capacity of Binary Channels With Causal Adversaries , 2012, IEEE Transactions on Information Theory.

[2]  Venkatesan Guruswami,et al.  An Improved Bound on the Fraction of Correctable Deletions , 2015, IEEE Transactions on Information Theory.

[3]  Michael Mitzenmacher,et al.  On the zero-error capacity threshold for deletion channels , 2011, 2011 Information Theory and Applications Workshop.

[4]  Yashodhan Kanoria,et al.  Optimal Coding for the Binary Deletion Channel With Small Deletion Probability , 2013, IEEE Transactions on Information Theory.

[5]  Prakash Narayan,et al.  Reliable Communication Under Channel Uncertainty , 1998, IEEE Trans. Inf. Theory.

[6]  Raef Bassily,et al.  Causal Erasure Channels , 2014, SODA.

[7]  Michael Mitzenmacher,et al.  On Lower Bounds for the Capacity of Deletion Channels , 2006, IEEE Transactions on Information Theory.

[8]  Bernhard Haeupler,et al.  Synchronization strings: codes for insertions and deletions approaching the Singleton bound , 2017, STOC.

[9]  Venkatesan Guruswami,et al.  Efficiently decodable insertion/deletion codes for high-noise and high-rate regimes , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[10]  Venkatesan Guruswami,et al.  Deletion Codes in the High-Noise and High-Rate Regimes , 2014, IEEE Transactions on Information Theory.

[11]  Imre Csiszár,et al.  Capacity and decoding rules for classes of arbitrarily varying channels , 1989, IEEE Trans. Inf. Theory.

[12]  Imre Csiszár,et al.  Arbitrarily varying channels with constrained inputs and states , 1988, IEEE Trans. Inf. Theory.

[13]  Venkatesan Guruswami,et al.  Efficiently Decodable Codes for the Binary Deletion Channel , 2017, APPROX-RANDOM.

[14]  Tolga M. Duman,et al.  An improvement of the deletion channel capacity upper bound , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[15]  Michael Mitzenmacher,et al.  Improved Lower Bounds for the Capacity of i.i.d. Deletion and Duplication Channels , 2007, IEEE Transactions on Information Theory.

[16]  Venkatesan Guruswami,et al.  Polynomial Time Decodable Codes for the Binary Deletion Channel , 2019, IEEE Transactions on Information Theory.

[17]  Michael Mitzenmacher,et al.  A Survey of Results for Deletion Channels and Related Synchronization Channels , 2008, SWAT.

[18]  Daniel Cullina,et al.  An improvement to Levenshtein's upper bound on the cardinality of deletion correcting codes , 2013, ISIT.

[19]  Adam Tauman Kalai,et al.  Tight asymptotic bounds for the deletion channel with small deletion probabilities , 2010, 2010 IEEE International Symposium on Information Theory.

[20]  Mahdi Cheraghchi Capacity upper bounds for deletion-type channels , 2018, STOC.

[21]  Ankur A. Kulkarni,et al.  Nonasymptotic Upper Bounds for Deletion Correcting Codes , 2012, IEEE Transactions on Information Theory.

[22]  Marco Dalai A new bound on the capacity of the binary deletion channel with high deletion probabilities , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[23]  Florham Park,et al.  On Transmission Over Deletion Channels , 2001 .

[24]  V. I. Levenshtein,et al.  Bounds for deletion/insertion correcting codes , 2002, Proceedings IEEE International Symposium on Information Theory,.

[25]  Venkatesan Guruswami,et al.  Optimal Rate Code Constructions for Computationally Simple Channels , 2016, J. ACM.

[26]  Michael Langberg,et al.  Oblivious Communication Channels and Their Capacity , 2008, IEEE Transactions on Information Theory.

[27]  Michael Langberg,et al.  A Characterization of the Capacity of Online (causal) Binary Channels , 2014, STOC.

[28]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[29]  Anand D. Sarwate,et al.  A bit of delay is sufficient and stochastic encoding is necessary to overcome online adversarial erasures , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).