Codes correcting deletions in oblivious and random models

We prove the existence of binary codes of positive rate that can correct an arbitrary pattern of $p$ fraction of deletions, for any $p 0$ and a code family with a randomized encoder $\mathsf{Enc}: \{0,1\}^{\mathcal{R} n} \to \{0,1\}^n$ and (deterministic) decoder $\mathsf{Dec}: \{0,1\}^{(1-p)n} \to \{0,1\}^{\mathcal{R} n}$ such that for all deletion patterns $\tau$ with $pn$ deletions and all messages $m \in \{0,1\}^{\mathcal{R} n}$, ${\textbf{Pr}} [ \mathsf{Dec}(\tau(\mathsf{Enc}(m))) \neq m ] \le o(1)$, where the probability is over the randomness of the encoder (which is private to the encoder and not known to the decoder). The oblivious model is a significant generalization of the random deletion channel where each bit is deleted independently with probability $p$. For the random deletion channel, existence of codes of rate $(1-p)/9$, and thus bounded away from $0$ for any $p 0$.

[1]  Michael Langberg,et al.  Oblivious Communication Channels and Their Capacity , 2008, IEEE Transactions on Information Theory.

[2]  Adam Tauman Kalai,et al.  Tight asymptotic bounds for the deletion channel with small deletion probabilities , 2010, 2010 IEEE International Symposium on Information Theory.

[3]  Prakash Narayan,et al.  Reliable Communication Under Channel Uncertainty , 1998, IEEE Trans. Inf. Theory.

[4]  Anand D. Sarwate,et al.  A bit of delay is sufficient and stochastic encoding is necessary to overcome online adversarial erasures , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[5]  Eleni Drinea,et al.  Directly lower bounding the information capacity for channels with I.I.D.deletions and duplications , 2010, IEEE Trans. Inf. Theory.

[6]  Venkatesan Guruswami,et al.  Deletion Codes in the High-Noise and High-Rate Regimes , 2014, IEEE Transactions on Information Theory.

[7]  Yashodhan Kanoria,et al.  Optimal Coding for the Binary Deletion Channel With Small Deletion Probability , 2013, IEEE Transactions on Information Theory.

[8]  Imre Csiszár,et al.  Capacity and decoding rules for classes of arbitrarily varying channels , 1989, IEEE Trans. Inf. Theory.

[9]  Imre Csiszár,et al.  Arbitrarily varying channels with constrained inputs and states , 1988, IEEE Trans. Inf. Theory.

[10]  Michael Langberg,et al.  A Characterization of the Capacity of Online (causal) Binary Channels , 2014, STOC.

[11]  Vladimir I. Levenshtein,et al.  Binary codes capable of correcting deletions, insertions, and reversals , 1965 .

[12]  Daniel Cullina,et al.  An improvement to Levenshtein's upper bound on the cardinality of deletion correcting codes , 2013, ISIT.

[13]  Venkatesan Guruswami,et al.  An Improved Bound on the Fraction of Correctable Deletions , 2015, IEEE Transactions on Information Theory.

[14]  Ankur A. Kulkarni,et al.  Nonasymptotic Upper Bounds for Deletion Correcting Codes , 2012, IEEE Transactions on Information Theory.

[15]  Marco Dalai A new bound on the capacity of the binary deletion channel with high deletion probabilities , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[16]  M. Mitzenmacher A survey of results for deletion channels and related synchronization channels , 2009 .

[17]  Vahid Tarokh,et al.  Bounds on the Capacity of Discrete Memoryless Channels Corrupted by Synchronization and Substitution Errors , 2012, IEEE Transactions on Information Theory.

[18]  Tolga M. Duman,et al.  An improvement of the deletion channel capacity upper bound , 2013, 2013 51st Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[19]  Dario Fertonani,et al.  Bounds on the Capacity of Channels with Insertions, Deletions and Substitutions , 2011, IEEE Transactions on Communications.

[20]  Michael Mitzenmacher,et al.  Improved Lower Bounds for the Capacity of i.i.d. Deletion and Duplication Channels , 2007, IEEE Transactions on Information Theory.

[21]  Suhas Diggavi,et al.  On transmission over deletion channels , 2001 .

[22]  V. I. Levenshtein,et al.  Bounds for deletion/insertion correcting codes , 2002, Proceedings IEEE International Symposium on Information Theory,.

[23]  Venkatesan Guruswami,et al.  Optimal Rate Code Constructions for Computationally Simple Channels , 2016, J. ACM.

[24]  Michael Mitzenmacher,et al.  On lower bounds for the capacity of deletion channels , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[25]  Venkatesan Guruswami,et al.  Efficiently decodable insertion/deletion codes for high-noise and high-rate regimes , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[26]  Michael Mitzenmacher,et al.  On the zero-error capacity threshold for deletion channels , 2011, 2011 Information Theory and Applications Workshop.