On Lower Bounds for the Capacity of Deletion Channels

This correspondence considers binary deletion channels, where bits are deleted independently with probability d; it improves upon the framework used to analyze the capacity of binary deletion channels established by Diggavi and Grossglauser, improving on their lower bounds. Diggavi and Grossglauser considered codebooks with codewords generated by a first-order Markov chain. They only consider typical outputs, where an output is typical if an N bit input gives an N(1-d)(1-epsi) bit output. The improvements in this correspondence arise from two considerations. First, a stronger notion of a typical output from the channel is used, which yields better bounds even for the codebooks studied by Diggavi and Grossglauser. Second, codewords generated by more general processes than first-order Markov chains are considered

[1]  Gilbert G. Walter,et al.  A sampling theorem for wavelet subspaces , 1992, IEEE Trans. Inf. Theory.

[2]  O. Christensen A Paley-Wiener theorem for frames , 1995 .

[3]  O. Christensen,et al.  Perturbation of operators and applications to frame theory , 1997 .

[4]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[5]  O. Christensen Frames, Riesz bases, and discrete Gabor/wavelet expansions , 2001 .

[6]  Guizhong Liu,et al.  Frames and sampling theorems for translation-invariant subspaces , 2004, IEEE Signal Process. Lett..

[7]  Jeffrey D. Ullman,et al.  On the capabilities of codes to correct synchronization errors , 1967, IEEE Trans. Inf. Theory.

[8]  R. Young,et al.  An introduction to non-harmonic Fourier series , 2001 .

[9]  Amara Lynn Graps,et al.  An introduction to wavelets , 1995 .

[10]  Wenchang Sun,et al.  Sampling theorem for wavelet subspaces: error estimate and irregular sampling , 2000, IEEE Trans. Signal Process..

[11]  Shuichi Itoh,et al.  A sampling theorem for shift-invariant subspace , 1998, IEEE Trans. Signal Process..

[12]  Augustus J. E. M. Janssen,et al.  The Zak transform and sampling theorems for wavelet subspaces , 1993, IEEE Trans. Signal Process..

[13]  Shuichi Itoh,et al.  Irregular Sampling Theorems for Wavelet Subspaces , 1998, IEEE Trans. Inf. Theory.

[14]  John J. Benedetto,et al.  Multiresolution analysis frames with applications , 1993, 1993 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Aleksandar Kavcic,et al.  Insertion/deletion channels: reduced-state lower bounds on channel capacities , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[16]  Michael Mitzenmacher,et al.  Improved Lower Bounds for the Capacity of i.i.d. Deletion and Duplication Channels , 2007, IEEE Transactions on Information Theory.

[17]  Shuichi Itoh,et al.  On sampling in shift invariant spaces , 2002, IEEE Trans. Inf. Theory.

[18]  Michael Mitzenmacher,et al.  On lower bounds for the capacity of deletion channels , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[19]  Wen Chen,et al.  On Irregular Sampling in Wavelet Subspaces , 1997 .

[20]  Suhas N. Diggavi,et al.  On information transmission over a finite buffer channel , 2000, IEEE Transactions on Information Theory.

[21]  Florham Park,et al.  On Transmission Over Deletion Channels , 2001 .

[22]  Chun Zhao,et al.  Sampling theorem and irregular sampling theorem for multiwavelet subspaces , 2005, IEEE Transactions on Signal Processing.

[23]  Wenchang Sun,et al.  Frames and sampling theorem , 1998 .