Information Capacity of BSC and BEC Permutation Channels

In this paper, we describe and study the permutation channel model, which constitutes a discrete memoryless channel (DMC) followed by a random permutation block that reorders the output codeword of the DMC. This model naturally emerges in the context of communication networks, and coding theoretic aspects of such channels have been widely studied. In contrast to the bulk of this literature, we analyze the information theoretic aspects of the model by defining an appropriate notion of permutation channel capacity. We consider two special cases of the permutation channel model: the binary symmetric channel (BSC) and the binary erasure channel (BEC). We establish the permutation channel capacity of the BSC, and prove bounds on the permutation channel capacity of the BEC. Somewhat surprisingly, our results illustrate that permutation channel capacities are generally agnostic to the parameters that define the DMCs. Furthermore, our achievability proof yields a conceptually simple, computationally efficient, and capacity achieving coding scheme for the BSC permutation channel.

[1]  Steven P. Weber,et al.  Optimal Rate–Delay Tradeoffs and Delay Mitigating Codes for Multipath Routed and Network Coded Networks , 2009, IEEE Transactions on Information Theory.

[2]  Dejan Vukobratovic,et al.  Subset Codes for Packet Networks , 2013, IEEE Communications Letters.

[3]  Vincent Y. F. Tan,et al.  Codes in the Space of Multisets—Coding for Permutation Channels With Impairments , 2016, IEEE Transactions on Information Theory.

[4]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[5]  Yuhong Yang Elements of Information Theory (2nd ed.). Thomas M. Cover and Joy A. Thomas , 2008 .

[6]  John J. Metzner Simplification of Packet-Symbol Decoding With Errors, Deletions, Misordering of Packets, and No Sequence Numbers , 2009, IEEE Transactions on Information Theory.

[7]  Suhas Diggavi,et al.  On transmission over deletion channels , 2001 .

[8]  Alexandre B. Tsybakov,et al.  Introduction to Nonparametric Estimation , 2008, Springer series in statistics.

[9]  Geoffrey Grimmett,et al.  Percolation and disordered systems , 1997 .

[10]  Michael Mitzenmacher,et al.  Polynomial Time Low-Density Parity-Check Codes With Rates Very Close to the Capacity of the $q$-ary Random Deletion Channel for Large $q$ , 2006, IEEE Transactions on Information Theory.

[11]  Vincent Yan Fu Tan,et al.  Asymptotic Estimates in Information Theory with Non-Vanishing Error Probabilities , 2014, Found. Trends Commun. Inf. Theory.

[12]  Tomás Feder,et al.  Reliable computation by networks in the presence of noise , 1989, IEEE Trans. Inf. Theory.

[13]  R. Keener Theoretical Statistics: Topics for a Core Course , 2010 .

[14]  M. Gadouleau,et al.  Binary codes for packet error and packet loss correction in store and forward , 2010, 2010 International ITG Conference on Source and Channel Coding (SCC).

[15]  Y. Peres,et al.  Broadcasting on trees and the Ising model , 2000 .

[16]  Tingting Zhang,et al.  Variable shortened-and-punctured Reed-Solomon codes for packet loss protection , 2002, IEEE Trans. Broadcast..

[17]  D. G. Chapman,et al.  Minimum Variance Estimation Without Regularity Assumptions , 1951 .

[18]  Kannan Ramchandran,et al.  Fundamental limits of DNA storage systems , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[19]  J. Hammersley On Estimating Restricted Parameters , 1950 .

[20]  R. Gallager Information Theory and Reliable Communication , 1968 .

[21]  Abbas El Gamal,et al.  Lecture Notes on Network Information Theory , 2010, ArXiv.

[22]  D. Vukobratović,et al.  Perfect codes in the discrete simplex , 2013, Des. Codes Cryptogr..

[23]  Yaming Yu,et al.  Sharp Bounds on the Entropy of the Poisson Law and Related Quantities , 2010, IEEE Transactions on Information Theory.