Yariable-to-fixed length homophonie coding suitable for asymmetric channel coding

In communication through asymmetric channels the capacity-achieving input distribution is not uniform in general. Homophonic coding is a framework to invertibly convert a (usually uniform) message into a sequence with some target distribution, and is a promising candidate to generate codewords with the nonuniform target distribution for asymmetric channels. In particular, a Variable-to-Fixed length (VF) homophonic code can be used as a suitable component for channel codes to avoid decoding error propagation. However, the existing VF homo-phonic code requires the knowledge of the maximum relative gap of probabilities between two adjacent sequences beforehand, which is an unrealistic assumption for long block codes. In this paper we propose a new VF homophonic code without such a requirement by allowing one-symbol decoding delay. We evaluate this code theoretically and experimentally to verify its asymptotic optimality.

[1]  Jun Muramatsu,et al.  A construction of channel code, joint source-channel code, and universal code for arbitrary stationary memoryless channels using sparse matrices , 2008, 2008 IEEE International Symposium on Information Theory.

[2]  Rudolf Mathar,et al.  Operating LDPC codes with zero shaping gap , 2011, 2011 IEEE Information Theory Workshop.

[3]  Christoph G. Günther,et al.  A Universal Algorithm for Homophonic Coding , 1988, EUROCRYPT.

[4]  Junya Honda,et al.  Polar Coding Without Alphabet Extension for Asymmetric Models , 2013, IEEE Transactions on Information Theory.

[5]  Rudolf Mathar,et al.  Matching Dyadic Distributions to Channels , 2010, 2011 Data Compression Conference.

[6]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[7]  Rongke Liu,et al.  Construction of polar codes for channels with memory , 2015, 2015 IEEE Information Theory Workshop - Fall (ITW).

[8]  James L. Massey,et al.  An Information-Theoretic Treatment of Homophonic Substitution , 1990, EUROCRYPT.

[9]  Mamoru Hoshi,et al.  Interval algorithm for random number generation , 1997, IEEE Trans. Inf. Theory.

[10]  Mamoru Hoshi,et al.  Interval algorithm for homophonic coding , 2001, IEEE Trans. Inf. Theory.

[11]  Georg Böcherer,et al.  Fixed-to-variable length distribution matching , 2013, 2013 IEEE International Symposium on Information Theory.

[12]  Patrick Schulte,et al.  Constant Composition Distribution Matching , 2015, IEEE Transactions on Information Theory.

[13]  Junya Honda,et al.  Variable-to-fixed length homophonie coding with a modified Shannon-Fano-Elias code , 2016, 2016 International Symposium on Information Theory and Its Applications (ISITA).

[14]  Rüdiger L. Urbanke,et al.  How to achieve the capacity of asymmetric channels , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[15]  Rudolf Mathar,et al.  Capacity achieving probabilistic shaping for noisy and noiseless channels , 2012 .

[16]  Junya Honda,et al.  Efficient Polar and LDPC Coding for Asymmetric Channels and Sources , 2013 .