Polar Code Moderate Deviation: Recovering the Scaling Exponent

In 2008 Arikan proposed polar coding [arXiv:0807.3917] which we summarize as follows: (a) From the root channel $W$ synthesize recursively a series of channels $W_N^{(1)},\dotsc,W_N^{(N)}$. (b) Select sophisticatedly a subset $A$ of synthetic channels. (c) Transmit information using synthetic channels indexed by $A$ and freeze the remaining synthetic channels. Arikan gives each synthetic channel a score (called the Bhattacharyya parameter) that determines whether it should be selected or frozen. As $N$ grows, a majority of the scores are either very high or very low, i.e., they polarize. By characterizing how fast they polarize, Arikan showed that polar coding is able to produce a series of codes that achieve capacity on symmetric binary-input memoryless channels. In measuring how the scores polarize the relation among block length, gap to capacity, and block error probability are studied. In particular, the error exponent regime fixes the gap to capacity and varies the other two. The scaling exponent regime fixes the block error probability and varies the other two. The moderate deviation regime varies all three factors at once. The latest result [arxiv:1501.02444, Theorem 7] in the moderate deviation regime does not imply the scaling exponent regime as a special case. We give a result that does. (See Corollary 8.)

[1]  Gilles Zémor,et al.  Discrete Isoperimetric Inequalities and the Probability of a Decoding Error , 2000, Combinatorics, Probability and Computing.

[2]  Rüdiger L. Urbanke,et al.  Unified scaling of polar codes: Error exponent, scaling exponent, moderate deviations, and error floors , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[3]  Emre Telatar,et al.  On the rate of channel polarization , 2008, 2009 IEEE International Symposium on Information Theory.

[4]  Rüdiger L. Urbanke,et al.  Near-optimal finite-length scaling for polar codes over large alphabets , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[5]  Rüdiger L. Urbanke,et al.  Polar Codes: Characterization of Exponent, Bounds, and Constructions , 2010, IEEE Transactions on Information Theory.

[6]  Seyed Hamed Hassani Polarization and Spatial Coupling - Two Techniques to Boost Performance , 2013 .

[7]  Rüdiger L. Urbanke,et al.  Finite-Length Scaling for Polar Codes , 2013, IEEE Transactions on Information Theory.

[8]  Emre Telatar,et al.  On the correlation between polarized BECs , 2013, 2013 IEEE International Symposium on Information Theory.

[9]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[10]  Masahito Hayashi,et al.  Information Spectrum Approach to Second-Order Coding Rate in Channel Coding , 2008, IEEE Transactions on Information Theory.

[11]  R. Gallager Information Theory and Reliable Communication , 1968 .

[12]  R. Dobrushin Mathematical Problems in the Shannon Theory of Optimal Coding of Information , 1961 .

[13]  Erdal Arikan,et al.  Channel Polarization: A Method for Constructing Capacity-Achieving Codes for Symmetric Binary-Input Memoryless Channels , 2008, IEEE Transactions on Information Theory.

[14]  Rüdiger L. Urbanke,et al.  Modern Coding Theory , 2008 .

[15]  Arman Fazeli,et al.  On the scaling exponent of binary polarization kernels , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[16]  Robert G. Gallager,et al.  A simple derivation of the coding theorem and some applications , 1965, IEEE Trans. Inf. Theory.

[17]  Rudiger Urbanke,et al.  Scaling Exponent of List Decoders With Applications to Polar Codes , 2015, IEEE Trans. Inf. Theory.

[18]  Toshiyuki Tanaka,et al.  Rate-Dependent Analysis of the Asymptotic Behavior of Channel Polarization , 2011, IEEE Transactions on Information Theory.

[19]  Venkatesan Guruswami,et al.  Polar Codes: Speed of Polarization and Polynomial Gap to Capacity , 2013, 2013 IEEE 54th Annual Symposium on Foundations of Computer Science.

[20]  Andrea Montanari,et al.  An empirical scaling law for polar codes , 2010, 2010 IEEE International Symposium on Information Theory.

[21]  Arman Fazeli,et al.  Binary Linear Codes with Optimal Scaling and Quasi-Linear Complexity , 2017, ArXiv.

[22]  Venkatesan Guruswami,et al.  General strong polarization , 2018, Electron. Colloquium Comput. Complex..

[23]  David Burshtein,et al.  Improved Bounds on the Finite Length Scaling of Polar Codes , 2013, IEEE Transactions on Information Theory.

[24]  Toshiyuki Tanaka,et al.  Source and Channel Polarization Over Finite Fields and Reed–Solomon Matrices , 2012, IEEE Transactions on Information Theory.