Explicit Polar Codes with Small Scaling Exponent

Polar coding gives rise to the first explicit family of codes that provably achieve capacity for a wide range of channels with efficient encoding and decoding. But how fast can polar coding approach capacity as a function of the code length? In finite-length analysis, the scaling between code length and the gap to capacity is usually measured in terms of the scaling exponent µ. It is well known that the optimal scaling exponent, achieved by random binary codes, is µ = 2. It is also well known that the scaling exponent of conventional polar codes on the binary erasure channel (BEC) is µ = 3.627, which falls far short of the optimal value. On the other hand, it was recently shown that polar codes derived from ℓ × ℓ binary polarization kernels approach the optimal scaling exponent µ = 2 on the BEC as ℓ→∞, with high probability over a random choice of the kernel.Herein, we focus on explicit constructions of ℓ×ℓ binary kernels with small scaling exponent for ℓ ⩽ 64. In particular, we exhibit a sequence of binary linear codes that approaches capacity on the BEC with quasi-linear complexity and scaling exponent µ < 3. To the best of our knowledge, such a sequence of codes was not previously known to exist. The principal challenges in establishing our results are twofold: how to construct such kernels and how to evaluate their scaling exponent.In a single polarization step, an ℓ×ℓ kernel Kℓ transforms an underlying BEC into ℓ bit-channels W1, W2,…, Wℓ. The erasure probabilities of W1, W2,…, Wℓ, known as the polarization behavior of Kℓ, determine the resulting scaling exponent µ(Kℓ). We first introduce a class of self-dual binary kernels and prove that their polarization behavior satisfies a strong symmetry property. This reduces the problem of constructing Kℓ to that of producing a certain nested chain of only ℓ/2 self-orthogonal codes. We use nested cyclic codes, whose distance is as high as possible subject to the orthogonality constraint, to construct the kernels K32 and K64. In order to evaluate the polarization behavior of K32 and K64, two alternative trellis representations (which may be of independent interest) are proposed. Using the resulting trellises, we show that µ(K32) = 3.122 and explicitly compute over half of the polarization-behavior coefficients for K64, at which point the complexity becomes prohibitive. To complete the computation, we introduce a Monte-Carlo interpolation method, which produces the estimate µ(K64) ≃ 2.87. We augment this estimate with a rigorous proof that µ(K64) < 2.97.

[1]  Hessam Mahdavifar Fast Polarization and Finite-Length Scaling for Non-Stationary Channels , 2016, ArXiv.

[2]  Paul H. Siegel,et al.  Permuted successive cancellation decoding for polar codes , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[3]  Peter Trifonov,et al.  Efficient decoding of polar codes with some 16×16 kernels , 2018, 2018 IEEE Information Theory Workshop (ITW).

[4]  Rüdiger L. Urbanke,et al.  Unified scaling of polar codes: Error exponent, scaling exponent, moderate deviations, and error floors , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[5]  Arman Fazeli,et al.  Binary Linear Codes with Optimal Scaling: Polar Codes with Large Kernels , 2017, 2018 IEEE Information Theory Workshop (ITW).

[6]  Rüdiger L. Urbanke,et al.  Near-optimal finite-length scaling for polar codes over large alphabets , 2016, 2016 IEEE International Symposium on Information Theory (ISIT).

[7]  Rüdiger L. Urbanke,et al.  Polar codes: Characterization of exponent, bounds, and constructions , 2009, 2009 IEEE International Symposium on Information Theory.

[8]  Hessam Mahdavifar,et al.  Polar Coding for Non-Stationary Channels , 2016, IEEE Transactions on Information Theory.

[9]  Erdal Arikan,et al.  Channel Polarization: A Method for Constructing Capacity-Achieving Codes for Symmetric Binary-Input Memoryless Channels , 2008, IEEE Transactions on Information Theory.

[10]  H. Vincent Poor,et al.  Channel Coding Rate in the Finite Blocklength Regime , 2010, IEEE Transactions on Information Theory.

[11]  Vera Miloslavskaya,et al.  Design of binary polar codes with arbitrary kernel , 2012, 2012 IEEE Information Theory Workshop.

[12]  Arman Fazeli,et al.  Binary Linear Codes with Optimal Scaling and Quasi-Linear Complexity , 2017, ArXiv.

[13]  Rüdiger L. Urbanke,et al.  Finite-Length Scaling for Polar Codes , 2013, IEEE Transactions on Information Theory.

[14]  Arman Fazeli,et al.  On the scaling exponent of binary polarization kernels , 2014, 2014 52nd Annual Allerton Conference on Communication, Control, and Computing (Allerton).