Analysis of Sequential Decoding Complexity Using the Berry-Esseen Inequality

his study presents a novel technique to estimate the computational complexity of sequential decoding using the Berry-Esseen theorem. Unlike the theoretical bounds determined by the conventional central limit theorem argument, which often holds only for sufficiently large codeword length, the new bound obtained from the Berry-Esseen theorem is valid for any blocklength. The accuracy of the new bound is then examined for two sequential decoding algorithms, an ordering-free variant of the generalized Dijkstra's algorithm (GDA)(or simplified GDA) and the maximum-likelihood sequential decoding algorithm (MLSDA). Empirically investigating codes of small blocklength reveals that the theoretical upper bound for the simplified GDA almost matches the simulation results as the signal-to-noise ratio (SNR) per information bit ($\gamma_b$) is greater than or equal to 8 dB. However, the theoretical bound may become markedly higher than the simulated average complexity when $\gamma_b$ is small. For the MLSDA, the theoretical upper bound is quite close to the simulation results for both high SNR ($\gamma_b\geq 6$ dB) and low SNR ($\gamma_b\leq 2$ dB). Even for moderate SNR, the simulation results and the theoretical bound differ by at most \makeblue{0.8} on a $\log_{10}$ scale.

[1]  I. S. Shiganov Refinement of the upper bound of the constant in the central limit theorem , 1986 .

[2]  Yair Be'ery,et al.  Optimal soft decision block decoders based on fast Hadamard transform , 1986, IEEE Trans. Inf. Theory.

[3]  Yunghsiang Sam Han,et al.  Decoding Linear Block Codes Using a Priority-First Search : Performance Analysis and Suboptimal Version , 1998, IEEE Trans. Inf. Theory.

[4]  Frank R. Kschischang,et al.  A Sequential Decoder for Linear Block Codes with a Variable Bias-Term Metric , 1998, IEEE Trans. Inf. Theory.

[5]  Yunghsiang Sam Han,et al.  Efficient priority-first search maximum-likelihood soft-decision decoding of linear block codes , 1993, IEEE Trans. Inf. Theory.

[6]  John E. Savage,et al.  Sequential decoding — the computation problem , 1966 .

[7]  Frederick Jelinek,et al.  An upper bound on moments of sequential decoding effort , 1969, IEEE Trans. Inf. Theory.

[8]  Samuel Dolinar,et al.  A* decoding of block codes , 1996, IEEE Trans. Commun..

[9]  Patrick G. Farrell,et al.  On Hybrid Stack Decoding Algorithms for Block Codes , 1998, IEEE Trans. Inf. Theory.

[10]  Shu Lin,et al.  Error control coding : fundamentals and applications , 1983 .

[11]  Vladimir V. Senatov Normal Approximation: New Results, Methods and Problems , 1998 .

[12]  F. Jelinek Fast sequential decoding algorithm using a stack , 1969 .

[13]  Elwyn R. Berlekamp,et al.  A lower bound to the distribution of computation for sequential decoding , 1967, IEEE Trans. Inf. Theory.

[14]  Chilukuri K. Mohan,et al.  Efficient Heuristic Search Algorithms for Soft-Decision Decoding of Linear Block Codes , 1998, IEEE Trans. Inf. Theory.

[15]  Yunghsiang Sam Han A New Treatment of Priority-First Search Maximum-Likelihood Soft-Decision Decoding of Linear Block Codes , 1998, IEEE Trans. Inf. Theory.

[16]  PIERRE R. CHEVILLAT,et al.  An analysis of sequential decoding for specific time-invariant convolutional codes , 1978, IEEE Trans. Inf. Theory.

[17]  Feller William,et al.  An Introduction To Probability Theory And Its Applications , 1950 .

[18]  Rolf Johannesson,et al.  On the distribution of the number of computations in any finite number of subtrees for the stack algorithm , 1985, IEEE Trans. Inf. Theory.

[19]  Po-Ning Chen,et al.  Sequential Decoding of Convolutional Codes , 2003 .

[20]  Rolf Johannesson On the distribution of computation for sequential decoding using the stack algorithm , 1979, IEEE Trans. Inf. Theory.

[21]  Jakov Snyders,et al.  Reliability-based code-search algorithms for maximum-likelihood decoding of block codes , 1997, IEEE Trans. Inf. Theory.

[22]  Yunghsiang Sam Han,et al.  A maximum-likelihood soft-decision sequential decoding algorithm for binary convolutional codes , 2002, IEEE Trans. Commun..

[23]  P. V. Beek,et al.  An application of Fourier methods to the problem of sharpening the Berry-Esseen inequality , 1972 .

[24]  Alexander Vardy,et al.  Bit-level soft-decision decoding of Reed-Solomon codes , 1991, IEEE Trans. Commun..

[25]  David Haccoun A branching process analysis of the average number of computations of the stack algorithm , 1984, IEEE Trans. Inf. Theory.

[26]  G. David Forney,et al.  Convolutional Codes III. Sequential Decoding , 1974, Inf. Control..