Distance-spectrum formulas on the largest minimum distance of block codes

A general formula for the asymptotic largest minimum distance (in block length) of deterministic block codes under generalized distance functions (not necessarily additive, symmetric, and bounded) is presented. As revealed in the formula, the largest minimum distance can be fully determined by the ultimate statistical characteristics of the normalized distance function evaluated under a properly chosen random-code generating distribution. Interestingly, the new formula has an analogous form to the general information-spectrum expressions of the channel capacity and the optimistic channel capacity, respectively derived by Verdu and Han (1994) and Chen and Alajaji (1998, 1999). As a result, a minor class of distance functions for which the largest minimum distance can be derived is characterized. A general Varshamov-Gilbert lower bound is next addressed. Some discussions on the tightness of the general Varshamov-Gilbert bound are also provided. Finally, lower bounds on the largest minimum distances for several specific block coding schemes are rederived in terms of the new formulas, followed by comparisons with the known results devoted to the same codes.

[1]  Victor Zinoviev,et al.  An improvement of the Gilbert bound for constant weight codes , 1987, IEEE Trans. Inf. Theory.

[2]  Victor D. Kolesnik,et al.  Generating functions and lower bounds on rates for limited error-correcting codes , 1991, IEEE Trans. Inf. Theory.

[3]  J. H. Lint,et al.  Introduction to coding theory and algebraic geometry , 1989 .

[4]  Jack K. Wolf,et al.  On runlength codes , 1988, IEEE Trans. Inf. Theory.

[5]  Jim K. Omura On general Gilbert bounds , 1973, IEEE Trans. Inf. Theory.

[6]  Po-Ning Chen General formulas for the Neyman-Pearson type-II error exponent subject to fixed and exponential type-I error bounds , 1996, IEEE Trans. Inf. Theory.

[7]  F. Alajaji,et al.  On the optimistic capacity of arbitrary channels , 1998, Proceedings. 1998 IEEE International Symposium on Information Theory (Cat. No.98CH36252).

[8]  V. Blinovsky,et al.  Asymptotic Combinatorial Coding Theory , 1997 .

[9]  R. A. Silverman,et al.  Introductory Real Analysis , 1972 .

[10]  James A. Bucklew,et al.  Large Deviation Techniques in Decision, Simulation, and Estimation , 1990 .

[11]  Brian H. Marcus,et al.  Improved Gilbert-Varshamov bound for constrained systems , 1992, IEEE Trans. Inf. Theory.

[12]  C. L. Chen On a (145, 32) binary cyclic code , 1999, IEEE Trans. Inf. Theory.

[13]  Po-Ning Chen Generalization of Gártner-Ellis Theorem , 2000, IEEE Trans. Inf. Theory.

[14]  Sergio Verdú,et al.  A general formula for channel capacity , 1994, IEEE Trans. Inf. Theory.

[15]  Mikhail Deza,et al.  Some results related to generalized Varshamov-Gilbert bounds (Corresp.) , 1977, IEEE Trans. Inf. Theory.

[16]  G. Parmigiani Large Deviation Techniques in Decision, Simulation and Estimation , 1992 .

[17]  Patrick Billingsley,et al.  Probability and Measure. , 1986 .

[18]  O. Antoine,et al.  Theory of Error-correcting Codes , 2022 .

[19]  Richard E. Blahut,et al.  Principles and practice of information theory , 1987 .

[20]  R. Gallager Information Theory and Reliable Communication , 1968 .

[21]  H. Vincent Poor,et al.  A lower bound on the probability of error in multihypothesis testing , 1995, IEEE Trans. Inf. Theory.

[22]  N. J. A. Sloane,et al.  Lower bounds for constant weight codes , 1980, IEEE Trans. Inf. Theory.

[23]  Simon Litsyn,et al.  A note on lower bounds , 1986, IEEE Trans. Inf. Theory.

[24]  Ludo M. G. M. Tolhuizen,et al.  The generalized Gilbert-Varshamov bound is implied by Turan's theorem [code construction] , 1997, IEEE Trans. Inf. Theory.

[25]  Sergio Verdú,et al.  Approximation theory of output statistics , 1993, IEEE Trans. Inf. Theory.

[26]  Fady Alajaji,et al.  Optimistic Shannon coding theorems for arbitrary single-user systems , 1999, IEEE Trans. Inf. Theory.

[27]  Jian Gu,et al.  A generalized Gilbert-Varshamov bound derived via analysis of a code-search algorithm , 1993, IEEE Trans. Inf. Theory.