On the minimum rate for strong universal block coding of a class of ergodic sources

For a class of ergodic sources \Lambda on a given finite alphabet satisfying certain conditions, a formula is given for the minimum rate above which strong universal fixed-rate and variable-rate block coding of \Lambda with respect to an arbitrary single-letter fidelity criterion can be done. The result extends several previous strong universal block coding theorems. As an application it is shown that there is a metric on the class of stationary sources weaker than \bar{d} -metric for which compactness of \Lambda in the metric implies that strong universal coding can be done at all rates.

[1]  David L. Neuhoff,et al.  Fixed-rate universal codes for Markov sources , 1978, IEEE Trans. Inf. Theory.

[2]  David L. Neuhoff,et al.  New results on coding of stationary nonergodic sources , 1979, IEEE Trans. Inf. Theory.

[3]  Michael B. Pursley,et al.  Variable rate coding for nonergodic sources and classes of ergodic sources subject to a fidelity constraint , 1976, IEEE Trans. Inf. Theory.

[4]  John C. Kieffer,et al.  A unified approach to weak universal source coding , 1978, IEEE Trans. Inf. Theory.

[5]  Jacob Ziv,et al.  Coding of sources with unknown statistics-II: Distortion relative to a fidelity criterion , 1972, IEEE Trans. Inf. Theory.

[6]  John C. Kieffer,et al.  Extension of source coding theorems for block codes to sliding-block codes , 1980, IEEE Trans. Inf. Theory.

[7]  Michael B. Pursley,et al.  Variable-rate universal block source coding subject to a fidelity constraint , 1978, IEEE Trans. Inf. Theory.

[8]  R. G. Gallager,et al.  Coding of Sources With Unknown Statistics- Part II: Distortion Relative to a Fidelity Criterion , 1972 .

[9]  K. Parthasarathy PROBABILITY MEASURES IN A METRIC SPACE , 1967 .

[10]  John C. Kieffer,et al.  Estimation of a Convex Real Parameter of an Unknown Information Source , 1979 .

[11]  Robert M. Gray,et al.  Source coding theorems without the ergodic assumption , 1974, IEEE Trans. Inf. Theory.

[12]  D. L. Hanson,et al.  On invariant probability measures. II. , 1960 .

[13]  Lee D. Davisson,et al.  Universal noiseless coding , 1973, IEEE Trans. Inf. Theory.

[14]  Karel Winkelbauer On the asymptotic rate of non-ergodic information sources , 1970, Kybernetika.

[15]  David L. Neuhoff,et al.  Fixed rate universal block source coding with a fidelity criterion , 1975, IEEE Trans. Inf. Theory.