Shows that for any sequence /spl rho/(n)=o(n) and any sequence of prefix codes, there is a B-process of entropy arbitrarily close to the maximum possible entropy for which the expected redundancy is at least as large as /spl rho/(n) for infinitely many n. This extends work of Shields (1993), whose examples had O entropy. The class of B-processes, that is, stationary codings of independent and identically distributed (i.i.d.) processes, includes the aperiodic Markov chains and functions thereof, aperiodic renewal and regenerative processes, and m-dependent processes, as well as many other processes of interest. In particular, the results show that the search for a universal redundancy rate for the class of all B-processes is doomed to failure, and redundancy rates for any given subclass must be obtained by direct analysis of that subclass. >
[1]
Paul C. Shields,et al.
Universal redundancy rates do not exist
,
1993,
IEEE Trans. Inf. Theory.
[2]
Lee D. Davisson,et al.
Universal noiseless coding
,
1973,
IEEE Trans. Inf. Theory.
[3]
David L. Neuhoff,et al.
Process definitions of distortion-rate functions and source coding theorems
,
1975,
IEEE Trans. Inf. Theory.
[4]
Benjamin Weiss,et al.
Entropy and isomorphism theorems for actions of amenable groups
,
1987
.
[5]
Paul C. Shields,et al.
Stationary coding of processes
,
1979,
IEEE Trans. Inf. Theory.