Sending a lossy version of the innovations process is suboptimal in QG rate-distortion

In the critical range O < D les Dc, the MSE rate-distortion function of a time-discrete stationary autoregressive Gaussian source is equal to that of a related time-discrete i.i.d. Gaussian source. This suggests that perhaps an optimum encoder should compute the related memoryless sequence from the given source sequence with memory and then use a code of rate R(D) to convey the memoryless sequence to the decoder with an MSE of D. In this scenario, the question is, "for D les Dc can a D-admissible code for the original source be obtained via the R-D coding of the innovations process and additional post-processing at the decoder without having to provide any additional information of positive rate?" We show that the answer of this question often is "No"

[1]  Toby Berger,et al.  Information rates of Wiener processes , 1970, IEEE Trans. Inf. Theory.

[2]  Toby Berger,et al.  Lossy Source Coding , 1998, IEEE Trans. Inf. Theory.

[3]  D. A. Bell,et al.  Information Theory and Reliable Communication , 1969 .

[4]  R. Gray,et al.  A new class of lower bounds to information rates of stationary sources via conditional rate-distortion functions , 1973, IEEE Trans. Inf. Theory.

[5]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[6]  Mill Johannes G.A. Van,et al.  Transmission Of Information , 1961 .

[7]  Robert M. Gray,et al.  Information rates of autoregressive processes , 1970, IEEE Trans. Inf. Theory.

[8]  Robert M. Gray,et al.  On the asymptotic eigenvalue distribution of Toeplitz matrices , 1972, IEEE Trans. Inf. Theory.

[9]  Barry M. Leiner,et al.  Rate-distortion theory for ergodic sources with side information (Corresp.) , 1974, IEEE Trans. Inf. Theory.

[10]  Aaron D. Wyner,et al.  Coding Theorems for a Discrete Source With a Fidelity CriterionInstitute of Radio Engineers, International Convention Record, vol. 7, 1959. , 1993 .

[11]  B. McMillan The Basic Theorems of Information Theory , 1953 .

[12]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[13]  Sterling K. Berberian,et al.  Introduction to Hilbert Space , 1977 .

[14]  Barry M. Leiner Rate-distortion theory for sources with side information (Ph.D. Thesis abstr.) , 1974, IEEE Trans. Inf. Theory.

[15]  R. Hartley Transmission of information , 1928 .

[16]  U. Grenander,et al.  Toeplitz Forms And Their Applications , 1958 .

[17]  M. Zwaan An introduction to hilbert space , 1990 .

[18]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[19]  Toby Berger,et al.  Rate distortion theory : a mathematical basis for data compression , 1971 .

[20]  Aaron D. Wyner,et al.  Bounds on the rate-distortion function for stationary sources with memory , 1971, IEEE Trans. Inf. Theory.