Successive refinement of information

The successive refinement of information consists of first approximating data using a few bits of information, then iteratively improving the approximation as more and more information is supplied. The goal is to achieve an optimal description at each stage. In general, an ongoing description which is rate-distortion optimal whenever it is interrupted is sought. It is shown that in order to achieve optimal successive refinement the necessary and sufficient conditions are that the solutions of the rate distortion problem can be written as a Markov chain. In particular, all finite alphabet signals with Hamming distortion satisfy these requirements. It is also shown that the same is true for Gaussian signals with squared error distortion and for Laplacian signals with absolute error distortion. A simple counterexample with absolute error distortion and a symmetric source distribution which shows that successive refinement is not always achievable is presented. >

[1]  V. Erokhin $\varepsilon $-Entropy of a Discrete Random Variable , 1958 .

[2]  Joel Max,et al.  Quantizing for minimum distortion , 1960, IRE Trans. Inf. Theory.

[3]  John T. Pinkston An application of rate-distortion theory to a converse to the coding theorem , 1969, IEEE Trans. Inf. Theory.

[4]  R. Gray Conditional Rate-Distortion Theory , 1972 .

[5]  R. Gray,et al.  A new class of lower bounds to information rates of stationary sources via conditional rate-distortion functions , 1973, IEEE Trans. Inf. Theory.

[6]  Robert M. Gray,et al.  Source coding for a simple network , 1974 .

[7]  L. Ozarow,et al.  On a source-coding problem with two channels and three receivers , 1980, The Bell System Technical Journal.

[8]  A. Wyner,et al.  Source coding for multiple descriptions , 1980, The Bell System Technical Journal.

[9]  Hirosuke Yamamoto,et al.  Source coding theory for cascade and branching communication systems , 1981, IEEE Trans. Inf. Theory.

[10]  H. Witsenhausen,et al.  Source coding for multiple descriptions II: A binary source , 1981, The Bell System Technical Journal.

[11]  Toby Berger,et al.  Rate-distortion for correlated sources with partially separated encoders , 1982, IEEE Trans. Inf. Theory.

[12]  Abbas El Gamal,et al.  Achievable rates for multiple descriptions , 1982, IEEE Trans. Inf. Theory.

[13]  Rudolf Ahlswede The rate-distortion region for multiple descriptions without excess rate , 1985, IEEE Trans. Inf. Theory.

[14]  Toby Berger,et al.  New results in binary multiple descriptions , 1987, IEEE Trans. Inf. Theory.

[15]  Philip A. Chou,et al.  Optimal pruning with applications to tree-structured source coding and modeling , 1989, IEEE Trans. Inf. Theory.

[16]  R. Gray,et al.  Variable rate vector quantization for medical image compression , 1990 .