Distortion Minimization in Gaussian Source Coding with Fading Side Information

We consider a layered approach to source coding that minimiz es expected distortion when side information is available through a fading channel. Specifically, we assu me a Gaussian source encoder whereby the decoder receives a compressed version of the symbol at a given rate, a s well as an uncompressed version over a separate side-information channel with slow fading and noise. The de coder knows the realization of the slow fading but the encoder knows only its distribution. We consider a layer ed encoding strategy with a base layer describing the source assuming worst-case fading on the side-information cha nel, and subsequent layers describing the source under better fading conditions. Optimization of the layeri ng scheme utilizes the Heegard–Berger rate-distortion function that describes the rate required to meet a differen t distortion constraint for each fading state. The expected distortion minimization is formulated as a convex optimiza tion problem in which the problem size is shown to be linear in the number fading states. At an asymptotically l arge encoding rate, we showed that the distortion exponent is independent of the side-information fading dis tribution. Under a wide class of fading distributions such as Rayleigh, Rician, Nakagami, and log-normal, it is ob erved that the optimal rate allocation concentrates approximately at a single layer. Moreover, we showed that a c ontinuous rate allocation is not necessary for optimal expected distortion. Hence for a practical source coding sc heme, the encoder only needs to target a single sideinformation channel condition. Index Terms Source coding, distortion, Heegard–Berger, side informat ion, fading channel, convex optimization.

[1]  Andrea J. Goldsmith,et al.  Recursive Power Allocation in Gaussian Layered Broadcast Coding with Successive Refinement , 2007, 2007 IEEE International Conference on Communications.

[2]  Gordon L. Stüber Principles of mobile communication , 1996 .

[3]  Shlomo Shamai,et al.  Systematic Lossy Source/Channel Coding , 1998, IEEE Trans. Inf. Theory.

[4]  Meir Feder,et al.  Source broadcasting with unknown amount of receiver side information , 2002, Proceedings of the IEEE Information Theory Workshop.

[5]  Amiram H. Kaspi,et al.  Rate-distortion function when side-information may be present at the decoder , 1994, IEEE Trans. Inf. Theory.

[6]  Neri Merhav,et al.  On successive refinement for the Wyner-Ziv problem , 2004, ISIT.

[7]  Shlomo Shamai,et al.  A broadcast approach for a single-user slowly fading MIMO channel , 2003, IEEE Trans. Inf. Theory.

[8]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[9]  Deniz Gündüz,et al.  Wyner-Ziv coding over broadcast channels using hybrid digital/analog transmission , 2008, 2008 IEEE International Symposium on Information Theory.

[10]  Suhas N. Diggavi,et al.  Successive Refinement Via Broadcast: Optimizing Expected Distortion of a Gaussian Source Over a Gaussian Fading Channel , 2008, IEEE Transactions on Information Theory.

[11]  Michael Fleming,et al.  On rate-distortion with mixed types of side information , 2003, IEEE Transactions on Information Theory.

[12]  M. Feder,et al.  Static broadcasting , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[13]  R. Gray,et al.  A new class of lower bounds to information rates of stationary sources via conditional rate-distortion functions , 1973, IEEE Trans. Inf. Theory.

[14]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[15]  S. Brendle,et al.  Calculus of Variations , 1927, Nature.

[16]  Toby Berger,et al.  Rate distortion when side information may be absent , 1985, IEEE Trans. Inf. Theory.

[17]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[18]  Gregory W. Wornell,et al.  Source-channel diversity for parallel channels , 2004, IEEE Transactions on Information Theory.

[19]  Suhas N. Diggavi,et al.  Multistage successive refinement for Wyner-Ziv source coding with degraded side informations , 2006, 2006 IEEE International Symposium on Information Theory.

[20]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[21]  Andrea J. Goldsmith,et al.  Minimum Expected Distortion in Gaussian Layered Broadcast Coding with Successive Refinement , 2007, 2007 IEEE International Symposium on Information Theory.

[22]  Suhas N. Diggavi,et al.  Side-Information Scalable Source Coding , 2007, IEEE Transactions on Information Theory.

[23]  Shlomo Shamai,et al.  Oblivious Cooperation of Wireless Colocated Transmitters , 2007, 2007 5th International Symposium on Modeling and Optimization in Mobile, Ad Hoc and Wireless Networks and Workshops.

[24]  Ram Zamir,et al.  The rate loss in the Wyner-Ziv problem , 1996, IEEE Trans. Inf. Theory.

[25]  Neri Merhav,et al.  On successive refinement for the Wyner-Ziv problem , 2004, IEEE Transactions on Information Theory.