Joint Source-Channel Coding With Time-Varying Channel and Side-Information

Transmission of a Gaussian source over a time-varying Gaussian channel is studied in the presence of time-varying correlated side information at the receiver. A block fading model is considered for both the channel and the side information, whose states are assumed to be known only at the receiver. The optimality of separate source and channel coding in terms of average end-to-end distortion is shown when the channel is static, while the side information state follows a discrete or a continuous and quasiconcave distribution. When both the channel and side information states are time-varying, separate source and channel coding is suboptimal in general. A partially informed encoder lower bound is studied by providing the channel state information to the encoder. Several achievable transmission schemes are proposed based on uncoded transmission, separate source and channel coding, joint decoding, and hybrid digital-analog transmission. Uncoded transmission is shown to be optimal for a class of continuous and quasiconcave side information state distributions, while the channel gain may have an arbitrary distribution. To the best of our knowledge, this is the first example, in which the uncoded transmission achieves the optimal performance thanks to the time-varying nature of the states, while it is suboptimal in the static version of the same problem. Then, the optimal distortion exponent, which quantifies the exponential decay rate of the expected distortion in the high SNR regime, is characterized for Nakagami distributed channel and side information states, and it is shown to be achieved by hybrid digital-analog and joint decoding schemes in certain cases, illustrating the suboptimality of pure digital or analog transmission in general.

[1]  Giuseppe Caire,et al.  On the Distortion SNR Exponent of Hybrid Digital–Analog Space–Time Coding , 2007, IEEE Transactions on Information Theory.

[2]  Amos Lapidoth,et al.  Sending a bivariate Gaussian over a Gaussian MAC , 2010, IEEE Trans. Inf. Theory.

[3]  Toby Berger,et al.  Rate distortion when side information may be absent , 1985, IEEE Trans. Inf. Theory.

[4]  Michael Gastpar,et al.  To code, or not to code: lossy source-channel communication revisited , 2003, IEEE Trans. Inf. Theory.

[5]  Amos Lapidoth,et al.  Sending a Bivariate Gaussian Over a Gaussian MAC , 2010, IEEE Transactions on Information Theory.

[6]  Deniz Gündüz,et al.  Gaussian joint source-channel coding for the strong interference channel , 2015, 2015 IEEE Information Theory Workshop (ITW).

[7]  Deniz Gündüz,et al.  Expected Distortion with Fading Channel and Side Information Quality , 2011, 2011 IEEE International Conference on Communications (ICC).

[8]  Nam C. Phamdo,et al.  Hybrid digital-analog (HDA) joint source-channel codes for broadcasting and robust communications , 2002, IEEE Trans. Inf. Theory.

[9]  Michael Gastpar,et al.  Uncoded transmission is exactly optimal for a simple Gaussian "sensor" network , 2008, 2007 Information Theory and Applications Workshop.

[10]  Suhas N. Diggavi,et al.  The Achievable Distortion Region of Sending a Bivariate Gaussian Source on the Gaussian Broadcast Channel , 2011, IEEE Transactions on Information Theory.

[11]  Thomas J. Goblick,et al.  Theoretical limitations on the transmission of data from analog sources , 1965, IEEE Trans. Inf. Theory.

[12]  Gregory W. Wornell,et al.  Source-channel diversity for parallel channels , 2004, IEEE Transactions on Information Theory.

[13]  Yu-Chih Huang,et al.  Joint Source-Channel Coding with Correlated Interference , 2012, IEEE Transactions on Communications.

[14]  Deniz Gündüz,et al.  Distortion exponent in fading MIMO channels with time-varying side information , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[15]  Deniz Gündüz,et al.  Joint Source–Channel Codes for MIMO Block-Fading Channels , 2008, IEEE Transactions on Information Theory.

[16]  L. Goddard Information Theory , 1962, Nature.

[17]  Daniela Tuninetti,et al.  The Impact of Side-Information on Gaussian Source Transmission over Block-Fading Channels , 2010, 2010 IEEE International Conference on Communications.

[18]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[19]  J. Wolfowitz The rate distortion function for source coding with side information at the decoder , 1979 .

[20]  Deniz Gündüz,et al.  Systematic lossy source transmission over Gaussian time-varying channels , 2013, 2013 IEEE International Symposium on Information Theory.

[21]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[22]  Giuseppe Caire,et al.  On the Distortion SNR Exponent of Some Layered Transmission Schemes , 2008, IEEE Transactions on Information Theory.

[23]  Ertem Tuncel Lossless joint source-channel coding across broadcast channels with decoder side information , 2005, Proceedings. International Symposium on Information Theory, 2005. ISIT 2005..

[24]  Ertem Tuncel,et al.  Gaussian HDA coding with bandwidth expansion and side information at the decoder , 2013, 2013 IEEE International Symposium on Information Theory.

[25]  Morteza Varasteh,et al.  Optimal HDA Schemes for Transmission of a Gaussian Source Over a Gaussian Channel With Bandwidth Compression in the Presence of an Interference , 2012, IEEE Transactions on Signal Processing.

[26]  Hamid Jafarkhani,et al.  Optimal Layered Transmission Over Quasi-Static Fading Channels , 2006, 2006 IEEE International Symposium on Information Theory.

[27]  Giuseppe Caire,et al.  Joint Source Channel Coding With Side Information Using Hybrid Digital Analog Codes , 2007, IEEE Transactions on Information Theory.

[28]  Deniz Gündüz,et al.  Wyner–Ziv Coding Over Broadcast Channels: Digital Schemes , 2009, IEEE Transactions on Information Theory.

[29]  Chris T. K. Ng,et al.  Minimum Expected Distortion in Gaussian Source Coding with Uncertain Side Information , 2007, 2007 IEEE Information Theory Workshop.

[30]  Amir Dembo,et al.  Large Deviations Techniques and Applications , 1998 .

[31]  Neri Merhav,et al.  On hierarchical joint source-channel coding with degraded side information , 2006, IEEE Transactions on Information Theory.

[32]  Sung Hoon Lim,et al.  A Unified Approach to Hybrid Coding , 2015, IEEE Transactions on Information Theory.

[33]  H. Behroozi,et al.  On the transmission of a Gaussian source over an AWGN channel with correlated interference , 2011, 2011 12th Canadian Workshop on Information Theory.

[34]  Suhas N. Diggavi,et al.  Successive Refinement Via Broadcast: Optimizing Expected Distortion of a Gaussian Source Over a Gaussian Fading Channel , 2008, IEEE Transactions on Information Theory.

[35]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[36]  Thomas M. Cover,et al.  Network Information Theory , 2001 .

[37]  Andrea J. Goldsmith,et al.  Reliable Joint Source-Channel Cooperative Transmission Over Relay Networks , 2013, IEEE Transactions on Information Theory.

[38]  Shlomo Shamai,et al.  Systematic Lossy Source/Channel Coding , 1998, IEEE Trans. Inf. Theory.

[39]  Abbas El Gamal,et al.  Network Information Theory , 2021, 2021 IEEE 3rd International Conference on Advanced Trends in Information Theory (ATIT).

[40]  Lizhong Zheng,et al.  Diversity and multiplexing: a fundamental tradeoff in multiple-antenna channels , 2003, IEEE Trans. Inf. Theory.

[41]  Andrea J. Goldsmith,et al.  Distortion Minimization in Gaussian Layered Broadcast Coding With Successive Refinement , 2007, IEEE Transactions on Information Theory.

[42]  Shlomo Shamai,et al.  Minimum Expected Distortion in Gaussian Source Coding With Fading Side Information , 2008, IEEE Transactions on Information Theory.

[43]  Ertem Tuncel,et al.  Slepian-Wolf coding over broadcast channels , 2006, IEEE Transactions on Information Theory.