Hybrid Coding: An Interface for Joint Source-Channel Coding and Network Communication

A new approach to joint source‐channel coding is presented in the context of communicating correlated sources over multiple access channels. Similar to the separation architecture, the joint source‐ channel coding system architecture in this approach is modular, whereby the source encoding and channel decoding operations are decoupled. However, unlike the separation architecture, the same codeword is used for both source coding and channel coding, which allows the resulting hybrid coding scheme to achieve the performance of the best known joint source‐channel coding schemes. Applications of the proposed architecture to relay communication are also discussed.

[1]  Lihua Song,et al.  A separation theorem for single-source network coding , 2006, IEEE Transactions on Information Theory.

[2]  Mikael Skoglund,et al.  On Instantaneous Relaying , 2010, IEEE Transactions on Information Theory.

[3]  Alon Orlitsky,et al.  Coding for computing , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[4]  Amos Lapidoth,et al.  Sending a Bivariate Gaussian Source Over a Gaussian MAC With Feedback , 2007, IEEE Transactions on Information Theory.

[5]  Shlomo Shamai,et al.  Outer bounds on the admissible source region for broadcast channels with dependent sources , 2009, 2009 Information Theory and Applications Workshop.

[6]  Amos Lapidoth,et al.  Sending a bivariate Gaussian over a Gaussian MAC , 2010, IEEE Trans. Inf. Theory.

[7]  Ertem Tuncel,et al.  Wyner-Ziv Coding Over Broadcast Channels: Hybrid Digital/Analog Schemes , 2011, IEEE Transactions on Information Theory.

[8]  Deniz Gündüz,et al.  Wyner–Ziv Coding Over Broadcast Channels: Digital Schemes , 2009, IEEE Transactions on Information Theory.

[9]  Sanjoy K. Mitter,et al.  Communication to within a fidelity criterion over unknown networks by reduction to reliable communication problems over unknown networks , 2010, ArXiv.

[10]  Sui Tung,et al.  Multiterminal source coding (Ph.D. Thesis abstr.) , 1978, IEEE Trans. Inf. Theory.

[11]  Robert M. Gray,et al.  Source coding for a simple network , 1974 .

[12]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[13]  J. Wolfowitz.  The rate distortion function for source coding with side information at the decoder , 1979 .

[14]  Aditya Ramamoorthy,et al.  Separating distributed source coding from network coding , 2006, IEEE Transactions on Information Theory.

[15]  Yasutada Oohama,et al.  Rate-distortion theory for Gaussian multiterminal source coding systems with several side informations at the decoder , 2005, IEEE Transactions on Information Theory.

[16]  Abbas El Gamal,et al.  Network Information Theory , 2021, 2021 IEEE 3rd International Conference on Advanced Trends in Information Theory (ATIT).

[17]  Vinod M. Prabhakaran,et al.  Rate region of the quadratic Gaussian CEO problem , 2004, International Symposium onInformation Theory, 2004. ISIT 2004. Proceedings..

[18]  Vinod Sharma,et al.  Distributed joint source channel coding on a multiple access channel with side information , 2008, 2008 IEEE International Symposium on Information Theory.

[19]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[20]  Thomas J. Goblick,et al.  Theoretical limitations on the transmission of data from analog sources , 1965, IEEE Trans. Inf. Theory.

[21]  Suhas N. Diggavi,et al.  Optimality and Approximate Optimality of Source-Channel Separation in Networks , 2010, IEEE Transactions on Information Theory.

[22]  H. Witsenhausen.  ON SEQUENCES OF PAIRS OF DEPENDENT RANDOM VARIABLES , 1975 .

[23]  Wei Liu,et al.  Interference Channels With Arbitrarily Correlated Sources , 2011, IEEE Transactions on Information Theory.

[24]  Giuseppe Caire,et al.  Joint Source Channel Coding With Side Information Using Hybrid Digital Analog Codes , 2007, IEEE Transactions on Information Theory.

[25]  Toby Berger,et al.  The quadratic Gaussian CEO problem , 1997, IEEE Trans. Inf. Theory.

[26]  Andrea J. Goldsmith,et al.  Source and Channel Coding for Correlated Sources Over Multiuser Channels , 2008, IEEE Transactions on Information Theory.

[27]  Gregory W. Wornell,et al.  Cooperative diversity in wireless networks: Efficient protocols and outage behavior , 2004, IEEE Transactions on Information Theory.

[28]  Shirin Jalali,et al.  On the separation of lossy source-network coding and channel coding in wireline networks , 2010, 2010 IEEE International Symposium on Information Theory.

[29]  Michael Gastpar,et al.  Computation Over Multiple-Access Channels , 2007, IEEE Transactions on Information Theory.

[30]  Shlomo Shamai,et al.  Optimality and Approximate Optimality of Source-Channel Separation in Networks , 2014, IEEE Trans. Inf. Theory.

[31]  Max H. M. Costa,et al.  Broadcast channels with arbitrarily correlated sources , 1987, IEEE Trans. Inf. Theory.

[32]  R. Gallager,et al.  The Gaussian parallel relay network , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[33]  Sriram Vishwanath,et al.  Hybrid coding for Gaussian broadcast channels with Gaussian sources , 2009, 2009 IEEE International Symposium on Information Theory.

[34]  Armin Wittneben,et al.  Achievable Rate Regions for the Two-way Relay Channel , 2006, 2006 IEEE International Symposium on Information Theory.

[35]  Aaron D. Wyner,et al.  Coding Theorems for a Discrete Source With a Fidelity CriterionInstitute of Radio Engineers, International Convention Record, vol. 7, 1959. , 1993 .

[36]  Sae-Young Chung,et al.  Capacity of the Gaussian Two-Way Relay Channel to Within ${1\over 2}$ Bit , 2009, IEEE Transactions on Information Theory.

[37]  Sung Hoon Lim,et al.  Lossy communication of correlated sources over multiple access channels , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[38]  Gerhard Kramer,et al.  Comments on “broadcast channels with arbitrarily correlated sources” , 2009, 2009 IEEE International Symposium on Information Theory.

[39]  Andrea J. Goldsmith,et al.  Reliable Joint Source-Channel Cooperative Transmission Over Relay Networks , 2013, IEEE Transactions on Information Theory.

[40]  Edward C. van der Meulen,et al.  Reliable transmission of two correlated sources over an asymmetric multiple-access channel , 1987, IEEE Trans. Inf. Theory.

[41]  H. Vincent Poor,et al.  Energy-Distortion Tradeoffs in Gaussian Joint Source-Channel Coding Problems , 2012, IEEE Transactions on Information Theory.

[42]  Te Sun Han,et al.  A new achievable rate region for the interference channel , 1981, IEEE Trans. Inf. Theory.

[43]  Mikael Skoglund,et al.  Hybrid Digital-Analog Noisy Network Coding , 2011, 2011 International Symposium on Networking Coding.

[44]  Abbas El Gamal,et al.  Capacity theorems for relay channels , 1979 .

[45]  Abbas El Gamal,et al.  Capacity theorems for the relay channel , 1979, IEEE Trans. Inf. Theory.

[46]  Young-Han Kim,et al.  Correlated sources over broadcast channels , 2009, 2009 IEEE International Symposium on Information Theory.

[47]  Sae-Young Chung,et al.  Noisy network coding , 2010 .

[48]  Todd P. Coleman,et al.  Joint Source–Channel Coding for Transmitting Correlated Sources Over Broadcast Networks , 2009, IEEE Transactions on Information Theory.

[49]  Wei Liu,et al.  Communicating correlated sources over interference channels: The lossy case , 2010, 2010 IEEE International Symposium on Information Theory.

[50]  L. Goddard.  Information Theory , 1962, Nature.

[51]  Gerhard Kramer,et al.  Broadcast channel with degraded source random variables and receiver side information , 2008, 2008 IEEE International Symposium on Information Theory.

[52]  Michael Gastpar,et al.  To code, or not to code: lossy source-channel communication revisited , 2003, IEEE Trans. Inf. Theory.

[53]  Masoud Salehi,et al.  Multiple access channels with arbitrarily correlated sources , 1980, IEEE Trans. Inf. Theory.

[54]  Zhen Zhang,et al.  On the CEO problem , 1994, Proceedings of 1994 IEEE International Symposium on Information Theory.

[55]  Mung Chiang,et al.  Channel capacity and state estimation for state-dependent Gaussian channels , 2005, IEEE Transactions on Information Theory.

[56]  Sae-Young Chung,et al.  Noisy Network Coding , 2010, IEEE Transactions on Information Theory.

[57]  M. Gastpar.  Uncoded transmission is exactly optimal for a simple Gaussian "sensor" network , 2007 .

[58]  A. Wagner,et al.  The lossy one-helper conjecture is false , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[59]  Sae-Young Chung,et al.  Capacity of the Gaussian Two-way Relay Channel to within 1/2 Bit , 2009, ArXiv.

[60]  Ertem Tuncel,et al.  Slepian-Wolf coding over broadcast channels , 2006, IEEE Transactions on Information Theory.

[61]  Gunter Dueck,et al.  A note on the multiple access channel with correlated sources , 1981, IEEE Trans. Inf. Theory.

[62]  Suhas N. Diggavi,et al.  The achievable distortion region of bivariate Gaussian source on Gaussian broadcast channel , 2010, 2010 IEEE International Symposium on Information Theory.

[63]  Michael Gastpar,et al.  Cooperative strategies and capacity theorems for relay networks , 2005, IEEE Transactions on Information Theory.

[64]  Aaron B. Wagner,et al.  Distributed Rate-Distortion With Common Components , 2011, IEEE Transactions on Information Theory.

[65]  Suhas N. Diggavi,et al.  Wireless Network Information Flow: A Deterministic Approach , 2009, IEEE Transactions on Information Theory.

[66]  Giuseppe Longo,et al.  The information theory approach to communications , 1977 .

[67]  Nam C. Phamdo,et al.  Hybrid digital-analog (HDA) joint source-channel codes for broadcasting and robust communications , 2002, IEEE Trans. Inf. Theory.

[68]  Katalin Marton,et al.  A coding theorem for the discrete memoryless broadcast channel , 1979, IEEE Trans. Inf. Theory.

[69]  Toby Berger,et al.  Rate-distortion for correlated sources with partially separated encoders , 1982, IEEE Trans. Inf. Theory.

[70]  D. Slepian,et al.  A coding theorem for multiple access channels with correlated sources , 1973 .

[71]  Mohammad Reza Aref,et al.  Information flow in relay networks , 1981 .

[72]  Claude E. Shannon,et al.  Channels with Side Information at the Transmitter , 1958, IBM J. Res. Dev..

[73]  Shlomo Shamai,et al.  On joint source-channel coding for the Wyner-Ziv source and the Gel'fand-Pinsker channel , 2003, IEEE Trans. Inf. Theory.