Efficient coding for multi-source networks using Gács-Körner common information

Consider a multi-source multicast network coding problem with correlated sources. While the fundamental limits are known, achieving them, in general, involves a computational burden due to the complex decoding process. Efficient solutions, on the other hand, are by large based on source and network coding separation, thus imposing strict topological constraints on the networks which can be solved. In this work, we introduce a novel notion of separation of source and network coding using Gács-Körner Common Information (CI). Unlike existing notions of separation, the sufficient condition for this separation to hold depends on the source structure rather than the network topology. Using the suggested separation scheme, we tackle the problem of multi-source multicast. We construct efficient, zero error source codes, and via properties of the CI completely characterize the resulting rate region. We then study the complexity of the end-to-end scheme.

[1]  Ajay Luthra,et al.  Overview of the H.264/AVC video coding standard , 2003, IEEE Trans. Circuits Syst. Video Technol..

[2]  Muriel Médard,et al.  A Successive Description property of Monotone-Chain Polar Codes for Slepian-Wolf coding , 2015, 2015 IEEE International Symposium on Information Theory (ISIT).

[3]  Satyajit Thakor,et al.  Bounds for network information flow with correlated sources , 2011, 2011 Australian Communications Theory Workshop.

[4]  Amir Salman Avestimehr,et al.  On networks with side information , 2009, 2009 IEEE International Symposium on Information Theory.

[5]  Te Sun Han Multicasting Multiple Correlated Sources to Multiple Sinks Over a Noisy Channel Network , 2011, IEEE Transactions on Information Theory.

[6]  Rudolf Ahlswede,et al.  Source coding with side information and a converse for degraded broadcast channels , 1975, IEEE Trans. Inf. Theory.

[7]  Peter Sanders,et al.  Polynomial time algorithms for multicast network code construction , 2005, IEEE Transactions on Information Theory.

[8]  R. Koetter,et al.  Network Coding for Correlated Sources , 2004 .

[9]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[10]  Muriel Médard,et al.  An algebraic approach to network coding , 2003, TNET.

[11]  Sidharth Jaggi,et al.  Beyond the Cut-Set Bound: Uncertainty Computations in Network Coding With Correlated Sources , 2013, IEEE Transactions on Information Theory.

[12]  Vinod M. Prabhakaran,et al.  Assisted Common Information With an Application to Secure Two-Party Sampling , 2014, IEEE Transactions on Information Theory.

[13]  Aaron D. Wyner,et al.  Recent results in the Shannon theory , 1974, IEEE Trans. Inf. Theory.

[14]  Te Sun Han Polymatroids with network coding , 2010, 2010 Information Theory and Applications Workshop (ITA).

[15]  Muriel Médard,et al.  Maximum Entropy Functions: Approximate Gacs-Korner for Distributed Compression , 2016, ArXiv.

[16]  Michelle Effros,et al.  On Lossless Coding With Coded Side Information , 2009, IEEE Transactions on Information Theory.

[17]  S. Diggavi,et al.  Broadcasting with Degraded Message Sets : A Deterministic Approach , 2007 .

[18]  Aditya Ramamoorthy,et al.  Separating distributed source coding from network coding , 2006, IEEE Transactions on Information Theory.

[19]  H. Witsenhausen ON SEQUENCES OF PAIRS OF DEPENDENT RANDOM VARIABLES , 1975 .

[20]  Mayank Bakshi,et al.  On achievable rates for multicast in the presence of side information , 2008, 2008 IEEE International Symposium on Information Theory.

[21]  Muriel Medard,et al.  Practical source-network decoding , 2009, 2009 6th International Symposium on Wireless Communication Systems.

[22]  Muriel Médard,et al.  Minimum-Cost Subgraphs for Joint Distributed Source and Network Coding , 2006 .

[23]  Tracey Ho,et al.  A Random Linear Network Coding Approach to Multicast , 2006, IEEE Transactions on Information Theory.

[24]  János Körner,et al.  General broadcast channels with degraded message sets , 1977, IEEE Trans. Inf. Theory.

[25]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[26]  R. Yeung,et al.  Network information flow-multiple sources , 2001, Proceedings. 2001 IEEE International Symposium on Information Theory (IEEE Cat. No.01CH37252).