Network Coding and Data Compression

Publisher Summary This chapter discusses the problem of communicating statistically dependent sources over networks, focusing in particular on the case of lossless reconstruction over acyclic networks of noise-free links. In contrast to a purely network coding setup with independent sources, optimal code design for this setup involves both network coding as well as data compression aspects. Calculating the set of achievable rates for this problem is a difficult task in general, though some continuity properties of the rate region are known, and a general outer bound can be obtained from cut-set arguments. Even though the cut-set bounds are not achievable for all networks, they are achievable for multicast networks, i.e., networks where all sources are demanded at all sinks. The cut-set bounds are also achievable for an extension of the multicast network, where, in addition to the desired sources, the network may have side information present at some of the sinks. For both these cases, cut-set bounds are achievable via linear network codes. Finally, some practical approaches to combining network coding and compression are discussed.

[1]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[2]  Muriel Médard,et al.  An algebraic approach to network coding , 2003, TNET.

[3]  D. Slepian,et al.  A coding theorem for multiple access channels with correlated sources , 1973 .

[4]  Tracey Ho,et al.  Linear Network Codes: A Unified Framework for Source, Channel, and Network Coding , 2003, Advances in Network Information Theory.

[5]  Jack K. Wolf,et al.  Noiseless coding of correlated information sources , 1973, IEEE Trans. Inf. Theory.

[6]  Aaron D. Wyner,et al.  On source coding with side information at the decoder , 1975, IEEE Trans. Inf. Theory.

[7]  Toby Berger,et al.  Multiterminal source encoding with one distortion criterion , 1989, IEEE Trans. Inf. Theory.

[8]  Noga Alon,et al.  Source coding and graph entropies , 1996, IEEE Trans. Inf. Theory.

[9]  Elad Verbin,et al.  Network coding is highly non-approximable , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[10]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[11]  Alon Orlitsky,et al.  Coding for computing , 2001, IEEE Trans. Inf. Theory.

[12]  Hirosuke Yamamoto,et al.  Wyner-Ziv theory for a general function of the correlated sources , 1982, IEEE Trans. Inf. Theory.

[13]  Lihua Song,et al.  Zero-error network coding for acyclic network , 2003, IEEE Trans. Inf. Theory.

[14]  M. Medard,et al.  "Real" and "Complex" Network Codes: Promises and Challenges , 2008, 2008 Fourth Workshop on Network Coding, Theory and Applications.

[15]  Michael Langberg,et al.  Network Coding: A Computational Perspective , 2006, 2006 40th Annual Conference on Information Sciences and Systems.

[16]  Robert M. Gray,et al.  Source coding for a simple network , 1974 .

[17]  Aditya Ramamoorthy,et al.  Separating distributed source coding from network coding , 2006, IEEE Transactions on Information Theory.

[18]  Muriel Medard,et al.  Practical source-network decoding , 2009, 2009 6th International Symposium on Wireless Communication Systems.

[19]  Dina Katabi,et al.  One Video Stream to Serve Diverse Receivers , 2008 .

[20]  April Rasala Lehman,et al.  Complexity classification of network information flow problems , 2004, SODA '04.

[21]  Rudolf Ahlswede,et al.  Source coding with side information and a converse for degraded broadcast channels , 1975, IEEE Trans. Inf. Theory.

[22]  Dina Katabi,et al.  SoftCast: One Video to Serve All Wireless Receivers , 2009 .

[23]  Imre Csiszár Linear codes for sources and source networks: Error exponents, universal coding , 1982, IEEE Trans. Inf. Theory.

[24]  H. S. WITSENHAUSEN,et al.  The zero-error side information problem and chromatic numbers (Corresp.) , 1976, IEEE Trans. Inf. Theory.

[25]  Michelle Effros,et al.  On the Concavity of Rate Regions for Lossless Source Coding in Networks , 2006, 2006 IEEE International Symposium on Information Theory.

[26]  Muriel Médard,et al.  Minimum Cost Mirror Sites Using Network Coding: Replication versus Coding at the Source Nodes , 2009, IEEE Transactions on Information Theory.

[27]  Tracey Ho,et al.  A Random Linear Network Coding Approach to Multicast , 2006, IEEE Transactions on Information Theory.