Lossy source coding of multiple Gaussian sources: m-helper problem

We consider the network information theoretic problem of finding the rate distortion bound when multiple correlated Gaussian sources are present. One of these is the source of interest but some side information from other sources is also transmitted to help reduce the distortion in the reproduction of the first source. The other sources are treated as helpers and are also coded. Special cases of this problem have been solved before, such as when the reproduction is lossless, when the sources are conditionally independent given one of them, or when the number of helpers is limited to one. We consider a generalized version and show that the previously derived expressions fall out as special cases of our bound. Our results can be directly utilized by designers to choose not only how many of the available sources should actually be communicated but also which sources have the highest potential to reduce the distortion.

[1]  Anna Scaglione,et al.  On the Interdependence of Routing and Data Compression in Multi-Hop Sensor Networks , 2002, MobiCom '02.

[2]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[3]  R. A. McDonald,et al.  Noiseless Coding of Correlated Information Sources , 1973 .

[4]  Sui Tung,et al.  Multiterminal source coding (Ph.D. Thesis abstr.) , 1978, IEEE Trans. Inf. Theory.

[5]  Toby Berger,et al.  Multiterminal source encoding with one distortion criterion , 1989, IEEE Trans. Inf. Theory.

[6]  Te Sun Han,et al.  A unified achievable rate region for a general class of multiterminal source coding systems , 1980, IEEE Trans. Inf. Theory.

[7]  Y. Oohama.  Multiterminal source coding for correlated memoryless Gaussian sources with several side information at the decoder , 1999, Proceedings of the 1999 IEEE Information Theory and Communications Workshop (Cat. No. 99EX253).

[8]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[9]  J. Wolfowitz.  The rate distortion function for source coding with side information at the decoder , 1979 .

[10]  Gregory J. Pottie,et al.  Wireless integrated network sensors , 2000, Commun. ACM.

[11]  Mingyan Liu,et al.  On the Many-to-One Transport Capacity of a Dense Wireless Sensor Network and the Compressibility of Its Data , 2003, IPSN.

[12]  Mani B. Srivastava,et al.  A distributed computation platform for wireless embedded sensing , 2002, Proceedings. IEEE International Conference on Computer Design: VLSI in Computers and Processors.

[13]  Pramod K. Varshney,et al.  Distributed Detection and Data Fusion , 1996 .

[14]  Y. Oohama.  Gaussian multiterminal source coding , 1995, Proceedings of 1995 IEEE International Symposium on Information Theory.

[15]  Gregory J. Pottie,et al.  Decentralized Information Processing in Wireless Peer-to-Peer Networks , 2002 .

[16]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[17]  Wu,et al.  Networked Infomechanical Systems-NIMS , 2003 .

[18]  Imre Csiszár,et al.  Towards a general theory of source networks , 1980, IEEE Trans. Inf. Theory.

[19]  Toby Berger,et al.  Rate-distortion for correlated sources with partially separated encoders , 1982, IEEE Trans. Inf. Theory.

[20]  J. Wolfowitz.  The rate distortion function for source coding with side information at the decoder. II , 1979 .

[21]  Deborah Estrin,et al.  Embedding the Internet: introduction , 2000, Commun. ACM.

[22]  Gregory J. Pottie,et al.  Information theory of wireless sensor networks: the n-helper Gaussian case , 2000, 2000 IEEE International Symposium on Information Theory (Cat. No.00CH37060).

[23]  Toby Berger,et al.  An upper bound on the rate distortion function for source coding with partial side information at the decoder , 1979, IEEE Trans. Inf. Theory.