Computing a Function of Correlated Sources

A receiver wants to compute a function f of two correlated sources X and Y and side information Z. What is the minimum number of bits that needs to be communicated by each transmitter? In this paper, we derive inner and outer bounds to the rate region of this problem which coincide in the cases where f is partially invertible and where the sources are independent given the side information. From the former case we recover the Slepian-Wolf rate region and from the latter case we recover Orlitsky and Roche’s single source result.

[1]  Te Sun Han,et al.  A dichotomy of functions F(X, Y) of correlated sources (X, Y) , 1987, IEEE Trans. Inf. Theory.

[2]  Alon Orlitsky,et al.  Worst-case interactive communication I: Two messages are almost optimal , 1990, IEEE Trans. Inf. Theory.

[3]  Rudolf Ahlswede,et al.  On source coding with side information via a multiple-access channel and related problems in multi-user information theory , 1983, IEEE Trans. Inf. Theory.

[4]  Alon Orlitsky,et al.  Coding for computing , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[5]  Hirosuke Yamamoto,et al.  Correction to 'Wyner-Ziv theory for a general function of the correlated sources' (Sep 82 803-807) , 1983, IEEE Trans. Inf. Theory.

[6]  Michael Gastpar,et al.  Computation Over Multiple-Access Channels , 2007, IEEE Transactions on Information Theory.

[7]  Massimo Franceschetti,et al.  Network Coding for Computing: Cut-Set Bounds , 2009, IEEE Transactions on Information Theory.

[8]  Piyush Gupta,et al.  Information-theoretic bounds for multiround function computation in collocated networks , 2009, 2009 IEEE International Symposium on Information Theory.

[9]  R. A. McDonald,et al.  Noiseless Coding of Correlated Information Sources , 1973 .

[10]  Krishnamurthy Viswanathan,et al.  Information-theoretic analysis of function computation on streams , 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[11]  Devavrat Shah,et al.  Distributed Functional Compression through Graph Coloring , 2007, 2007 Data Compression Conference (DCC'07).

[12]  P. Vijay Kumar,et al.  A nested linear codes approach to distributed function computation over subspaces , 2011, 2011 49th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[13]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[14]  J. Wolfowitz.  The rate distortion function for source coding with side information at the decoder , 1979 .

[15]  Han-I Su,et al.  Cascade multiterminal source coding , 2009, 2009 IEEE International Symposium on Information Theory.

[16]  Andrew Chi-Chih Yao,et al.  Some complexity questions related to distributive computing(Preliminary Report) , 1979, STOC.

[17]  Ofer Shayevitz.  Graph Entropy Characterization of Relay-Assisted Zero-Error Source Coding with Side Information , 2011, 2011 Data Compression Conference.

[18]  Abbas El Gamal,et al.  Network Information Theory , 2021, 2021 IEEE 3rd International Conference on Advanced Trends in Information Theory (ATIT).

[19]  Mikael Skoglund,et al.  Computing polynomial functions of correlated sources: Inner bounds , 2012, 2012 International Symposium on Information Theory and its Applications.

[20]  H. S. WITSENHAUSEN,et al.  The zero-error side information problem and chromatic numbers (Corresp.) , 1976, IEEE Trans. Inf. Theory.

[21]  Alon Orlitsky,et al.  Worst-case interactive communication - II: Two messages are not optimal , 1991, IEEE Trans. Inf. Theory.

[22]  János Körner,et al.  How to encode the modulo-two sum of binary sources (Corresp.) , 1979, IEEE Trans. Inf. Theory.

[23]  Sui Tung,et al.  Multiterminal source coding (Ph.D. Thesis abstr.) , 1978, IEEE Trans. Inf. Theory.

[24]  Richard E. Blahut,et al.  Canonical description for multiterminal source coding , 2008, 2008 IEEE International Symposium on Information Theory.

[25]  Ιωαννησ Τσιτσικλησ,et al.  PROBLEMS IN DECENTRALIZED DECISION MAKING AND COMPUTATION , 1984 .

[26]  Toby Berger,et al.  Multiterminal source encoding with one distortion criterion , 1989, IEEE Trans. Inf. Theory.