Optimal Function Computation in Directed and Undirected Graphs

We consider the problem of information aggregation in sensor networks, where one is interested in computing a function of the sensor measurements. We allow for block processing and study in-network function computation in directed graphs and undirected graphs. We study how the structure of the function affects the encoding strategies and the effect of interactive information exchange. Depending on the application, there could be a designated collector node, or every node might want to compute the function. We begin by considering a directed graph C = (γ. ε) on the sensor nodes, where the goal is to determine the optimal encoders on each edge which achieve function computation at the collector node. Our goal is to characterize the rate region in R|ε|, i.e., the set of points for which there exist feasible encoders with given rates which achieve zero-error computation for asymptotically large block length. We determine the solution for directed trees, specifying the optimal encoder and decoder for each edge. For general directed acyclic graphs, we provide an outer bound on the rate region by finding the disambiguation requirements for each cut, and describe examples where this outer bound is tight. Next, we address the scenario where nodes are connected in an undirected tree network, and every node wishes to compute a given symmetric Boolean function of the sensor data. Undirected edges permit interactive computation, and we therefore study the effect of interaction on the aggregation and communication strategies. We focus on sum-threshold functions and determine the minimum worst case total number of bits to be exchanged on each edge. The optimal strategy involves recursive in-network aggregation which is reminiscent of message passing. In the case of general graphs, we present a cut-set lower bound and an achievable scheme based on aggregation along trees. For complete graphs, we prove that the complexity of this scheme is no more than twice that of the optimal scheme.

[1]  Piyush Gupta,et al.  Information-theoretic bounds for multiround function computation in collocated networks , 2009, 2009 IEEE International Symposium on Information Theory.

[2]  Ran Raz,et al.  Super-logarithmic depth lower bounds via direct sum in communication complexity , 1991, [1991] Proceedings of the Sixth Annual Structure in Complexity Theory Conference.

[3]  Alon Orlitsky,et al.  Coding for computing , 1995, Proceedings of IEEE 36th Annual Foundations of Computer Science.

[4]  Robert G. Gallager,et al.  Finding parity in a simple broadcast network , 1988, IEEE Trans. Inf. Theory.

[5]  Robert J. McEliece,et al.  The generalized distributive law , 2000, IEEE Trans. Inf. Theory.

[6]  Aaron D. Wyner,et al.  The rate-distortion function for source coding with side information at the decoder , 1976, IEEE Trans. Inf. Theory.

[7]  Sanjay Shakkottai,et al.  Scaling Bounds for Function Computation over Large Networks , 2007, 2007 IEEE International Symposium on Information Theory.

[8]  X. Jin Factor graphs and the Sum-Product Algorithm , 2002 .

[9]  Rudolf Ahlswede,et al.  Network information flow , 2000, IEEE Trans. Inf. Theory.

[10]  R. Srikant,et al.  Distributed Symmetric Function Computation in Noisy Wireless Sensor Networks , 2007, IEEE Transactions on Information Theory.

[11]  Brendan J. Frey,et al.  Factor graphs and the sum-product algorithm , 2001, IEEE Trans. Inf. Theory.

[12]  M. Franceschetti,et al.  Network coding for computing , 2008, 2008 46th Annual Allerton Conference on Communication, Control, and Computing.

[13]  A. Razborov Communication Complexity , 2011 .

[14]  Noga Alon,et al.  Source coding and graph entropies , 1996, IEEE Trans. Inf. Theory.

[15]  Yashodhan Kanoria,et al.  A tight lower bound for parity in noisy communication networks , 2008, SODA '08.

[16]  Prakash Ishwar,et al.  Two-terminal distributed source coding with alternating messages for function computation , 2008, 2008 IEEE International Symposium on Information Theory.

[17]  Massimo Franceschetti,et al.  Time and Energy Complexity of Function Computation Over Networks , 2011, IEEE Transactions on Information Theory.

[18]  Massimo Franceschetti,et al.  Network Coding for Computing: Cut-Set Bounds , 2009, IEEE Transactions on Information Theory.

[19]  Ingo Wegener,et al.  The complexity of Boolean functions , 1987 .

[20]  Alon Orlitsky,et al.  Average and randomized communication complexity , 1990, IEEE Trans. Inf. Theory.

[21]  H. S. WITSENHAUSEN,et al.  The zero-error side information problem and chromatic numbers (Corresp.) , 1976, IEEE Trans. Inf. Theory.

[22]  Panganamala Ramana Kumar,et al.  Computing and communicating functions over sensor networks , 2005, IEEE Journal on Selected Areas in Communications.

[23]  Rudolf Ahlswede,et al.  On communication complexity of vector-valued functions , 1994, IEEE Trans. Inf. Theory.