Averaging algorithms and distributed anonymous discrete function computation

In distributed consensus and averaging algorithms, processors exchange and update certain values (“estimates” or “opinions”) by forming a local average with the values of their neighbors. Under suitable conditions, such algorithms converge to consensus (every processor ends up holding the same value) or even average-consensus (consensus is achieved on the average of the initial values held by the processors). We first review some convergence rate results. We then abstract the problem by introducing a model of deterministic distributed function computation by a network of identical and anonymous nodes, with limited communication and storage capabilities, and where each node only knows its neighbors, not the entire graph. Our goal is to characterize the class of functions that can be computed within this model. In our main result, we provide a necessary condition for computability which we show to be nearly sufficient, in the sense that every function that satisfies this condition can at least be approximated. The problem of computing (suitably rounded) averages in a distributed manner plays a central role in our development, and we provide an algorithm that solves it in time that grows at most quadratically with the size of the network. (Joint work with J. Hendrickx and A. Olshevsky.)

[1]  John N. Tsitsiklis,et al.  Convergence Speed in Distributed Consensus and Averaging , 2009, SIAM J. Control. Optim..

[2]  John N. Tsitsiklis,et al.  On distributed averaging algorithms and quantization effects , 2007, 2008 47th IEEE Conference on Decision and Control.

[3]  Martin Vetterli,et al.  Interval consensus: From quantized gossip to voting , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  J. Tsitsiklis,et al.  Distributed anonymous discrete function computation and averaging , 2011 .