Broadcast Gossip Averaging: Interference and Unbiasedness in Large Abelian Cayley Networks

In this paper, we study two related iterative randomized algorithms for distributed computation of averages. The first algorithm is the Broadcast Gossip Algorithm, in which at each iteration one randomly selected node broadcasts its own state to its neighbors. The second algorithm is a novel variation of the former, in which at each iteration every node is allowed to broadcast: hence, this algorithm, which we call Collision Broadcast Gossip Algorithm (CBGA), is affected by interference among messages. The performance of both algorithms is evaluated in terms of rate of convergence and asymptotical error: focusing on large Abelian Cayley networks, we highlight the role of topology and of design parameters. We show that on fully connected graphs the rate of convergence is bounded away from one, whereas the asymptotical error is bounded away from zero. On the contrary, on sparse graphs the rate of convergence goes to one and the asymptotical error goes to zero, as the size of the network grows larger. Our results also show that the performance of the CBGA is close to the performance of the BGA: this indicates the robustness of broadcast gossip algorithms to interferences.

[1]  Alexandros G. Dimakis,et al.  Reaching consensus in wireless networks with probabilistic broadcast , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[2]  M. Alanyali,et al.  Distributed Detection in Sensor Networks With Packet Losses and Finite Capacity Links , 2006, IEEE Transactions on Signal Processing.

[3]  S. Rai The Spectrum of a Random Geometric Graph is Concentrated , 2004, math/0408103.

[4]  Soummya Kar,et al.  Gossip Algorithms for Distributed Signal Processing , 2010, Proceedings of the IEEE.

[5]  Alexandros G. Dimakis,et al.  Geographic Gossip: Efficient Averaging for Sensor Networks , 2007, IEEE Transactions on Signal Processing.

[6]  Sandro Zampieri,et al.  Performance of consensus algorithms in large-scale distributed estimation , 2009, 2009 European Control Conference (ECC).

[7]  Kenneth E. Barner,et al.  Convergence of Consensus Models With Stochastic Disturbances , 2010, IEEE Transactions on Information Theory.

[8]  A. Terras Fourier Analysis on Finite Groups and Applications: Index , 1999 .

[9]  Alexandros G. Dimakis,et al.  Gossip along the way: order-optimal consensus through randomized path averaging , 2007 .

[10]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[11]  R. Carli,et al.  Quadratic indices for the analysis of consensus algorithms , 2009, 2009 Information Theory and Applications Workshop.

[12]  Benjamin Recht,et al.  Distributed control of systems over discrete Groups , 2004, IEEE Transactions on Automatic Control.

[13]  Alexandros G. Dimakis,et al.  Local Interference Can Accelerate Gossip Algorithms , 2008, IEEE Journal of Selected Topics in Signal Processing.

[14]  Martin Vetterli,et al.  Which Distributed Averaging Algorithm Should I Choose for my Sensor Network? , 2008, IEEE INFOCOM 2008 - The 27th Conference on Computer Communications.

[15]  Devavrat Shah,et al.  Fast Distributed Algorithms for Computing Separable Functions , 2005, IEEE Transactions on Information Theory.

[16]  Jean-Charles Delvenne,et al.  Democracy in Markov chains and its preservation under local perturbations , 2010, 49th IEEE Conference on Decision and Control (CDC).

[17]  Ruggero Carli,et al.  Communication constraints in the average consensus problem , 2008, Autom..

[18]  Anand D. Sarwate,et al.  Broadcast Gossip Algorithms for Consensus , 2009, IEEE Transactions on Signal Processing.

[19]  Sandro Zampieri,et al.  Randomized consensus algorithms over large scale networks , 2007, 2007 Information Theory and Applications Workshop.

[20]  P. Rowlinson FOURIER ANALYSIS ON FINITE GROUPS AND APPLICATIONS (London Mathematical Society Student Texts 43) , 2000 .

[21]  Sandro Zampieri,et al.  Average consensus with packet drop communication , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[22]  Massimo Franceschetti,et al.  Random Networks for Communication , 2008 .

[23]  Nancy A. Lynch,et al.  Consensus and collision detectors in radio networks , 2008, Distributed Computing.