Broadcast-Based Consensus With Non-Zero-Mean Stochastic Perturbations

Bolstered by the growing interest in building wireless sensor and ad hoc networks with applications ranging across different engineering disciplines, distributed consensus algorithms have recently seen a new revival since their inception in the early 1980s. Of particular interest is the recently developed broadcast-based consensus algorithm, which is one special type of randomized consensus algorithms and is amenable to practical implementation in wireless networks. This paper focuses on the performance analysis of this broadcast-based consensus algorithm in the presence of non-zero-mean stochastic perturbations. It is demonstrated that as the algorithm proceeds, the deviation of the node states from their average will converge, in expectation, to a fixed value, which is determined by the Laplacian matrix of the network, the mixing parameter, and the mean of the stochastic perturbations. Asymptotic upper and lower bounds on the total mean-square deviation are derived, which describe the range of distances over which the node states deviate from consensus. These bounds can facilitate evaluation of the applicability of this algorithm in practice. Results are also provided on the algorithm's ε-converging time, i.e., the earliest time at which the deviation is ε close to its steady value, and on the mean and mean-square behaviors of the displacement of node states from their initial states at large iteration number. As a special case study, performance of the broadcast-based consensus algorithm under zero-mean stochastic disturbances is analyzed, and results regarding its convergence, mean-square deviation, and mean-square displacement are given. The theoretical results presented in this study hold true regardless of the statistics of the stochastic disturbances, and are valid for arbitrary network topology as long as the topology is connected.

[1]  Soummya Kar,et al.  Distributed Average Consensus in Sensor Networks with Random Link Failures and Communication Channel Noise , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.

[2]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[3]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[4]  M. Mesbahi,et al.  Agreement in presence of noise: pseudogradients on random geometric networks , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[5]  Sandro Zampieri,et al.  Randomized consensus algorithms over large scale networks , 2007, 2007 Information Theory and Applications Workshop.

[6]  K. Dessouky,et al.  Network synchronization , 1985, Proceedings of the IEEE.

[7]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[8]  William Voxman,et al.  Advanced Calculus: An Introduction to Modern Analysis , 1981 .

[9]  Martin J. Wainwright,et al.  Network-Based Consensus Averaging With General Noisy Channels , 2008, IEEE Transactions on Signal Processing.

[10]  Gesualdo Scutari,et al.  The effect of additive noise on consensus achievement in wireless sensor networks , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[11]  Mehran Mesbahi,et al.  Agreement over random networks , 2004, 2004 43rd IEEE Conference on Decision and Control (CDC) (IEEE Cat. No.04CH37601).

[12]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[13]  M. Fiedler Algebraic connectivity of graphs , 1973 .

[14]  R. Merris Laplacian matrices of graphs: a survey , 1994 .

[15]  T. D. Morley,et al.  Eigenvalues of the Laplacian of a graph , 1985 .

[16]  Minyi Huang Convergence rate for stochastic consensus algorithms with time-varying noise statistics: Asymptotic normality , 2008, 2008 47th IEEE Conference on Decision and Control.

[17]  O. Nelles,et al.  An Introduction to Optimization , 1996, IEEE Antennas and Propagation Magazine.

[18]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[19]  Kenneth E. Barner,et al.  Convergence of Consensus Models With Stochastic Disturbances , 2010, IEEE Transactions on Information Theory.

[20]  Qun Li,et al.  Global clock synchronization in sensor networks , 2006, IEEE Transactions on Computers.

[21]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.

[22]  Sam Toueg,et al.  Asynchronous consensus and broadcast protocols , 1985, JACM.

[23]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[24]  Alejandro Ribeiro,et al.  Consensus-Based Distributed Parameter Estimation in Ad Hoc Wireless Sensor Networks with Noisy Links , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[25]  Luca Schenato,et al.  A distributed consensus protocol for clock synchronization in wireless sensor network , 2007, 2007 46th IEEE Conference on Decision and Control.

[26]  Stephen P. Boyd,et al.  Distributed average consensus with least-mean-square deviation , 2007, J. Parallel Distributed Comput..

[27]  Anand D. Sarwate,et al.  Broadcast Gossip Algorithms for Consensus , 2009, IEEE Transactions on Signal Processing.

[28]  Louise E. Moser,et al.  Broadcast Protocols for Distributed Systems , 1990, IEEE Trans. Parallel Distributed Syst..

[29]  Gang Xiong,et al.  Analysis of Distributed Consensus Time Synchronization with Gaussian Delay over Wireless Sensor Networks , 2009, EURASIP J. Wirel. Commun. Netw..

[30]  Behrouz Touri,et al.  Distributed consensus over network with noisy links , 2009, 2009 12th International Conference on Information Fusion.

[31]  Dimitri P. Bertsekas,et al.  Data networks (2nd ed.) , 1992 .

[32]  Rick S. Blum,et al.  Phase Synchronization for Coherent MIMO Radar: Algorithms and Their Analysis , 2011, IEEE Transactions on Signal Processing.

[33]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.

[34]  Louise E. Moser,et al.  Necessary and sufficient conditions for broadcast consensus protocols , 2005, Distributed Computing.