Distributed Consensus Algorithms in Sensor Networks: Quantized Data and Random Link Failures

The paper studies the problem of distributed average consensus in sensor networks with quantized data and random link failures. To achieve consensus, dither (small noise) is added to the sensor states before quantization. When the quantizer range is unbounded (countable number of quantizer levels), stochastic approximation shows that consensus is asymptotically achieved with probability one and in mean square to a finite random variable. We show that the mean-squared error (mse) can be made arbitrarily small by tuning the link weight sequence, at a cost of the convergence rate of the algorithm. To study dithered consensus with random links when the range of the quantizer is bounded, we establish uniform boundedness of the sample paths of the unbounded quantizer. This requires characterization of the statistical properties of the supremum taken over the sample paths of the state of the quantizer. This is accomplished by splitting the state vector of the quantizer in two components: one along the consensus subspace and the other along the subspace orthogonal to the consensus subspace. The proofs use maximal inequalities for submartingale and supermartingale sequences. From these, we derive probability bounds on the excursions of the two subsequences, from which probability bounds on the excursions of the quantizer state vector follow. The paper shows how to use these probability bounds to design the quantizer parameters and to explore tradeoffs among the number of quantizer levels, the size of the quantization steps, the desired probability of saturation, and the desired level of accuracy ¿ away from consensus. Finally, the paper illustrates the quantizer design with a numerical study.

[1]  A. Barabasi,et al.  Collective Motion of Self-Propelled Particles: Kinetic Phase Transition in One Dimension , 1997, cond-mat/9712154.

[2]  J.M.F. Moura,et al.  Distributed Detection in Sensor Networks: Connectivity Graph and Small World Networks , 2005, Conference Record of the Thirty-Ninth Asilomar Conference onSignals, Systems and Computers, 2005..

[3]  George Cybenko,et al.  Dynamic Load Balancing for Distributed Memory Multiprocessors , 1989, J. Parallel Distributed Comput..

[4]  Michael Rabbat,et al.  Distributed Average Consensus using Probabilistic Quantization , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[5]  Ruggero Carli,et al.  Efficient quantized techniques for consensus algorithms , 2007 .

[6]  L. Schuchman Dither Signals and Their Effect on Quantization Noise , 1964 .

[7]  Mehmet E. Yildiz,et al.  Limiting rate behavior and rate allocation strategies for average consensus problems with bounded convergence , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[8]  D. Sworder,et al.  Introduction to stochastic control , 1972 .

[9]  Duncan J. Watts,et al.  Collective dynamics of ‘small-world’ networks , 1998, Nature.

[10]  John N. Tsitsiklis,et al.  Distributed Asynchronous Deterministic and Stochastic Gradient Optimization Algorithms , 1984, 1984 American Control Conference.

[11]  Mikhail Borisovich Nevelʹson,et al.  Stochastic Approximation and Recursive Estimation , 1976 .

[12]  Soummya Kar,et al.  Distributed average consensus in sensor networks with quantized inter-sensor communication , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[13]  R. Srikant,et al.  Quantized Consensus , 2006, 2006 IEEE International Symposium on Information Theory.

[14]  Wei Ren,et al.  Information consensus in multivehicle cooperative control , 2007, IEEE Control Systems.

[15]  David Williams,et al.  Probability with Martingales , 1991, Cambridge mathematical textbooks.

[16]  Frank Harary,et al.  Graph Theory , 2016 .

[17]  B. Mohar THE LAPLACIAN SPECTRUM OF GRAPHS y , 1991 .

[18]  José M. F. Moura,et al.  Ramanujan Topologies for Decision Making in Sensor Networks , 2006 .

[19]  T. C. Aysal,et al.  Distributed Average Consensus With Dithered Quantization , 2008, IEEE Transactions on Signal Processing.

[20]  Richard M. Murray,et al.  Information flow and cooperative control of vehicle formations , 2004, IEEE Transactions on Automatic Control.

[21]  John Vanderkooy,et al.  Quantization and Dither: A Theoretical Survey , 1992 .

[22]  Mihailo R. Jovanovic,et al.  Effect of topological dimension on rigidity of vehicle formations: Fundamental limitations of local feedback , 2008, 2008 47th IEEE Conference on Decision and Control.

[23]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[24]  Stephen P. Boyd,et al.  Randomized gossip algorithms , 2006, IEEE Transactions on Information Theory.

[25]  Jie Lin,et al.  Coordination of groups of mobile autonomous agents using nearest neighbor rules , 2003, IEEE Trans. Autom. Control..

[26]  John N. Tsitsiklis,et al.  Problems in decentralized decision making and computation , 1984 .

[27]  H. Kushner,et al.  Stochastic Approximation and Recursive Algorithms and Applications , 2003 .

[28]  A. Scaglione,et al.  Differential Nested Lattice Encoding for Consensus Problems , 2007, 2007 6th International Symposium on Information Processing in Sensor Networks.

[29]  Michael William Newman,et al.  The Laplacian spectrum of graphs , 2001 .

[30]  John Vanderkooy,et al.  A theory of nonsubtractive dither , 2000, IEEE Trans. Signal Process..

[31]  Yongxiang Ruan,et al.  Binary consensus with soft information processing in cooperative networks , 2008, 2008 47th IEEE Conference on Decision and Control.

[32]  V. Borkar Stochastic Approximation: A Dynamical Systems Viewpoint , 2008 .

[33]  Mehrzad Malmirchegini,et al.  Binary Consensus over Fading Channels: A Best Affine Estimation Approach , 2008, IEEE GLOBECOM 2008 - 2008 IEEE Global Telecommunications Conference.

[34]  P. Barooah,et al.  Graph Effective Resistance and Distributed Control: Spectral Properties and Applications , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[35]  Soummya Kar,et al.  Topology for Distributed Inference on Graphs , 2006, IEEE Transactions on Signal Processing.

[36]  R. Olfati-Saber Ultrafast consensus in small-world networks , 2005, Proceedings of the 2005, American Control Conference, 2005..

[37]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks: Link Failures and Channel Noise , 2007, ArXiv.

[38]  R. Gray,et al.  Dithered Quantizers , 1993, Proceedings. 1991 IEEE International Symposium on Information Theory.

[39]  M. Rabbat,et al.  Rates of Convergence for Distributed Average Consensus with Probabilistic Quantization , 2007 .

[40]  M. Mesbahi,et al.  Agreement in presence of noise: pseudogradients on random geometric networks , 2005, Proceedings of the 44th IEEE Conference on Decision and Control.

[41]  A. Sripad,et al.  A necessary and sufficient condition for quantization errors to be uniform and white , 1977 .

[42]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[43]  Stephen P. Boyd,et al.  Distributed average consensus with least-mean-square deviation , 2007, J. Parallel Distributed Comput..

[44]  P. Dupuis,et al.  Stochastic Approximations via Large Deviations: Asymptotic Properties , 1985 .

[45]  Haifeng Liu,et al.  Phase Transitions on Fixed Connected Graphs and Random Graphs in the Presence of Noise , 2005, IEEE Transactions on Automatic Control.

[46]  John N. Tsitsiklis,et al.  On distributed averaging algorithms and quantization effects , 2007, 2008 47th IEEE Conference on Decision and Control.

[47]  V. Saligrama,et al.  Reliable Distributed Estimation with Intermittent Communications , 2006, Proceedings of the 45th IEEE Conference on Decision and Control.

[48]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks With Imperfect Communication: Link Failures and Channel Noise , 2007, IEEE Transactions on Signal Processing.

[49]  U. Feige,et al.  Spectral Graph Theory , 2015 .

[50]  Ruggero Carli,et al.  Average consensus on networks with quantized communication , 2009 .

[51]  Richard M. Murray,et al.  Consensus problems in networks of agents with switching topology and time-delays , 2004, IEEE Transactions on Automatic Control.