Distributed Parameter Estimation With Quantized Communication via Running Average

In this paper, we consider the problem of parameter estimation over sensor networks in the presence of quantized data and directed communication links. We propose a two-stage distributed algorithm aiming at achieving the centralized sample mean estimate in a distributed manner. Different from the existing algorithms, a running average technique is utilized in the proposed algorithm to smear out the randomness caused by the probabilistic quantization scheme. With the running average technique, it is shown that the centralized sample mean estimate can be achieved both in the mean square and almost sure senses, which is not observed in the standard consensus algorithms. In addition, the rates of convergence are given to quantify the mean square and almost sure performances. Finally, simulation results are presented to illustrate the effectiveness of the proposed algorithm and highlight the improvements by using running average technique.

[1]  Andrea Gasparri,et al.  A distributed algorithm for average consensus on strongly connected weighted digraphs , 2014, Autom..

[2]  Jun Fang,et al.  Distributed Consensus With Quantized Data via Sequence Averaging , 2010, IEEE Transactions on Signal Processing.

[3]  Amit K. Roy-Chowdhury,et al.  Information Weighted Consensus Filters and Their Application in Distributed Camera Networks , 2013, IEEE Transactions on Automatic Control.

[4]  Xia Chen.  On the Law of the Iterated Logarithm for Independent Banach Space Valued Random Variables , 1993 .

[5]  Kai Cai,et al.  Average consensus on general strongly connected digraphs , 2012, Autom..

[6]  Charles R. Johnson,et al.  Matrix Analysis, 2nd Ed , 2012 .

[7]  Frank L. Lewis,et al.  Cooperative control with distributed gain adaptation and connectivity estimation for directed networks , 2014 .

[8]  Stephen P. Boyd,et al.  A scheme for robust distributed sensor fusion based on average consensus , 2005, IPSN 2005. Fourth International Symposium on Information Processing in Sensor Networks, 2005..

[9]  Asymptotic Behaviour of Linearly Transformed Sums of Random Variables , 1997 .

[10]  Lihua Xie,et al.  Distributed Consensus With Limited Communication Data Rate , 2011, IEEE Transactions on Automatic Control.

[11]  Christoforos N. Hadjicostis,et al.  Distributed strategies for average consensus in directed graphs , 2011, IEEE Conference on Decision and Control and European Control Conference.

[12]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[13]  Zhi-Quan Luo,et al.  Universal decentralized estimation in a bandwidth constrained sensor network , 2005, IEEE Transactions on Information Theory.

[14]  Ruggero Carli,et al.  Gossip consensus algorithms via quantized communication , 2009, Autom..

[15]  BoydStephen,et al.  Distributed average consensus with least-mean-square deviation , 2007 .

[16]  Lihua Xie,et al.  Sampled-data based average consensus with logarithmic quantizers , 2012, Proceedings of the 31st Chinese Control Conference.

[17]  John N. Tsitsiklis,et al.  Weighted Gossip: Distributed Averaging using non-doubly stochastic matrices , 2010, 2010 IEEE International Symposium on Information Theory.

[18]  John Vanderkooy,et al.  Quantization and Dither: A Theoretical Survey , 1992 .

[19]  Kai Cai,et al.  Quantized Consensus and Averaging on Gossip Digraphs , 2011, IEEE Transactions on Automatic Control.

[20]  Allen Gersho,et al.  Vector quantization and signal compression , 1991, The Kluwer international series in engineering and computer science.

[21]  Stephen P. Boyd,et al.  Distributed average consensus with least-mean-square deviation , 2007, J. Parallel Distributed Comput..

[22]  T. C. Aysal,et al.  Distributed Average Consensus With Dithered Quantization , 2008, IEEE Transactions on Signal Processing.

[23]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks: Quantized Data and Random Link Failures , 2007, IEEE Transactions on Signal Processing.

[24]  Ruggero Carli,et al.  Quantized average consensus via dynamic coding/decoding schemes , 2008, 2008 47th IEEE Conference on Decision and Control.

[25]  Qipeng Liu,et al.  Consensus seeking over directed networks with limited information communication , 2013, Autom..

[26]  Jun Fang,et al.  An adaptive quantization scheme for distributed consensus , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[27]  Charles R. Johnson,et al.  Matrix analysis , 1985, Statistical Inference for Engineers and Data Scientists.

[28]  Sandra Lowe,et al.  Probability A Graduate Course , 2016 .

[29]  G.B. Giannakis,et al.  Distributed compression-estimation using wireless sensor networks , 2006, IEEE Signal Processing Magazine.

[30]  Ruggero Carli,et al.  Average consensus on networks with quantized communication , 2009 .

[31]  Lihua Xie,et al.  Averaging based distributed estimation algorithm for sensor networks with quantized and directed communication , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[32]  John N. Tsitsiklis,et al.  On distributed averaging algorithms and quantization effects , 2007, 2008 47th IEEE Conference on Decision and Control.

[33]  Alejandro Ribeiro,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part I: Distributed Estimation of Deterministic Signals , 2008, IEEE Transactions on Signal Processing.

[34]  Werner Gautschi,et al.  The asymptotic behaviour of powers of matrices , 1953 .

[35]  R. Srikant,et al.  Quantized Consensus , 2006, 2006 IEEE International Symposium on Information Theory.

[36]  Ji Liu,et al.  Design and analysis of distributed averaging with quantized communication , 2014, 53rd IEEE Conference on Decision and Control.

[37]  Randal W. Beard,et al.  Consensus seeking in multiagent systems under dynamically changing interaction topologies , 2005, IEEE Transactions on Automatic Control.