Distributed LMS estimation over networks with quantised communications

This article investigates the problem of distributed least mean-square (D-LMS) estimation over a network with quantised communication. Each node in the network has a quantiser consisting of a first-order dynamical encoder-decoder and can only communicate with its neighbours. Then a new D-LMS estimator is proposed by employing a weighted sum of the internal state differences between each node's quantiser and those of its neighbours. Performance analysis of the proposed quantised D-LMS algorithm is studied in terms of mean-square transient and steady-state measurements. We show that for Gaussian data and sufficiently small step sizes, the proposed cooperative D-LMS with quantisation is mean-square stable in all quantisation levels including the 1-bit case, and its performance approaches the cooperative D-LMS without quantisation when the quantisation step size is fairly small. Furthermore, although in unquantised case (infinite precision), the cooperative D-LMS always outperforms the non-cooperative D-LMS scheme (without communications among the neighbours); however, we show that due to the existence of quantisation error, the cooperative D-LMS with quantisation does not always outperform the non-cooperative D-LMS scheme, especially when the quantisation step size is quite large. Finally, numerical simulations also demonstrate that our theoretical performance matches well with experimental performance.

[1]  Ian F. Akyildiz,et al.  Sensor Networks , 2002, Encyclopedia of GIS.

[2]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[3]  Ali H. Sayed,et al.  Adaptive Processing over Distributed Networks , 2007, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[4]  Ruggero Carli,et al.  Quantized average consensus via dynamic coding/decoding schemes , 2008, 2008 47th IEEE Conference on Decision and Control.

[5]  Ruggero Carli,et al.  Average consensus on networks with quantized communication , 2009 .

[6]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[7]  Wheyming Tina Song,et al.  Variance Reduction Techniques on Generating M/M/1 Processes in Simulation Output Analysis , 2013, IEEE Transactions on Automatic Control.

[8]  Reza Olfati-Saber,et al.  Distributed Kalman filtering for sensor networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[9]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[10]  Ioannis D. Schizas,et al.  Distributed LMS for Consensus-Based In-Network Adaptive Processing , 2009, IEEE Transactions on Signal Processing.

[11]  Ruggero Carli,et al.  Distributed averaging on digital erasure networks , 2011, Autom..

[12]  Zidong Wang,et al.  Distributed state estimation for uncertain Markov‐type sensor networks with mode‐dependent distributed delays , 2012 .

[13]  Lihua Xie,et al.  Distributed consensus over digital networks with limited bandwidth and time-varying topologies , 2011, Autom..

[14]  Stergios I. Roumeliotis,et al.  Consensus in Ad Hoc WSNs With Noisy Links—Part II: Distributed Estimation and Smoothing of Random Signals , 2008, IEEE Transactions on Signal Processing.

[15]  Ali H. Sayed,et al.  Incremental Adaptive Strategies Over Distributed Networks , 2007, IEEE Transactions on Signal Processing.

[16]  Ali H. Sayed,et al.  Diffusion Strategies for Distributed Kalman Filtering and Smoothing , 2010, IEEE Transactions on Automatic Control.

[17]  Lihua Xie,et al.  Distributed Consensus With Limited Communication Data Rate , 2011, IEEE Transactions on Automatic Control.

[18]  Yu Hen Hu,et al.  Detection, classification, and tracking of targets , 2002, IEEE Signal Process. Mag..

[19]  Ruggero Carli,et al.  Quantized Coordination Algorithms for Rendezvous and Deployment , 2009, SIAM J. Control. Optim..

[20]  B. Widrow,et al.  Statistical theory of quantization , 1996 .

[21]  Zidong Wang,et al.  A Stochastic Sampled-Data Approach to Distributed $H_{\infty }$ Filtering in Sensor Networks , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[22]  Graham C. Goodwin,et al.  Adaptive filtering prediction and control , 1984 .

[23]  Paulo Sergio Ramirez,et al.  Fundamentals of Adaptive Filtering , 2002 .

[24]  Azam Khalili,et al.  Performance analysis of quantized incremental LMS algorithm for distributed adaptive estimation , 2010, Signal Process..

[25]  Gregory J. Pottie,et al.  Instrumenting the world with wireless sensor networks , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[26]  Milos S. Stankovic,et al.  Decentralized Parameter Estimation by Consensus Based Stochastic Approximation , 2011, IEEE Trans. Autom. Control..

[27]  Zidong Wang,et al.  Robust Hinfinity finite-horizon filtering with randomly occurred nonlinearities and quantization effects , 2010, Autom..