A variable step-size strategy for distributed estimation over adaptive networks

A lot of work has been done recently to develop algorithms that utilize the distributed structure of an ad hoc wireless sensor network to estimate a certain parameter of interest. One such algorithm is called diffusion least-mean squares (DLMS). This algorithm estimates the parameter of interest using the cooperation between neighboring sensors within the network. The present work proposes an improvement on the DLMS algorithm by using a variable step-size LMS (VSSLMS) algorithm. In this work, first, the well-known variants of VSSLMS algorithms are compared with each other in order to select the most suitable algorithm which provides the best trade-off between performance and complexity. Second, the detailed convergence and steady-state analyses of the selected VSSLMS algorithm are performed. Finally, extensive simulations are carried out to test the robustness of the proposed algorithm under different scenarios. Moreover, the simulation results are found to corroborate the theoretical findings very well.

[1]  V. John Mathews,et al.  A stochastic gradient adaptive filter with gradient adaptive step size , 1993, IEEE Trans. Signal Process..

[2]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[3]  Azam Khalili,et al.  Performance analysis of quantized incremental LMS algorithm for distributed adaptive estimation , 2010, Signal Process..

[4]  Gregory J. Pottie,et al.  Instrumenting the world with wireless sensor networks , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[5]  Reza Olfati-Saber,et al.  Consensus and Cooperation in Networked Multi-Agent Systems , 2007, Proceedings of the IEEE.

[6]  Zhang Jingjing,et al.  Variable Step Size LMS Algorithm , 2012 .

[7]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[8]  Isao Yamada,et al.  Diffusion Least-Mean Squares With Adaptive Combiners: Formulation and Performance Analysis , 2010, IEEE Transactions on Signal Processing.

[9]  Gonzalo Mateos,et al.  Distributed Recursive Least-Squares: Stability and Performance Analysis , 2011, IEEE Transactions on Signal Processing.

[10]  Cássio Guimarães Lopes,et al.  Evaluation and design of variable step size adaptive algorithms , 2001, ICASSP.

[11]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[12]  Ali H. Sayed,et al.  Diffusion Strategies for Distributed Kalman Filtering and Smoothing , 2010, IEEE Transactions on Automatic Control.

[13]  Ioannis D. Schizas,et al.  Performance Analysis of the Consensus-Based Distributed LMS Algorithm , 2009, EURASIP J. Adv. Signal Process..

[14]  José Carlos M. Bermudez,et al.  A Robust Variable Step Size Algorithm for Lms Adaptive Filters , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[15]  Azzedine Zerguine,et al.  Convergence and steady-state analysis of a variable step-size NLMS algorithm , 2003, Signal Process..

[16]  A. Nedić,et al.  Stochastic Incremental Gradient Descent for Estimation in Sensor Networks , 2007, 2007 Conference Record of the Forty-First Asilomar Conference on Signals, Systems and Computers.

[17]  H. Neudecker,et al.  Block Kronecker products and the vecb operator , 1991 .

[18]  Reza Olfati-Saber,et al.  Distributed Kalman filtering for sensor networks , 2007, 2007 46th IEEE Conference on Decision and Control.

[19]  Ioannis D. Schizas,et al.  Distributed LMS for Consensus-Based In-Network Adaptive Processing , 2009, IEEE Transactions on Signal Processing.

[20]  Ali H. Sayed,et al.  Fundamentals Of Adaptive Filtering , 2003 .

[21]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[22]  Tyseer Aboulnasr,et al.  A robust variable step-size LMS-type algorithm: analysis and simulations , 1997, IEEE Trans. Signal Process..

[23]  Azzedine Zerguine,et al.  Variable step-size least mean square algorithms over adaptive networks , 2010, 10th International Conference on Information Science, Signal Processing and their Applications (ISSPA 2010).

[24]  Ioannis D. Schizas,et al.  Distributed Recursive Least-Squares for Consensus-Based In-Network Adaptive Estimation , 2009, IEEE Transactions on Signal Processing.

[25]  Ali H. Sayed,et al.  Incremental Adaptive Strategies Over Distributed Networks , 2007, IEEE Transactions on Signal Processing.

[26]  Petar M. Djuric,et al.  Distributed particle filtering in agent networks: A survey, classification, and comparison , 2013, IEEE Signal Processing Magazine.