Diffusion LMS with component-wise variable step-size over sensor networks

In this study, the authors propose a novel component - wise variable step-size (CVSS) diffusion distributed algorithm for estimating a specific parameter over sensor networks. The novelty of the CVSS algorithm is that step-sizes vary from each other on different components at each iteration. They derive the steady-state value of global mean-square deviation (MSD) and relative MSD (RMSD). In the numerical simulations, they compare the proposed CVSS algorithm with several other least mean square (LMS) algorithms. Results show that, when compared with these other algorithms, the CVSS algorithm can effectively reduce steady-state value and speed up convergence rate of RMSD while not sacrificing the convergence rate of MSD. Results also reveal that the proposed CVSS algorithm can achieve reduced difference of steady-state values of relative estimation error on various components.

[1]  Joseph Mitola,et al.  Cognitive radio: making software radios more personal , 1999, IEEE Wirel. Commun..

[2]  Ali H. Sayed,et al.  Incremental Adaptive Strategies Over Distributed Networks , 2007, IEEE Transactions on Signal Processing.

[3]  Azam Khalili,et al.  Derivation and analysis of incremental augmented complex least mean square algorithm , 2015, IET Signal Process..

[4]  Raymond H. Kwong,et al.  A variable step size LMS algorithm , 1992, IEEE Trans. Signal Process..

[5]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[6]  Stephen P. Boyd,et al.  Fast linear iterations for distributed averaging , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[7]  Zhaoyang Zhang,et al.  Diffusion Information Theoretic Learning for Distributed Estimation Over Network , 2013, IEEE Transactions on Signal Processing.

[8]  Soummya Kar,et al.  Gossip Algorithms for Distributed Signal Processing , 2010, Proceedings of the IEEE.

[9]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[10]  PooGyeon Park,et al.  A Variable Step-Size Diffusion Normalized Least-Mean-Square Algorithm with a Combination Method Based on Mean-Square Deviation , 2015, Circuits Syst. Signal Process..

[11]  Jiming Chen,et al.  Building-Environment Control With Wireless Sensor and Actuator Networks: Centralized Versus Distributed , 2010, IEEE Transactions on Industrial Electronics.

[12]  Jae-Woo Lee,et al.  A Variable Step-Size Diffusion LMS Algorithm for Distributed Estimation , 2015, IEEE Transactions on Signal Processing.

[13]  Ali H. Sayed,et al.  Mobile Adaptive Networks , 2011, IEEE Journal of Selected Topics in Signal Processing.

[14]  Ehud Weinstein,et al.  Convergence analysis of LMS filters with uncorrelated Gaussian data , 1985, IEEE Trans. Acoust. Speech Signal Process..

[15]  Azam Khalili,et al.  Diffusion adaptive networks with imperfect communications: link failure and channel noise , 2014, IET Signal Process..

[16]  J. Chambers,et al.  An optimum step-size assignment for incremental LMS adaptive networks based on average convergence rate constraint , 2013 .

[17]  K. Senne,et al.  Performance advantage of complex LMS for controlling narrow-band adaptive arrays , 1981 .