Analysis of partial diffusion recursive least squares adaptation over noisy links

Partial diffusion-based recursive least squares (PDRLS) is an effective way of lowering computational load and power consumption in adaptive network implementation. In this method, every single node distributes a fraction of its intermediate vector estimate with its immediate neighbours at each iteration. In this study, the authors examine the steady-state performance of PDRLS algorithm in the presence of noisy links by means of an energy conservation argument. They consider the mean-square-deviation (MSD) as the performance metric in the steady-state and derive a theoretical expression for PDRLS algorithm with noisy links. The authors’ analysis reveals that unlike the established statements on PDRLS scheme under ideal links, the trade-off between MSD performance and the number of selected entries of the intermediate estimate vectors, as a sign of communication cost, is mitigated. They further examine the convergence behaviour of the PDRLS algorithm. The obtained results show that under certain statistical assumptions for the measurement data and noise signals, under noisy links the PDRLS algorithm is stable in both mean and mean-square senses. Finally, they present some simulation results to verify the theoretical findings.

[1]  Ali H. Sayed,et al.  Single-link diffusion strategies over adaptive networks , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[2]  Scott C. Douglas,et al.  Adaptive filters employing partial updates , 1997 .

[3]  Ali H. Sayed,et al.  Diffusion LMS with communication constraints , 2010, 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers.

[4]  Suleyman Serdar Kozat,et al.  Single Bit and Reduced Dimension Diffusion Strategies Over Distributed Networks , 2013, IEEE Signal Processing Letters.

[5]  Milos S. Stankovic,et al.  Decentralized Parameter Estimation by Consensus Based Stochastic Approximation , 2011, IEEE Trans. Autom. Control..

[6]  Azzedine Zerguine,et al.  A variable step-size strategy for distributed estimation over adaptive networks , 2013, EURASIP Journal on Advances in Signal Processing.

[7]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[8]  Soummya Kar,et al.  Distributed Consensus Algorithms in Sensor Networks With Imperfect Communication: Link Failures and Channel Noise , 2007, IEEE Transactions on Signal Processing.

[9]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[10]  Azam Khalili,et al.  Steady-State Analysis of Incremental LMS Adaptive Networks With Noisy Links , 2011, IEEE Transactions on Signal Processing.

[11]  Azam Khalili,et al.  Transient analysis of diffusion least‐mean squares adaptive networks with noisy channels , 2012 .

[12]  Sergios Theodoridis,et al.  Trading off Complexity With Communication Costs in Distributed Adaptive Learning via Krylov Subspaces for Dimensionality Reduction , 2013, IEEE Journal of Selected Topics in Signal Processing.

[13]  Ali H. Sayed,et al.  Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks , 2011, IEEE Transactions on Signal Processing.

[14]  Ali H. Sayed,et al.  Diffusion Strategies Outperform Consensus Strategies for Distributed Estimation Over Adaptive Networks , 2012, IEEE Transactions on Signal Processing.

[15]  Alfred O. Hero,et al.  Partial update LMS algorithms , 2005, IEEE Transactions on Signal Processing.

[16]  Azam Khalili,et al.  Steady-State Analysis of Diffusion LMS Adaptive Networks With Noisy Links , 2012, IEEE Transactions on Signal Processing.

[17]  Suleyman Serdar Kozat,et al.  Compressive Diffusion Strategies Over Distributed Networks for Reduced Communication Load , 2014, IEEE Transactions on Signal Processing.

[18]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[19]  Benoît Champagne,et al.  Diffusion LMS algorithms for sensor networks over non-ideal inter-sensor wireless channels , 2011, 2011 International Conference on Distributed Computing in Sensor Systems and Workshops (DCOSS).

[20]  Robert D. Nowak,et al.  Quantized incremental algorithms for distributed optimization , 2005, IEEE Journal on Selected Areas in Communications.

[21]  Sergios Theodoridis,et al.  Adaptive Robust Distributed Learning in Diffusion Sensor Networks , 2011, IEEE Transactions on Signal Processing.

[22]  Ali H. Sayed,et al.  Adaptive Networks with Noisy Links , 2011, 2011 IEEE Global Telecommunications Conference - GLOBECOM 2011.

[23]  Azam Khalili,et al.  Performance Analysis of Distributed Incremental LMS Algorithm with Noisy Links , 2011, Int. J. Distributed Sens. Networks.

[24]  Isao Yamada,et al.  Link probability control for probabilistic diffusion least-mean squares over resource-constrained networks , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[25]  Ali H. Sayed,et al.  Diffusion adaptive networks with changing topologies , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[26]  Ali H. Sayed,et al.  Diffusion Bias-Compensated RLS Estimation Over Adaptive Networks , 2011, IEEE Transactions on Signal Processing.

[27]  Ali H. Sayed,et al.  A unified approach to the steady-state and tracking analyses of adaptive filters , 2001, IEEE Trans. Signal Process..

[28]  Yih-Fang Huang,et al.  Distributed Least Mean-Square Estimation With Partial Diffusion , 2014, IEEE Transactions on Signal Processing.

[29]  Marc Moonen,et al.  Consensus-Based Distributed Total Least Squares Estimation in Ad Hoc Wireless Sensor Networks , 2011, IEEE Transactions on Signal Processing.

[30]  Azzedine Zerguine,et al.  A noise‐constrained algorithm for estimation over distributed networks , 2012 .

[31]  Yih-Fang Huang,et al.  Adaptive Distributed Estimation Based on Recursive Least-Squares and Partial Diffusion , 2014, IEEE Transactions on Signal Processing.

[32]  Dimitri P. Bertsekas,et al.  Incremental Subgradient Methods for Nondifferentiable Optimization , 2001, SIAM J. Optim..

[33]  Azam Khalili,et al.  Analysis of incremental RLS adaptive networks with noisy links , 2011, IEICE Electron. Express.

[34]  Ioannis D. Schizas,et al.  Performance Analysis of the Consensus-Based Distributed LMS Algorithm , 2009, EURASIP J. Adv. Signal Process..

[35]  Ali H. Sayed,et al.  Diffusion Adaptation Over Networks Under Imperfect Information Exchange and Non-Stationary Data , 2011, IEEE Transactions on Signal Processing.

[36]  Ioannis D. Schizas,et al.  Distributed Recursive Least-Squares for Consensus-Based In-Network Adaptive Estimation , 2009, IEEE Transactions on Signal Processing.

[37]  Ali H. Sayed,et al.  Incremental Adaptive Strategies Over Distributed Networks , 2007, IEEE Transactions on Signal Processing.

[38]  Tareq Y. Al-Naffouri,et al.  Transient analysis of data-normalized adaptive filters , 2003, IEEE Trans. Signal Process..