Diffusion sign-error LMS algorithm: Formulation and stochastic behavior analysis

In the case where the measurement noise involves impulsive interference, distributed estimation algorithms based on the mean-square error (MSE) criterion may suffer from severely degraded convergence performance or divergence. To address this problem, we modify the adapt-then-combine (ATC) diffusion LMS (DLMS) algorithm by applying the sign operation to the error signals at all agents to develop a diffusion sign-error LMS (DSE-LMS) algorithm. Furthermore, the stochastic behavior of the DSE-LMS algorithm is analyzed for Gaussian inputs and contaminated Gaussian noise based on Price's theorem. Simulation results show the robustness of the DSE-LMS algorithm against impulsive interference and validate the theoretical findings. HighlightsThe diffusion LMS algorithm may suffer from severely degraded convergence performance in impulsive interference environments.The proposed diffusion sign-error LMS algorithm is robust against impulsive interferences.The stochastic behavior of the diffusion sign-error LMS algorithm is analyzed based on Price's theorem.

[1]  Suleyman Serdar Kozat,et al.  Single Bit and Reduced Dimension Diffusion Strategies Over Distributed Networks , 2013, IEEE Signal Processing Letters.

[2]  Ali H. Sayed,et al.  Dictionary Learning Over Distributed Models , 2014, IEEE Transactions on Signal Processing.

[3]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[4]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[5]  Ali H. Sayed,et al.  Distributed Estimation Over an Adaptive Incremental Network Based on the Affine Projection Algorithm , 2010, IEEE Transactions on Signal Processing.

[6]  PooGyeon Park,et al.  Variable Step-Size Sign Subband Adaptive Filter , 2013, IEEE Signal Processing Letters.

[7]  Ali H. Sayed,et al.  Incremental Adaptive Strategies Over Distributed Networks , 2007, IEEE Transactions on Signal Processing.

[8]  Robert Price,et al.  A useful theorem for nonlinear devices having Gaussian inputs , 1958, IRE Trans. Inf. Theory.

[9]  Jingen Ni,et al.  Diffusion Sign Subband Adaptive Filtering Algorithm for Distributed Estimation , 2015, IEEE Signal Processing Letters.

[10]  Wallace Kit-Sang Tang,et al.  Enhanced incremental LMS with norm constraints for distributed in-network estimation , 2014, Signal Process..

[11]  Eweda Eweda,et al.  Stochastic Analysis of a Stable Normalized Least Mean Fourth Algorithm for Adaptive Noise Canceling With a White Gaussian Reference , 2012, IEEE Transactions on Signal Processing.

[12]  Ali H. Sayed,et al.  An Adaptive Diffusion Augmented CLMS Algorithm for Distributed Filtering of Noncircular Complex Signals , 2011, IEEE Signal Processing Letters.

[13]  Jie Chen,et al.  Steady-State Performance of Non-Negative Least-Mean-Square Algorithm and Its Variants , 2014, IEEE Signal Processing Letters.

[14]  PooGyeon Park,et al.  A band-dependent variable step-size sign subband adaptive filter , 2014, Signal Process..

[15]  V. J. Mathews,et al.  Improved convergence analysis of stochastic gradient adaptive filters using the sign algorithm , 1987, IEEE Trans. Acoust. Speech Signal Process..

[16]  I. Song,et al.  Performance analysis of the dual sign algorithm for additive contaminated-Gaussian noise , 1994, IEEE Signal Processing Letters.

[17]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[18]  Angelia Nedic,et al.  Distributed Random Projection Algorithm for Convex Optimization , 2012, IEEE Journal of Selected Topics in Signal Processing.

[19]  Ali H. Sayed,et al.  Bio-Inspired Decentralized Radio Access Based on Swarming Mechanisms Over Adaptive Networks , 2013, IEEE Transactions on Signal Processing.

[20]  Ali H. Sayed,et al.  Distributed Decision-Making Over Adaptive Networks , 2013, IEEE Transactions on Signal Processing.

[21]  Ali H. Sayed,et al.  Adaptive Processing over Distributed Networks , 2007, IEICE Trans. Fundam. Electron. Commun. Comput. Sci..

[22]  Jian Yang,et al.  Two variants of the sign subband adaptive filter with improved convergence rate , 2014, Signal Process..

[23]  Ali H. Sayed,et al.  Distributed Clustering and Learning Over Networks , 2014, IEEE Transactions on Signal Processing.

[24]  José Carlos M. Bermudez,et al.  A Mean-Square Stability Analysis of the Least Mean Fourth Adaptive Algorithm , 2007, IEEE Transactions on Signal Processing.

[25]  Jonathon A. Chambers,et al.  A new incremental affine projection-based adaptive algorithm for distributed networks , 2008, Signal Process..

[26]  V. John Mathews,et al.  Performance analysis of adaptive filters equipped with the dual sign algorithm , 1991, IEEE Trans. Signal Process..

[27]  M. Omair Ahmad,et al.  Robust Shrinkage Affine-Projection Sign Adaptive-Filtering Algorithms for Impulsive Noise Environments , 2014, IEEE Transactions on Signal Processing.

[28]  Yih-Fang Huang,et al.  Analysis of a reduced-communication diffusion LMS algorithm , 2014, Signal Process..

[29]  Jie Chen,et al.  Multitask Diffusion Adaptation Over Networks , 2013, IEEE Transactions on Signal Processing.

[30]  Jie Chen,et al.  Non-negative least-mean-square algorithm , 2011 .

[31]  Tania Stathaki,et al.  A normalized robust mixed-norm adaptive algorithm for system identification , 2004, IEEE Signal Processing Letters.

[32]  Ali H. Sayed,et al.  Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks , 2011, IEEE Transactions on Signal Processing.

[33]  Jacob Benesty,et al.  An Affine Projection Sign Algorithm Robust Against Impulsive Interferences , 2010, IEEE Signal Processing Letters.

[34]  Ali H. Sayed,et al.  Adaptive Penalty-Based Distributed Stochastic Convex Optimization , 2013, IEEE Transactions on Signal Processing.

[35]  Ali H. Sayed,et al.  Mobile Adaptive Networks , 2011, IEEE Journal of Selected Topics in Signal Processing.

[36]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[37]  Angelia Nedic,et al.  Distributed Asynchronous Constrained Stochastic Optimization , 2011, IEEE Journal of Selected Topics in Signal Processing.

[38]  Ali H. Sayed,et al.  Diffusion Strategies for Distributed Kalman Filtering and Smoothing , 2010, IEEE Transactions on Automatic Control.

[39]  C. L. Nikias,et al.  Signal processing with fractional lower order moments: stable processes and their applications , 1993, Proc. IEEE.

[40]  Petar M. Djuric,et al.  Sequential Estimation of Mixtures in Diffusion Networks , 2015, IEEE Signal Processing Letters.

[41]  Feng Li,et al.  Efficient Implementation of the Affine Projection Sign Algorithm , 2012, IEEE Signal Processing Letters.

[42]  Jacob Benesty,et al.  A New Robust Variable Step-Size NLMS Algorithm , 2008, IEEE Transactions on Signal Processing.

[43]  Ali H. Sayed,et al.  Distributed Spectrum Estimation for Small Cell Networks Based on Sparse Diffusion Adaptation , 2013, IEEE Signal Processing Letters.

[44]  Jie Chen,et al.  Variants of Non-Negative Least-Mean-Square Algorithm and Convergence Analysis , 2014, IEEE Transactions on Signal Processing.

[45]  Soummya Kar,et al.  Convergence Rate Analysis of Distributed Gossip (Linear Parameter) Estimation: Fundamental Limits and Tradeoffs , 2010, IEEE Journal of Selected Topics in Signal Processing.

[46]  A. Figueiras-Vidal,et al.  Adaptive combination of normalised filters for robust system identification , 2005 .

[47]  Ali H. Sayed,et al.  Modeling Bird Flight Formations Using Diffusion Adaptation , 2011, IEEE Transactions on Signal Processing.

[48]  Ali H. Sayed,et al.  Adaptive Filters , 2008 .

[49]  J. Chambers,et al.  A robust mixed-norm adaptive filter algorithm , 1997, IEEE Signal Processing Letters.

[50]  J. Ni,et al.  Variable regularisation parameter sign subband adaptive filter , 2010 .

[51]  Zhaoyang Zhang,et al.  Diffusion Information Theoretic Learning for Distributed Estimation Over Network , 2013, IEEE Transactions on Signal Processing.

[52]  Jie Chen,et al.  Diffusion LMS Over Multitask Networks , 2014, IEEE Transactions on Signal Processing.

[53]  Ta-Sung Lee,et al.  A variable step-size sign algorithm for channel estimation , 2014, Signal Process..

[54]  José Carlos M. Bermudez,et al.  Mean-square stability of the Normalized Least-Mean Fourth algorithm for white Gaussian inputs , 2011, Digit. Signal Process..

[55]  Jae-Woo Lee,et al.  Data-selective diffusion LMS for reducing communication overhead , 2015, Signal Process..

[56]  Jie Chen,et al.  Nonnegative Least-Mean-Square Algorithm , 2011, IEEE Transactions on Signal Processing.