Robust Distributed Diffusion Recursive Least Squares Algorithms With Side Information for Adaptive Networks

This work develops robust diffusion recursive least-squares algorithms to mitigate the performance degradation often experienced in networks of agents in the presence of impulsive noise. The first algorithm minimizes an exponentially weighted least-squares cost function subject to a time-dependent constraint on the squared norm of the intermediate update at each node. A recursive strategy for computing the constraint is proposed using side information from the neighboring nodes to further improve the robustness. We also analyze the mean-square convergence behavior of the proposed algorithm. The second proposed algorithm is a modification of the first one based on the dichotomous coordinate descent iterations. It has a performance similar to that of the former, however, its complexity is significantly lower especially when input regressors of agents have a shift structure and it is well suited to practical implementation. Simulations show the superiority of the proposed algorithms over previously reported techniques in various impulsive noise scenarios.

[1]  Upendra Kumar Sahoo,et al.  Diffusion minimum-Wilcoxon-norm over distributed adaptive networks: Formulation and performance analysis , 2016, Digit. Signal Process..

[2]  H. Vincent Poor,et al.  Adaptive link selection algorithms for distributed estimation , 2015, EURASIP Journal on Advances in Signal Processing.

[3]  Danilo P. Mandic,et al.  Distributed Widely Linear Kalman Filtering for Frequency Estimation in Power Networks , 2015, IEEE Transactions on Signal and Information Processing over Networks.

[4]  H. Vincent Poor,et al.  Distributed estimation over sensor networks based on distributed conjugate gradient strategies , 2016, IET Signal Process..

[5]  Reza Abdolee,et al.  An Iterative Scheme for Computing Combination Weights in Diffusion Wireless Networks , 2017, IEEE Wireless Communications Letters.

[6]  Michael Muma,et al.  Robust Estimation in Signal Processing: A Tutorial-Style Treatment of Fundamental Concepts , 2012, IEEE Signal Processing Magazine.

[7]  Rodrigo C. de Lamare,et al.  Decoder-Optimised Progressive Edge Growth Algorithms for the Design of LDPC Codes with Low Error Floors , 2012, IEEE Communications Letters.

[8]  S. Haykin Adaptive Filters , 2007 .

[9]  J. Miller,et al.  The Detection of Signals in Impulsive Noise Modeled as a Mixture Process , 1976, IEEE Trans. Commun..

[10]  H. Vincent Poor,et al.  Distributed Compressed Estimation Based on Compressive Sensing , 2015, IEEE Signal Processing Letters.

[11]  Tareq Y. Al-Naffouri,et al.  Transient analysis of adaptive filters with error nonlinearities , 2003, IEEE Trans. Signal Process..

[12]  Sheng Zhang,et al.  Non-parametric variable step-size diffusion LMS algorithm over adaptive networks , 2017 .

[13]  H. Vincent Poor,et al.  Distributed Spectrum Estimation Based on Alternating Mixed Discrete-Continuous Adaptation , 2016, IEEE Signal Processing Letters.

[14]  Robert W. Newcomb,et al.  A Normalized Least Mean Squares Algorithm With a Step-Size Scaler Against Impulsive Measurement Noise , 2013, IEEE Transactions on Circuits and Systems II: Express Briefs.

[15]  Jie Chen,et al.  Diffusion sign-error LMS algorithm: Formulation and stochastic behavior analysis , 2016, Signal Process..

[16]  Rodrigo C. de Lamare,et al.  Adaptive and Iterative Multi-Branch MMSE Decision Feedback Detection Algorithms for Multi-Antenna Systems , 2013, IEEE Trans. Wirel. Commun..

[17]  T. Tozer,et al.  Multiplication-free iterative algorithm for LS problem , 2004 .

[18]  Jacob Benesty,et al.  A Fast Robust Recursive Least-Squares Algorithm , 2009, IEEE Transactions on Signal Processing.

[19]  Shing-Chow Chan,et al.  New Sequential Partial-Update Least Mean M-Estimate Algorithms for Robust Adaptive System Identification in Impulsive Noise , 2011, IEEE Transactions on Industrial Electronics.

[20]  Neil J. Bershad On Error Saturation Nonlinearities for LMS Adaptation in Impulsive Noise , 2008, IEEE Transactions on Signal Processing.

[21]  Fuxi Wen,et al.  Diffusion Least Mean P-Power Algorithms for Distributed Estimation in Alpha-Stable Noise Environments , 2013, ArXiv.

[22]  Panayiotis G. Georgiou,et al.  Alpha-Stable Modeling of Noise and Robust Time-Delay Estimation in the Presence of Impulsive Noise , 1999, IEEE Trans. Multim..

[23]  Ioannis D. Schizas,et al.  Distributed Recursive Least-Squares for Consensus-Based In-Network Adaptive Estimation , 2009, IEEE Transactions on Signal Processing.

[24]  Ali H. Sayed,et al.  Diffusion Strategies Outperform Consensus Strategies for Distributed Estimation Over Adaptive Networks , 2012, IEEE Transactions on Signal Processing.

[25]  Duan Jiandong,et al.  Robust diffusion recursive adaptive filtering algorithm based on lp-norm , 2016, 2016 35th Chinese Control Conference (CCC).

[26]  Yunlong Cai,et al.  Variable forgetting factor mechanisms for diffusion recursive least squares algorithm in sensor networks , 2017, EURASIP J. Adv. Signal Process..

[27]  Badong Chen,et al.  Improved-Variable-Forgetting-Factor Recursive Algorithm Based on the Logarithmic Cost for Volterra System Identification , 2016, IEEE Transactions on Circuits and Systems II: Express Briefs.

[28]  Sergios Theodoridis,et al.  Adaptive Robust Distributed Learning in Diffusion Sensor Networks , 2011, IEEE Transactions on Signal Processing.

[29]  Jae-Woo Lee,et al.  A Variable Step-Size Diffusion LMS Algorithm for Distributed Estimation , 2015, IEEE Transactions on Signal Processing.

[30]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[31]  Robert Price,et al.  A useful theorem for nonlinear devices having Gaussian inputs , 1958, IRE Trans. Inf. Theory.

[32]  Junwoong Hur,et al.  A Variable Step-Size Normalized Subband Adaptive Filter With a Step-Size Scaler Against Impulsive Measurement Noise , 2017, IEEE Transactions on Circuits and Systems II: Express Briefs.

[33]  Stuart C. Schwartz,et al.  Comparison of adaptive and robust receivers for signal detection in ambient underwater noise , 1989, IEEE Trans. Acoust. Speech Signal Process..

[34]  Rodrigo C. de Lamare,et al.  Adaptive reduced-rank processing based on joint and iterative interpolation, decimation, and filtering , 2009, IEEE Trans. Signal Process..

[35]  Rodrigo C. de Lamare,et al.  Reduced-Rank STAP Schemes for Airborne Radar Based on Switched Joint Interpolation, Decimation and Filtering Algorithm , 2010, IEEE Transactions on Signal Processing.

[36]  Yuriy V. Zakharov,et al.  DCD-RLS Adaptive Filters With Penalties for Sparse Identification , 2013, IEEE Transactions on Signal Processing.

[37]  Rodrigo C. de Lamare,et al.  Low-Latency Reweighted Belief Propagation Decoding for LDPC Codes , 2012, IEEE Communications Letters.

[38]  Wei-Ping Zhu,et al.  Spectrum sensing based on fractional lower order moments for cognitive radios in α-stable distributed noise , 2015, Signal Process..

[39]  C. L. Nikias,et al.  Signal processing with fractional lower order moments: stable processes and their applications , 1993, Proc. IEEE.

[40]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[41]  Jiandong Duan,et al.  Diffusion maximum correntropy criterion algorithms for robust distributed estimation , 2015, Digit. Signal Process..

[42]  M. Chitre,et al.  Optimal and Near-Optimal Signal Detection in Snapping Shrimp Dominated Ambient Noise , 2006, IEEE Journal of Oceanic Engineering.

[43]  Rodrigo C. de Lamare,et al.  Multiple Feedback Successive Interference Cancellation Detection for Multiuser MIMO Systems , 2011, IEEE Transactions on Wireless Communications.

[44]  Ali H. Sayed,et al.  Distributed Pareto Optimization via Diffusion Strategies , 2012, IEEE Journal of Selected Topics in Signal Processing.

[45]  Benoît Champagne,et al.  Diffusion total least-squares algorithm with multi-node feedback , 2018, Signal Process..

[46]  Azam Khalili,et al.  Analysis of partial diffusion recursive least squares adaptation over noisy links , 2017, IET Signal Process..

[47]  Ali H. Sayed,et al.  Adaptive Networks , 2014, Proceedings of the IEEE.

[48]  Qing Ling,et al.  Decentralized RLS With Data-Adaptive Censoring for Regressions Over Large-Scale Networks , 2016, IEEE Transactions on Signal Processing.

[49]  Chunguang Li,et al.  Distributed Sparse Recursive Least-Squares Over Networks , 2014, IEEE Transactions on Signal Processing.

[50]  Fei Wang,et al.  Maximum Total Correntropy Diffusion Adaptation Over Networks With Noisy Links , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[51]  Ali H. Sayed,et al.  Robust Distributed Estimation by Networked Agents , 2017, IEEE Transactions on Signal Processing.

[52]  Jae-Woo Lee,et al.  A new robust variable weighting coefficients diffusion LMS algorithm , 2017, Signal Process..

[53]  Ali Sayed,et al.  Adaptation, Learning, and Optimization over Networks , 2014, Found. Trends Mach. Learn..

[54]  Rodrigo C. de Lamare,et al.  Robust Adaptive Beamforming Based on Low-Rank and Cross-Correlation Techniques , 2016, IEEE Trans. Signal Process..

[55]  Andreas Antoniou,et al.  Robust Recursive Least-Squares Adaptive-Filtering Algorithm for Impulsive-Noise Environments , 2011, IEEE Signal Processing Letters.

[56]  Jacob Benesty,et al.  A New Robust Variable Step-Size NLMS Algorithm , 2008, IEEE Transactions on Signal Processing.

[57]  Maboud Farzaneh Kaloorazi,et al.  Subspace-Orbit Randomized Decomposition for Low-Rank Matrix Approximations , 2018, IEEE Transactions on Signal Processing.

[58]  Rodrigo C. de Lamare,et al.  Compressed Randomized UTV Decompositions for Low-Rank Matrix Approximations , 2018, IEEE Journal of Selected Topics in Signal Processing.

[59]  Ali H. Sayed,et al.  Distributed Spectrum Estimation for Small Cell Networks Based on Sparse Diffusion Adaptation , 2013, IEEE Signal Processing Letters.

[60]  Isao Yamada,et al.  Diffusion Least-Mean Squares With Adaptive Combiners: Formulation and Performance Analysis , 2010, IEEE Transactions on Signal Processing.

[61]  H. Vincent Poor,et al.  Distributed low-rank adaptive estimation algorithms based on alternating optimization , 2018, Signal Process..

[62]  Ali H. Sayed,et al.  Adjustment of combination weights over adaptive diffusion networks , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[63]  Konstantinos Pelekanakis,et al.  Adaptive Sparse Channel Estimation under Symmetric alpha-Stable Noise , 2014, IEEE Transactions on Wireless Communications.

[64]  Shun-ichi Amari,et al.  Why natural gradient? , 1998, Proceedings of the 1998 IEEE International Conference on Acoustics, Speech and Signal Processing, ICASSP '98 (Cat. No.98CH36181).

[65]  Luciano Leonel Mendes,et al.  Knowledge-aided informed dynamic scheduling for LDPC decoding of short blocks , 2018, IET Commun..

[66]  Rodrigo C. de Lamare,et al.  Reduced-dimension robust capon beamforming using Krylov-subspace techniques , 2015, IEEE Transactions on Aerospace and Electronic Systems.

[67]  Rodrigo C. de Lamare,et al.  Adaptive reduced-rank MMSE filtering with interpolated FIR filters and adaptive interpolators , 2005, IEEE Signal Process. Lett..

[68]  Rodrigo C. de Lamare,et al.  Design of LDPC Codes Based on Multipath EMD Strategies for Progressive Edge Growth , 2016, IEEE Transactions on Communications.

[69]  Rodrigo C. de Lamare,et al.  Robust Adaptive Beamforming Using a Low-Complexity Shrinkage-Based Mismatch Estimation Algorithm , 2013, IEEE Signal Processing Letters.

[70]  Theodore S. Rappaport,et al.  Measurements and Models of Radio Frequency Impulsive Noise for Indoor Wireless Communications , 1993, IEEE J. Sel. Areas Commun..

[71]  Rodrigo C. de Lamare,et al.  Robust Diffusion Recursive Least Squares Estimation with Side Information for Networked Agents , 2018, 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[72]  Ali H. Sayed,et al.  Diffusion Adaptation Strategies for Distributed Optimization and Learning Over Networks , 2011, IEEE Transactions on Signal Processing.

[73]  Xin Wang,et al.  Mixture correntropy for robust learning , 2018, Pattern Recognit..

[74]  Jie Liu,et al.  Promoting Access to White Rose Research Papers Low-complexity Rls Algorithms Using Dichotomous Coordinate Descent Iterations , 2022 .

[75]  Richard Demo Souza,et al.  Design of LDPC Codes Based on Progressive Edge Growth Techniques for Block Fading Channels , 2011, IEEE Communications Letters.

[76]  Ali H. Sayed,et al.  Mobile Adaptive Networks , 2011, IEEE Journal of Selected Topics in Signal Processing.

[77]  Guan Gui,et al.  Robust diffusion recursive adaptive filtering algorithm based on l p -norm , 2016, CCC 2016.

[78]  Ali H. Sayed,et al.  Distributed Estimation Over an Adaptive Incremental Network Based on the Affine Projection Algorithm , 2010, IEEE Transactions on Signal Processing.

[79]  Jie Liu,et al.  Architecture and FPGA Design of Dichotomous Coordinate Descent Algorithms , 2009, IEEE Transactions on Circuits and Systems I: Regular Papers.

[80]  Xiang Li,et al.  $L_1$ -Regularized STAP Algorithms With a Generalized Sidelobe Canceler Architecture for Airborne Radar , 2012, IEEE Transactions on Signal Processing.

[81]  Ali H. Sayed,et al.  Diffusion strategies for adaptation and learning over networks: an examination of distributed strategies and network behavior , 2013, IEEE Signal Processing Magazine.

[82]  Stefan Werner,et al.  Reduced-complexity distributed least-squares estimation over adaptive networks , 2013, 2013 IEEE 14th Workshop on Signal Processing Advances in Wireless Communications (SPAWC).