Weighted diffusion continuous mixed p-norm algorithm for distributed estimation in non-uniform noise environment

Abstract This paper presents weighted diffusion least mean p-power (LMP) algorithm for distributed estimation of an unknown sparse vector in a sensor network. We consider a network, in which the variances of the noise for sensors are different, i.e., non-uniform noise condition. We replace the sum of mean square errors with a weighted sum of LMP for global and local cost functions of a sensor network. The weights are adaptive and are updated by a simple steepest-descent recursion to minimize the global and local cost functions of the adaptive algorithm. Further, we propose the adaptive weighted diffusion continuous mixed p-norm (CMPN) algorithm, which further improves the performance of the proposed weighted diffusion LMP algorithm. In the proposed weighted diffusion CMPN algorithm, p-power is considered adaptive and continuous in the range 1 ≤ p ≤ 2. Unlike the CMPN algorithm in the literature with uniform weights, the weighted diffusion CMPN algorithm uses adaptive weights, which are updated by a simple steepest descent recursion. We also extend the proposed algorithm to one-bit distributed estimation scenario. Performance analysis and simulation results show the efficacy of the proposed weighted diffusion LMP and CMPN algorithms. Further, the proposed one-bit weighted diffusion algorithms exhibit robustness against the different noise distributions.

[1]  Peter J. W. Rayner,et al.  Least Lp-norm impulsive noise cancellation with polynomial filters , 1998, Signal Process..

[2]  Ali H. Sayed,et al.  Sparse Distributed Learning Based on Diffusion Adaptation , 2012, IEEE Transactions on Signal Processing.

[3]  Farrokh Marvasti,et al.  Robust Sparse Recovery in Impulsive Noise via Continuous Mixed Norm , 2018, IEEE Signal Processing Letters.

[4]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[5]  C. L. Nikias,et al.  Signal processing with fractional lower order moments: stable processes and their applications , 1993, Proc. IEEE.

[6]  Danilo P. Mandic,et al.  Distributed Particle Filtering of $\alpha$ -Stable Signals , 2017, IEEE Signal Processing Letters.

[7]  A. Cetin,et al.  Robust adaptive filtering algorithms for /spl alpha/-stable random processes , 1999 .

[8]  W. Mitsuhashi,et al.  Improving robustness of filtered-x least mean p-power algorithm for active attenuation of standard symmetric-α-stable impulsive noise , 2011 .

[9]  Mehdi Korki,et al.  A Distributed 1-bit Compressed Sensing Algorithm Robust to Impulsive Noise , 2016, IEEE Communications Letters.

[10]  Magno T. M. Silva,et al.  Distributed estimation in diffusion networks using affine least-squares combiners , 2015, Digit. Signal Process..

[11]  Ali H. Sayed,et al.  Robust Adaptation in Impulsive Noise , 2016, IEEE Transactions on Signal Processing.

[12]  Marc Moonen,et al.  Distributed adaptive node-specific signal estimation in heterogeneous and mixed-topology wireless sensor networks , 2015, Signal Process..

[13]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[14]  Ali H. Sayed,et al.  Combinations of Adaptive Filters: Performance and convergence properties , 2021, IEEE Signal Processing Magazine.

[15]  Haiquan Zhao,et al.  A Novel Normalized Sign Algorithm for System Identification Under Impulsive Noise Interference , 2015, Circuits Syst. Signal Process..

[16]  Sung Ho Cho,et al.  Performance of least mean absolute third (LMAT) adaptive algorithm in various noise environments , 1998 .

[17]  Reza Abdolee,et al.  An Iterative Scheme for Computing Combination Weights in Diffusion Wireless Networks , 2017, IEEE Wireless Communications Letters.

[18]  Hadi Zayyani,et al.  Continuous Mixed $p$-Norm Adaptive Algorithm for System Identification , 2014, IEEE Signal Processing Letters.

[19]  Jian Yang,et al.  Variable step-size diffusion least mean fourth algorithm for distributed estimation , 2016, Signal Process..

[20]  Fuxi Wen,et al.  Diffusion Least Mean P-Power Algorithms for Distributed Estimation in Alpha-Stable Noise Environments , 2013, ArXiv.

[21]  Farrokh Marvasti,et al.  An Iterative Dictionary Learning-Based Algorithm for DOA Estimation , 2016, IEEE Communications Letters.

[22]  Ercan E. Kuruoglu,et al.  Nonlinear Least lp-Norm Filters for Nonlinear Autoregressive alpha-Stable Processes , 2002, Digit. Signal Process..

[23]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[24]  Jae-Woo Lee,et al.  A new robust variable weighting coefficients diffusion LMS algorithm , 2017, Signal Process..

[25]  Zhi Li,et al.  Continuous mixed p-norm adaptive algorithm with reweighted L0-norm constraint , 2017, 2017 First International Conference on Electronics Instrumentation & Information Systems (EIIS).

[26]  A. Enis Çetin,et al.  Adaptive filtering approaches for non-Gaussian stable processes , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[27]  Jiandong Duan,et al.  General Mixed-Norm-Based Diffusion Adaptive Filtering Algorithm for Distributed Estimation Over Network , 2017, IEEE Access.

[28]  Chien-Cheng Tseng,et al.  Least mean p-power error criterion for adaptive FIR filter , 1994, IEEE J. Sel. Areas Commun..

[29]  Haiquan Zhao,et al.  Generalized Variable Step Size Continuous Mixed ${p}$ -Norm Adaptive Filtering Algorithm , 2019, IEEE Transactions on Circuits and Systems II: Express Briefs.

[30]  Babak Hossein Khalaj,et al.  Compressive Sensing-Based Pilot Design for Sparse Channel Estimation in OFDM Systems , 2017, IEEE Communications Letters.

[31]  Raja Muhammad Asif Zahoor,et al.  Fractional processing-based active noise control algorithm for impulsive noise , 2015, 2015 IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP).

[32]  Georgios B. Giannakis,et al.  Distributed Spectrum Sensing for Cognitive Radio Networks by Exploiting Sparsity , 2010, IEEE Transactions on Signal Processing.

[33]  Cishen Zhang,et al.  Block-Sparse Impulsive Noise Reduction in OFDM Systems—A Novel Iterative Bayesian Approach , 2016, IEEE Transactions on Communications.

[34]  Binwei Weng,et al.  Nonlinear system identification in impulsive environments , 2005, IEEE Transactions on Signal Processing.

[35]  Chunguang Li,et al.  Distributed Sparse Total Least-Squares Over Networks , 2015, IEEE Transactions on Signal Processing.

[36]  PooGyeon Park,et al.  A variable step-size diffusion affine projection algorithm , 2016, Int. J. Commun. Syst..

[37]  Yi Yu,et al.  Performance Analysis of the Robust Diffusion Normalized Least Mean ${p}$ -Power Algorithm , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[38]  Minyue Fu,et al.  Distributed weighted least-squares estimation with fast convergence for large-scale systems , 2015, 52nd IEEE Conference on Decision and Control.

[39]  Danilo P. Mandic,et al.  Distributed Adaptive Filtering of $\alpha$ -Stable Signals , 2018, IEEE Signal Processing Letters.

[40]  Mehdi Korki,et al.  Bayesian hypothesis testing detector for one bit diffusion LMS with blind missing samples , 2018, Signal Process..

[41]  Badong Chen,et al.  Improved-Variable-Forgetting-Factor Recursive Algorithm Based on the Logarithmic Cost for Volterra System Identification , 2016, IEEE Transactions on Circuits and Systems II: Express Briefs.

[42]  Cishen Zhang,et al.  Iterative Bayesian Reconstruction of Non-IID Block-Sparse Signals , 2014, IEEE Transactions on Signal Processing.

[43]  Ali Sayed,et al.  Adaptation, Learning, and Optimization over Networks , 2014, Found. Trends Mach. Learn..

[44]  Yi Yu,et al.  A new normalized LMAT algorithm and its performance analysis , 2014, Signal Process..

[45]  PooGyeon Park,et al.  A diffusion subband adaptive filtering algorithm for distributed estimation using variable step size and new combination method based on the MSD , 2016, Digit. Signal Process..

[46]  Jingen Ni,et al.  Diffusion Sign Subband Adaptive Filtering Algorithm for Distributed Estimation , 2015, IEEE Signal Processing Letters.

[47]  Wallace Kit-Sang Tang,et al.  Enhanced incremental LMS with norm constraints for distributed in-network estimation , 2014, Signal Process..

[48]  Mehdi Korki,et al.  Dictionary Learning for Blind One Bit Compressed Sensing , 2015, IEEE Signal Processing Letters.

[49]  Eweda Eweda,et al.  Stochastic Analysis of a Stable Normalized Least Mean Fourth Algorithm for Adaptive Noise Canceling With a White Gaussian Reference , 2012, IEEE Transactions on Signal Processing.

[50]  V. J. Mathews,et al.  Improved convergence analysis of stochastic gradient adaptive filters using the sign algorithm , 1987, IEEE Trans. Acoust. Speech Signal Process..

[51]  Jiandong Duan,et al.  Diffusion maximum correntropy criterion algorithms for robust distributed estimation , 2015, Digit. Signal Process..

[52]  Guoqing Wang,et al.  Diffusion distributed Kalman filter over sensor networks without exchanging raw measurements , 2017, Signal Process..

[53]  Mohammad Shams Esfand Abadi,et al.  Diffusion normalized subband adaptive algorithm for distributed estimation employing signed regressor of input signal , 2017, Digit. Signal Process..

[54]  Christian Jutten,et al.  An Iterative Bayesian Algorithm for Sparse Component Analysis in Presence of Noise , 2009, IEEE Transactions on Signal Processing.

[55]  Eweda Eweda,et al.  Global Stabilization of the Least Mean Fourth Algorithm , 2012, IEEE Transactions on Signal Processing.

[56]  Fuxi Wen Diffusion LMP algorithm with adaptive variable power , 2014 .