A Low Complexity Proportionate Generlized Correntropy-Based Diffusion LMS Algorithm With Closed-Form Gain Coefficients

This brief proposes a correntropy-based proportionate diffusion algorithm with low computational complexity. The proportionate diffusion algorithms in the literature suffer from a high computational complexity due to the complicated calculation process of the coefficients of the gain matrix, i.e., by solving an optimization problem or solving a linear system of equations via a matrix inversion. In this brief, by defining a proper correntropy kernel function and suitably assuming a wise constraint, the gain matrix coefficients are derived in a closed-form formula. In fact, the correntropy kernel function is used to determine the gain coefficients. This closed-form formula significantly reduces the computational complexity of the proposed algorithm. Moreover, a condition of uniform convergence for the distributed estimation algorithm at each time instant is obtained analytically. Simulation results show the lower steady-state Normalized Mean Square Deviation (NMSD) and lower computational complexity of the proposed algorithm compared to some other competing algorithms.

[1]  Alireza Naeimi Sadigh,et al.  A Proportionate Robust Diffusion Recursive Least Exponential Hyperbolic Cosine Algorithm for Distributed Estimation , 2022, IEEE Transactions on Circuits and Systems II: Express Briefs.

[2]  Hadi Zayyani,et al.  A Robust Generalized Proportionate Diffusion LMS Algorithm for Distributed Estimation , 2021, IEEE Transactions on Circuits and Systems II: Express Briefs.

[3]  Hadi Zayyani,et al.  Robust Minimum Disturbance Diffusion LMS for Distributed Estimation , 2021, IEEE Transactions on Circuits and Systems II: Express Briefs.

[4]  Jae-Woo Lee,et al.  Adaptive Algorithm for Sparse System Identification Based on Hard-Thresholding Techniques , 2020, IEEE Transactions on Circuits and Systems II: Express Briefs.

[5]  Paulo S. R. Diniz,et al.  Feature Adaptive Filtering: Exploiting Hidden Sparsity , 2020, IEEE Transactions on Circuits and Systems I: Regular Papers.

[6]  Mehdi Korki,et al.  Weighted diffusion continuous mixed p-norm algorithm for distributed estimation in non-uniform noise environment , 2019, Signal Process..

[7]  Yi Yu,et al.  Performance Analysis of the Robust Diffusion Normalized Least Mean ${p}$ -Power Algorithm , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[8]  Farrokh Marvasti,et al.  Robust Sparse Recovery in Impulsive Noise via Continuous Mixed Norm , 2018, IEEE Signal Processing Letters.

[9]  Fei Wang,et al.  Maximum Total Correntropy Diffusion Adaptation Over Networks With Noisy Links , 2018, IEEE Transactions on Circuits and Systems II: Express Briefs.

[10]  P. Park,et al.  Diffusion proportionate affine projection sign algorithm for distributed estimation over network , 2017, 2017 14th International Conference on Electrical Engineering/Electronics, Computer, Telecommunications and Information Technology (ECTI-CON).

[11]  Mehdi Korki,et al.  A Distributed 1-bit Compressed Sensing Algorithm Robust to Impulsive Noise , 2016, IEEE Communications Letters.

[12]  Jiandong Duan,et al.  Diffusion maximum correntropy criterion algorithms for robust distributed estimation , 2015, Digit. Signal Process..

[13]  Woo-Jin Song,et al.  A Proportionate Diffusion LMS Algorithm for Sparse Distributed Estimation , 2015, IEEE Transactions on Circuits and Systems II: Express Briefs.

[14]  Nanning Zheng,et al.  Generalized Correntropy for Robust Adaptive Filtering , 2015, IEEE Transactions on Signal Processing.

[15]  Ali Sayed,et al.  Adaptation, Learning, and Optimization over Networks , 2014, Found. Trends Mach. Learn..

[16]  Fuxi Wen,et al.  Diffusion Least Mean P-Power Algorithms for Distributed Estimation in Alpha-Stable Noise Environments , 2013, ArXiv.

[17]  Zhaoyang Zhang,et al.  Diffusion Sparse Least-Mean Squares Over Networks , 2012, IEEE Transactions on Signal Processing.

[18]  Ali H. Sayed,et al.  Sparse Distributed Learning Based on Diffusion Adaptation , 2012, IEEE Transactions on Signal Processing.

[19]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[20]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[21]  Vinay Chakravarthi Gogineni,et al.  Fractional-Order Correntropy Adaptive Filters for Distributed Processing of $\alpha$-Stable Signals , 2020, IEEE Signal Processing Letters.

[22]  D. Mandic,et al.  Distributed Adaptive Filtering of α-Stable Signals Distributed Adaptive Filtering of α -Stable Signals , 2018 .