A Robust Diffusion Adaptive Network Based on the Maximum Correntropy Criterion

Adaptive estimation over distributed networks has received a lot of attention due to its broad range of applications. A useful estimation strategy is diffusion adaptive network, where the parameters of interest can be well estimated from noisy measurements through diffusion cooperation between nodes. The conventional diffusion algorithms exhibit good performance in the presence of Gaussian noise but their performance decreases in presence of impulsive noise. The aim of the present paper is to propose a robust diffusion based algorithm that alleviates the effect of impulsive noise. To this end, we move beyond mean squared error (MSE) criterion and recast the estimation problem in terms of the maximum correntropy criterion (MCC). We use stochastic gradient ascent and useful approximations to derive an adaptive algorithm which is appropriate for distributed implementation. The resultant algorithm has the computational simplicity of the popular LMS algorithm, along with the robustness that is obtained by using higher order moments. We present some simulations results which show that the proposed algorithm outperforms existing alternative that rely MSE criterion.

[1]  Ali H. Sayed,et al.  Diffusion recursive least-squares for distributed estimation over adaptive networks , 2008, IEEE Transactions on Signal Processing.

[2]  Ali H. Sayed,et al.  Distributed processing over adaptive networks , 2007, 2007 9th International Symposium on Signal Processing and Its Applications.

[3]  Ganapati Panda,et al.  Robust identification using new Wilcoxon least mean square algorithm , 2009 .

[4]  Weifeng Liu,et al.  Correntropy: Properties and Applications in Non-Gaussian Signal Processing , 2007, IEEE Transactions on Signal Processing.

[5]  Bernard Mulgrew,et al.  Error Saturation Nonlinearities for Robust Incremental LMS over Wireless Sensor Networks , 2014, ACM Trans. Sens. Networks.

[6]  A.H. Sayed,et al.  Distributed Recursive Least-Squares Strategies Over Adaptive Networks , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[7]  Fuxi Wen,et al.  Diffusion Least Mean P-Power Algorithms for Distributed Estimation in Alpha-Stable Noise Environments , 2013, ArXiv.

[8]  Ali H. Sayed,et al.  Incremental Adaptive Strategies Over Distributed Networks , 2007, IEEE Transactions on Signal Processing.

[9]  Jie Chen,et al.  Multitask Diffusion Adaptation Over Networks , 2013, IEEE Transactions on Signal Processing.

[10]  Ioannis D. Schizas,et al.  Distributed LMS for Consensus-Based In-Network Adaptive Processing , 2009, IEEE Transactions on Signal Processing.

[11]  Sergio Barbarossa,et al.  Distributed Detection and Estimation in Wireless Sensor Networks , 2013, ArXiv.

[12]  Ali Sayed,et al.  Adaptation, Learning, and Optimization over Networks , 2014, Found. Trends Mach. Learn..

[13]  Seong Rag Kim,et al.  Adaptive robust impulse noise filtering , 1995, IEEE Trans. Signal Process..

[14]  Neil J. Bershad On Error Saturation Nonlinearities for LMS Adaptation in Impulsive Noise , 2008, IEEE Transactions on Signal Processing.

[15]  Ali H. Sayed,et al.  Diffusion Least-Mean Squares Over Adaptive Networks: Formulation and Performance Analysis , 2008, IEEE Transactions on Signal Processing.

[16]  Ali H. Sayed,et al.  Diffusion LMS Strategies for Distributed Estimation , 2010, IEEE Transactions on Signal Processing.

[17]  Ali H. Sayed,et al.  Distributed Estimation Over an Adaptive Incremental Network Based on the Affine Projection Algorithm , 2010, IEEE Transactions on Signal Processing.

[18]  C. L. Nikias,et al.  Signal processing with fractional lower order moments: stable processes and their applications , 1993, Proc. IEEE.

[19]  Sergio Barbarossa,et al.  Distributed least mean squares strategies for sparsity-aware estimation over Gaussian Markov random fields , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[20]  Azam Khalili,et al.  Derivation and analysis of incremental augmented complex least mean square algorithm , 2015, IET Signal Process..

[21]  Azam Khalili,et al.  A Distributed Algorithm for In-Network Adaptive Estimation Using Incremental Aggregated Gradient , 2014, ICWMC 2014.

[22]  Soummya Kar,et al.  Convergence Rate Analysis of Distributed Gossip (Linear Parameter) Estimation: Fundamental Limits and Tradeoffs , 2010, IEEE Journal of Selected Topics in Signal Processing.

[23]  Jose C. Principe,et al.  Information Theoretic Learning - Renyi's Entropy and Kernel Perspectives , 2010, Information Theoretic Learning.

[24]  Ali H. Sayed,et al.  Diffusion Strategies Outperform Consensus Strategies for Distributed Estimation Over Adaptive Networks , 2012, IEEE Transactions on Signal Processing.