Proportionate Minimum Error Entropy Algorithm for Sparse System Identification

Sparse system identification has received a great deal of attention due to its broad applicability. The proportionate normalized least mean square (PNLMS) algorithm, as a popular tool, achieves excellent performance for sparse system identification. In previous studies, most of the cost functions used in proportionate-type sparse adaptive algorithms are based on the mean square error (MSE) criterion, which is optimal only when the measurement noise is Gaussian. However, this condition does not hold in most real-world environments. In this work, we use the minimum error entropy (MEE) criterion, an alternative to the conventional MSE criterion, to develop the proportionate minimum error entropy (PMEE) algorithm for sparse system identification, which may achieve much better performance than the MSE based methods especially in heavy-tailed non-Gaussian situations. Moreover, we analyze the convergence of the proposed algorithm and derive a sufficient condition that ensures the mean square convergence. Simulation results confirm the excellent performance of the new algorithm.

[1]  Ercan E. Kuruoglu,et al.  Alpha-Stable Channel Capacity , 2011, IEEE Communications Letters.

[2]  Badong Chen,et al.  Some Further Results on the Minimum Error Entropy Estimation , 2012, Entropy.

[3]  Konstantinos N. Plataniotis,et al.  Nonlinear Filtering of Non-Gaussian Noise , 1997, J. Intell. Robotic Syst..

[4]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[5]  Jie Yang,et al.  Efficient μ-law improved proportionate affine projection algorithm for echo cancellation , 2011 .

[6]  Zengqi Sun,et al.  Stochastic Gradient Algorithm Under (h,φ)-Entropy Criterion , 2007 .

[7]  Deniz Erdogmus,et al.  An error-entropy minimization algorithm for supervised training of nonlinear adaptive systems , 2002, IEEE Trans. Signal Process..

[8]  Rafik A. Goubran,et al.  Improved Proportionate Subband NLMS for Acoustic Echo Cancellation in Changing Environments , 2008, IEEE Signal Processing Letters.

[9]  Deniz Erdogmus,et al.  Convergence properties and data efficiency of the minimum error entropy criterion in ADALINE training , 2003, IEEE Trans. Signal Process..

[10]  Francisco das Chagas de Souza,et al.  An Enhanced IAF-PNLMS Adaptive Algorithm for Sparse Impulse Response Identification , 2012, IEEE Transactions on Signal Processing.

[11]  Jacob Benesty,et al.  An Efficient Proportionate Affine Projection Algorithm for Echo Cancellation , 2010, IEEE Signal Processing Letters.

[12]  Badong Chen,et al.  System Parameter Identification: Information Criteria and Algorithms , 2013 .

[13]  Jingdong Chen,et al.  Acoustic MIMO Signal Processing , 2006 .

[14]  Zhaoyang Zhang,et al.  Diffusion Information Theoretic Learning for Distributed Estimation Over Network , 2013, IEEE Transactions on Signal Processing.

[15]  Badong Chen,et al.  On the Smoothed Minimum Error Entropy Criterion , 2012, Entropy.

[16]  Jose C. Principe,et al.  Information Theoretic Learning - Renyi's Entropy and Kernel Perspectives , 2010, Information Theoretic Learning.

[17]  Tareq Y. Al-Naffouri,et al.  Adaptive Filters with Error Nonlinearities: Mean-Square Analysis and Optimum Design , 2001, EURASIP J. Adv. Signal Process..

[18]  Badong Chen,et al.  Mean-Square Convergence Analysis of ADALINE Training With Minimum Error Entropy Criterion , 2010, IEEE Transactions on Neural Networks.

[19]  Jacob Benesty,et al.  Sparse Adaptive Filters for Echo Cancellation , 2010, Synthesis Lectures on Speech and Audio Processing.

[20]  Zongze Wu,et al.  Minimum Error Entropy Algorithms with Sparsity Penalty Constraints , 2015, Entropy.

[21]  Luc Pronzato,et al.  Minimum-entropy estimation in semi-parametric models , 2005, Signal Process..

[22]  Binwei Weng,et al.  Nonlinear system identification in impulsive environments , 2005, IEEE Transactions on Signal Processing.

[23]  Milos Doroslovacki,et al.  Improving convergence of the PNLMS algorithm for sparse impulse response identification , 2005, IEEE Signal Processing Letters.

[24]  Ali H. Sayed,et al.  Fundamentals Of Adaptive Filtering , 2003 .

[25]  Yi Yu,et al.  Memory Proportionate APA with Individual Activation Factors for Acoustic Echo Cancellation , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[26]  Yahong Rosa Zheng,et al.  Proportionate Affine Projection Sign Algorithms for Network Echo Cancellation , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[27]  Milos Doroslovacki,et al.  Proportionate adaptive algorithms for network echo cancellation , 2006, IEEE Transactions on Signal Processing.