A Soft Parameter Function Penalized Normalized Maximum Correntropy Criterion Algorithm for Sparse System Identification

A soft parameter function penalized normalized maximum correntropy criterion (SPF-NMCC) algorithm is proposed for sparse system identification. The proposed SPF-NMCC algorithm is derived on the basis of the normalized adaptive filter theory, the maximum correntropy criterion (MCC) algorithm and zero-attracting techniques. A soft parameter function is incorporated into the cost function of the traditional normalized MCC (NMCC) algorithm to exploit the sparsity properties of the sparse signals. The proposed SPF-NMCC algorithm is mathematically derived in detail. As a result, the proposed SPF-NMCC algorithm can provide an efficient zero attractor term to effectively attract the zero taps and near-zero coefficients to zero, and, hence, it can speed up the convergence. Furthermore, the estimation behaviors are obtained by estimating a sparse system and a sparse acoustic echo channel. Computer simulation results indicate that the proposed SPF-NMCC algorithm can achieve a better performance in comparison with the MCC, NMCC, LMS (least mean square) algorithms and their zero attraction forms in terms of both convergence speed and steady-state performance.

[1]  José Carlos Príncipe,et al.  Using Correntropy as a cost function in linear adaptive filters , 2009, 2009 International Joint Conference on Neural Networks.

[2]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Paulo Sergio Ramirez,et al.  Fundamentals of Adaptive Filtering , 2002 .

[4]  J. G. Harris,et al.  Combined LMS/F algorithm , 1997 .

[5]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[6]  Yanyan Wang,et al.  A Robust Sparse Adaptive Filtering Algorithm with a Correntropy Induced Metric Constraint for Broadband Multi-Path Channel Estimation , 2016, Entropy.

[7]  Zhiwei Li,et al.  Sparse Adaptive Channel Estimation Based on -Norm-Penalized Affine Projection Algorithm , 2014 .

[8]  Yingsong Li,et al.  Sparse SM-NLMS algorithm based on correntropy criterion , 2016 .

[9]  Rodrigo C. de Lamare,et al.  Sparsity-aware pseudo affine projection algorithm for active noise control , 2014, Signal and Information Processing Association Annual Summit and Conference (APSIPA), 2014 Asia-Pacific.

[10]  Babak Hossein Khalaj,et al.  A unified approach to sparse signal processing , 2009, EURASIP Journal on Advances in Signal Processing.

[11]  Ali H. Sayed,et al.  Mean-square performance of a family of affine projection algorithms , 2004, IEEE Transactions on Signal Processing.

[12]  Milos Doroslovacki,et al.  Improving convergence of the PNLMS algorithm for sparse impulse response identification , 2005, IEEE Signal Processing Letters.

[13]  Nanning Zheng,et al.  Generalized Correntropy for Robust Adaptive Filtering , 2015, IEEE Transactions on Signal Processing.

[14]  Vahid Tarokh,et al.  Adaptive algorithms for sparse system identification , 2011, Signal Process..

[15]  Mohammad Shukri Salman,et al.  Sparse leaky‐LMS algorithm for system identification and its convergence analysis , 2014 .

[16]  Bernard Widrow,et al.  The least mean fourth (LMF) adaptive algorithm and its family , 1984, IEEE Trans. Inf. Theory.

[17]  Tao Jiang,et al.  Norm-adaption penalized least mean square/fourth algorithm for sparse channel estimation , 2016, Signal Process..

[18]  S. Haykin,et al.  Adaptive Filter Theory , 1986 .

[19]  Fumiyuki Adachi,et al.  Improved adaptive sparse channel estimation based on the least mean square algorithm , 2013, 2013 IEEE Wireless Communications and Networking Conference (WCNC).

[20]  Li Xu,et al.  Improved adaptive sparse channel estimation using mixed square/fourth error criterion , 2015, J. Frankl. Inst..

[21]  V. Nascimento,et al.  Sparsity-aware affine projection adaptive algorithms for system identification , 2011 .

[22]  Yingsong Li,et al.  An Improved Proportionate Normalized Least-Mean-Square Algorithm for Broadband Multipath Channel Estimation , 2014, TheScientificWorldJournal.

[23]  Yanyan Wang,et al.  Sparse-aware set-membership NLMS algorithms and their application for sparse channel estimation and echo cancelation , 2016 .

[24]  Nanning Zheng,et al.  Steady-State Mean-Square Error Analysis for Adaptive Filtering under the Maximum Correntropy Criterion , 2014, IEEE Signal Processing Letters.

[25]  Deniz Erdogmus,et al.  Generalized information potential criterion for adaptive system training , 2002, IEEE Trans. Neural Networks.

[26]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[27]  Masanori Hamamura,et al.  Zero‐attracting variable‐step‐size least mean square algorithms for adaptive sparse channel estimation , 2015 .

[28]  Fumiyuki Adachi,et al.  Sparse least mean fourth algorithm for adaptive channel estimation in low signal‐to‐noise ratio region , 2014, Int. J. Commun. Syst..

[29]  Kazuhiko Ozeki,et al.  An adaptive filtering algorithm using an orthogonal projection to an affine subspace and its properties , 1984 .

[30]  Abolfazl Mehbodniya,et al.  Two Are Better Than One: Adaptive Sparse System Identification Using Affine Combination of Two Sparse Adaptive Filters , 2013, 2014 IEEE 79th Vehicular Technology Conference (VTC Spring).

[31]  Tao Jiang,et al.  Sparse channel estimation based on a p-norm-like constrained least mean fourth algorithm , 2015, 2015 International Conference on Wireless Communications & Signal Processing (WCSP).

[32]  Nanning Zheng,et al.  Convergence of a Fixed-Point Algorithm under Maximum Correntropy Criterion , 2015, IEEE Signal Processing Letters.

[33]  Zongze Wu,et al.  Proportionate Minimum Error Entropy Algorithm for Sparse System Identification , 2015, Entropy.

[34]  Fumiyuki Adachi,et al.  Sparse least mean fourth filter with zero-attracting ℓ1-norm constraint , 2013, 2013 9th International Conference on Information, Communications & Signal Processing.

[35]  Bhaskar D. Rao,et al.  Sparse channel estimation via matching pursuit with application to equalization , 2002, IEEE Trans. Commun..

[36]  Jacob Benesty,et al.  An Efficient Proportionate Affine Projection Algorithm for Echo Cancellation , 2010, IEEE Signal Processing Letters.

[37]  Tao Jiang,et al.  Sparse least mean mixed‐norm adaptive filtering algorithms for sparse channel estimation applications , 2017, Int. J. Commun. Syst..

[38]  Wentao Ma,et al.  Maximum correntropy criterion based sparse adaptive filtering algorithms for robust channel estimation under non-Gaussian environments , 2015, J. Frankl. Inst..

[39]  Sergiy A. Vorobyov,et al.  Sparse channel estimation with lp-norm and reweighted l1-norm penalized least mean squares , 2011, 2011 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[40]  Mariane R. Petraglia,et al.  A unified approach for sparsity-aware and maximum correntropy adaptive filters , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[41]  Abolfazl Mehbodniya,et al.  Least mean square/fourth algorithm for adaptive sparse channel estimation , 2013, 2013 IEEE 24th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC).

[42]  A. Constantinides,et al.  Least mean mixed-norm adaptive filtering , 1994 .

[43]  Yanyan Wang,et al.  Sparse channel estimation based on a reweighted least-mean mixed-norm adaptive filter algorithm , 2016, 2016 24th European Signal Processing Conference (EUSIPCO).

[44]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[45]  Badong Chen,et al.  Kernel adaptive filtering with maximum correntropy criterion , 2011, The 2011 International Joint Conference on Neural Networks.

[46]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[47]  E. Candès.  The restricted isometry property and its implications for compressed sensing , 2008 .

[48]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[49]  Shigang Wang,et al.  Low-Complexity Non-Uniform Penalized Affine Projection Algorithm for Sparse System Identification , 2015, Circuits, Systems, and Signal Processing.