A hybrid approach for sparse adaptive filters under highly colored inputs

We address an adaptive filtering problem for sparse linear systems excited by highly colored input signals. A proportionate approach is known to accelerate the convergence speed by exploiting the sparseness of the systems, while a transformdomain approach is known to alleviate the decay of the convergence rate for highly colored inputs. We highlight the improved proportionate NLMS (IPNLMS) and transform-domain NLMS (TD-NLMS) algorithms. The present experimental results show that the gain of IPNLMS against TD-NLMS changes from positive to negative as the input auto-correlation becomes strong. We propose a hybrid approach of IPNLMS and TD-NLMS, taking the advantages of both algorithms by means of a timevariant convex combination of the two matrices employed by those algorithms. Numerical examples show the efficacy of the proposed algorithm.

[1]  Kevin T. Wagner,et al.  Proportionate-type NLMS algorithms based on maximization of the joint conditional PDF for the weight deviation vector , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[3]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[4]  A. Peterson,et al.  Transform domain LMS algorithm , 1983 .

[5]  Sergios Theodoridis,et al.  Adaptive algorithm for sparse system identification using projections onto weighted ℓ1 balls , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Milos Doroslovacki,et al.  Proportionate adaptive algorithms for network echo cancellation , 2006, IEEE Transactions on Signal Processing.

[7]  Patrik O. Hoyer,et al.  Non-negative Matrix Factorization with Sparseness Constraints , 2004, J. Mach. Learn. Res..

[8]  Isao Yamada,et al.  A sparse adaptive filtering using time-varying soft-thresholding techniques , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Masahiro Yukawa,et al.  Krylov-Proportionate Adaptive Filtering Techniques Not Limited to Sparse Systems , 2009, IEEE Transactions on Signal Processing.

[10]  Isao Yamada,et al.  A Unified View of Adaptive Variable-Metric Projection Algorithms , 2009, EURASIP J. Adv. Signal Process..

[11]  W. K. Jenkins,et al.  The use of orthogonal transforms for improving performance of adaptive filters , 1989 .

[12]  S.L. Gay,et al.  An efficient, fast converging adaptive filter for network echo cancellation , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[13]  Georgios B. Giannakis,et al.  Online Adaptive Estimation of Sparse Signals: Where RLS Meets the $\ell_1$ -Norm , 2010, IEEE Transactions on Signal Processing.

[14]  Françoise Beaufays,et al.  Transform-domain adaptive filters: an analytical approach , 1995, IEEE Trans. Signal Process..

[15]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..