Proportionate Adaptive Filters Based on Minimizing Diversity Measures for Promoting Sparsity

In this paper, a novel way of deriving proportionate adaptive filters is proposed based on diversity measure minimization using the iterative reweighting techniques well-known in the sparse signal recovery (SSR) area. The resulting least mean square (LMS)-type and normalized LMS (NLMS)-type sparse adaptive filtering algorithms can incorporate various diversity measures that have proved effective in SSR. Furthermore, by setting the regularization coefficient of the diversity measure term to zero in the resulting algorithms, Sparsity promoting LMS (SLMS) and Sparsity promoting NLMS (SNLMS) are introduced, which exploit but do not strictly enforce the sparsity of the system response if it already exists. Moreover, unlike most existing proportionate algorithms that design the step-size control factors based on heuristics, our SSR-based framework leads to designing the factors in a more systematic way. Simulation results are presented to demonstrate the convergence behavior of the derived algorithms for systems with different sparsity levels.

[1]  Bhaskar D. Rao,et al.  Adaptive filtering algorithms for promoting sparsity , 2003, 2003 IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003. Proceedings. (ICASSP '03)..

[2]  C. Richard Johnson,et al.  Exploiting sparsity in adaptive filters , 2002, IEEE Trans. Signal Process..

[3]  Bhaskar D. Rao,et al.  Sparsity promoting LMS for adaptive feedback cancellation , 2017, 2017 25th European Signal Processing Conference (EUSIPCO).

[4]  Yuzhe Jin,et al.  Algorithm development for sparse signal recovery and performance limits using multiple-user information theory - eScholarship , 2011 .

[5]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[6]  Jacob Benesty,et al.  Sparse Adaptive Filters for Echo Cancellation , 2010, Synthesis Lectures on Speech and Audio Processing.

[7]  Bhaskar D. Rao,et al.  An affine scaling methodology for best basis selection , 1999, IEEE Trans. Signal Process..

[8]  Ching-Hua Lee,et al.  Speech quality and stable gain trade-offs in adaptive feedback cancellation for hearing aids. , 2017, The Journal of the Acoustical Society of America.

[9]  Kevin T. Wagner,et al.  Proportionate-type Normalized Least Mean Square Algorithms , 2013 .

[10]  Jacob Benesty,et al.  Proportionate Adaptive Filters From a Basis Pursuit Perspective , 2010, IEEE Signal Processing Letters.

[11]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[12]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[13]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[14]  Michael Elad,et al.  Sparse and Redundant Representations - From Theory to Applications in Signal and Image Processing , 2010 .

[15]  Wotao Yin,et al.  Iteratively reweighted algorithms for compressive sensing , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[16]  F. Y. Wu,et al.  Gradient optimization p-norm-like constraint LMS algorithm for sparse system estimation , 2013, Signal Process..

[17]  Sergiy A. Vorobyov,et al.  Reweighted l1-norm penalized LMS for sparse channel estimation and its analysis , 2014, Signal Process..

[18]  David P. Wipf,et al.  Iterative Reweighted 1 and 2 Methods for Finding Sparse Solutions , 2010, IEEE J. Sel. Top. Signal Process..

[19]  Jianming Liu,et al.  A generalized proportionate adaptive algorithm based on convex optimization , 2014, 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP).

[20]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[21]  S. Haykin Adaptive Filters , 2007 .