Sparsity-Aware Data-Selective Adaptive Filters

We propose two adaptive filtering algorithms that combine sparsity-promoting schemes with data-selection mechanisms. Sparsity is promoted via some well-known nonconvex approximations to the l0 norm in order to increase convergence speed of the algorithms when dealing with sparse/compressible signals. These approximations circumvent some difficulties of working with the l0 norm, thus allowing the development of online data-selective algorithms. Data selection is implemented based on set-membership filtering, which yields robustness against noise and reduced computational burden. The proposed algorithms are analyzed in order to set properly their parameters to guarantee stability. In addition, we characterize their updating processes from a geometrical viewpoint. Simulation results show that the proposed algorithms outperform the state-of-the-art algorithms designed to exploit sparsity.

[1]  José Antonio Apolinário,et al.  A set-membership approach to normalized proportionate adaptation algorithms , 2005, 2005 13th European Signal Processing Conference.

[2]  Paulo S. R. Diniz,et al.  Adaptive Filtering: Algorithms and Practical Implementation , 1997 .

[3]  Ender M. Eksioglu,et al.  RLS Algorithm With Convex Regularization , 2011, IEEE Signal Processing Letters.

[4]  C. A. SING-LONG,et al.  Evaluation of continuous approximation functions for the l 0-norm for Compressed Sensing , 2008 .

[5]  Andy W. H. Khong,et al.  Efficient Use Of Sparse Adaptive Filters , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[6]  Sergios Theodoridis,et al.  Adaptive algorithm for sparse system identification using projections onto weighted ℓ1 balls , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[7]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[8]  V. Nascimento,et al.  Sparsity-aware affine projection adaptive algorithms for system identification , 2011 .

[9]  P. L. Combettes.  The foundations of set theoretic estimation , 1993 .

[10]  W. Clem Karl,et al.  Feature-enhanced synthetic aperture radar image formation based on nonquadratic regularization , 2001, IEEE Trans. Image Process..

[11]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[12]  Jiasong Wu,et al.  Error Gradient-based Variable-Lp Norm Constraint LMS Algorithm for Sparse System Identification , 2015, ArXiv.

[13]  B. Ripley,et al.  Robust Statistics , 2018, Wiley Series in Probability and Statistics.

[14]  Mike Brookes,et al.  Adaptive algorithms for sparse echo cancellation , 2006, Signal Process..

[15]  S.L. Gay,et al.  An efficient, fast converging adaptive filter for network echo cancellation , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[16]  Paulo S. R. Diniz,et al.  Affine projection algorithms for sparse system identification , 2013, 2013 IEEE International Conference on Acoustics, Speech and Signal Processing.

[17]  T. Hastie,et al.  SparseNet: Coordinate Descent With Nonconvex Penalties , 2011, Journal of the American Statistical Association.

[18]  Jianqing Fan,et al.  Variable Selection via Nonconcave Penalized Likelihood and its Oracle Properties , 2001 .

[19]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[20]  Stéphane Canu,et al.  Recovering Sparse Signals With a Certain Family of Nonconvex Penalties and DC Programming , 2009, IEEE Transactions on Signal Processing.

[21]  Sergios Theodoridis,et al.  A Sparsity Promoting Adaptive Algorithm for Distributed Learning , 2012, IEEE Transactions on Signal Processing.

[22]  Sergios Theodoridis,et al.  Online Sparse System Identification and Signal Reconstruction Using Projections Onto Weighted $\ell_{1}$ Balls , 2010, IEEE Transactions on Signal Processing.

[23]  Paulo S. R. Diniz,et al.  Fast learning set theoretic estimation , 2013, 21st European Signal Processing Conference (EUSIPCO 2013).

[24]  Paulo S. R. Diniz,et al.  Steady-State MSE Performance of the Set-Membership Affine Projection Algorithm , 2013, Circuits, Systems, and Signal Processing.

[25]  Javier Portilla,et al.  L0-Norm-Based Sparse Representation Through Alternate Projections , 2006, 2006 International Conference on Image Processing.

[26]  Ender M. Eksioglu,et al.  Sparsity regularised recursive least squares adaptive filtering , 2011 .

[27]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[28]  Shirish Nagaraj,et al.  Set-membership filtering and a set-membership normalized LMS algorithm with an adaptive step size , 1998, IEEE Signal Processing Letters.

[29]  T. Blumensath,et al.  Theory and Applications , 2011 .

[30]  Ligang Liu,et al.  An improved mu-law proportionate NLMS algorithm , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[31]  Paulo S. R. Diniz,et al.  Convergence Performance of the Simplified Set-Membership Affine Projection Algorithm , 2011, Circuits Syst. Signal Process..

[32]  José Antonio Apolinário,et al.  Set-Membership Proportionate Affine Projection Algorithms , 2007, EURASIP J. Audio Speech Music. Process..

[33]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[34]  Bhaskar D. Rao,et al.  Sparse signal reconstruction from limited data using FOCUSS: a re-weighted minimum norm algorithm , 1997, IEEE Trans. Signal Process..

[35]  E. M. Eksioglu.  Sparsity Regularized RLS Adaptive Filtering , 2011 .

[36]  Akihiko Sugiyama,et al.  A generalized proportionate variable step-size algorithm for fast changing acoustic environments , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[37]  Paulo S. R. Diniz,et al.  Steady-state analysis of the set-membership affine projection algorithm , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[38]  Rick Chartrand,et al.  Nonconvex Splitting for Regularized Low-Rank + Sparse Decomposition , 2012, IEEE Transactions on Signal Processing.

[39]  Milos Doroslovacki,et al.  Proportionate adaptive algorithms for network echo cancellation , 2006, IEEE Transactions on Signal Processing.

[40]  K. Slavakis,et al.  Reduced complexity online sparse signal reconstruction using projections onto weighted ℓ1 balls , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[41]  Jacob Benesty,et al.  An Efficient Proportionate Affine Projection Algorithm for Echo Cancellation , 2010, IEEE Signal Processing Letters.

[42]  Armando Manduca,et al.  Highly Undersampled Magnetic Resonance Image Reconstruction via Homotopic $\ell_{0}$ -Minimization , 2009, IEEE Transactions on Medical Imaging.

[43]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[44]  P. Diniz,et al.  Set-membership affine projection algorithm , 2001, IEEE Signal Processing Letters.