Affine projection algorithms for sparse system identification

We propose two versions of affine projection (AP) algorithms tailored for sparse system identification (SSI). Contrary to most adaptive filtering algorithms devised for SSI, which are based on the l1 norm, the proposed algorithms rely on homotopic l0 norm minimization, which has proven to yield better results in some practical contexts. The first proposal is obtained by direct minimization of the AP cost function with a penalty function based on the l0 norm of the coefficient vector, whereas the second algorithm is a simplified version of the first proposal. Simulation results are presented in order to evaluate the performance of the proposed algorithms considering three different homotopies to the l0 norm as well as competing algorithms.

[1]  Sergios Theodoridis,et al.  Online Sparse System Identification and Signal Reconstruction Using Projections Onto Weighted $\ell_{1}$ Balls , 2010, IEEE Transactions on Signal Processing.

[2]  Peter J. Huber,et al.  Robust Statistics , 2005, Wiley Series in Probability and Statistics.

[3]  C. A. SING-LONG,et al.  Evaluation of continuous approximation functions for the l 0-norm for Compressed Sensing , 2008 .

[4]  Sergios Theodoridis,et al.  Adaptive algorithm for sparse system identification using projections onto weighted ℓ1 balls , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[5]  Donald Geman,et al.  Nonlinear image recovery with half-quadratic regularization , 1995, IEEE Trans. Image Process..

[6]  V. Nascimento,et al.  Sparsity-aware affine projection adaptive algorithms for system identification , 2011 .

[7]  Ali H. Sayed,et al.  Sparse diffusion LMS for distributed adaptive estimation , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[8]  Steven L. Gay,et al.  The fast affine projection algorithm , 1995, 1995 International Conference on Acoustics, Speech, and Signal Processing.

[9]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[10]  Paulo S. R. Diniz,et al.  Adaptive Filtering: Algorithms and Practical Implementation , 1997 .

[11]  José Antonio Apolinário,et al.  Set-Membership Proportionate Affine Projection Algorithms , 2007, EURASIP J. Audio Speech Music. Process..

[12]  T. Blumensath,et al.  Theory and Applications , 2011 .

[13]  Armando Manduca,et al.  Highly Undersampled Magnetic Resonance Image Reconstruction via Homotopic $\ell_{0}$ -Minimization , 2009, IEEE Transactions on Medical Imaging.

[14]  Kazuhiko Ozeki,et al.  An adaptive filtering algorithm using an orthogonal projection to an affine subspace and its properties , 1984 .

[15]  K. Slavakis,et al.  Reduced complexity online sparse signal reconstruction using projections onto weighted ℓ1 balls , 2011, 2011 17th International Conference on Digital Signal Processing (DSP).

[16]  Sergios Theodoridis,et al.  A Sparsity Promoting Adaptive Algorithm for Distributed Learning , 2012, IEEE Transactions on Signal Processing.

[17]  Mariane R. Petraglia,et al.  New adaptive algorithms for identification of sparse impulse responses — Analysis and comparisons , 2010, 2010 7th International Symposium on Wireless Communication Systems.

[18]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[19]  B. Ripley,et al.  Robust Statistics , 2018, Encyclopedia of Mathematical Geosciences.

[20]  T. Hinamoto,et al.  Extended theory of learning identification , 1975 .

[21]  José Antonio Apolinário,et al.  A set-membership approach to normalized proportionate adaptation algorithms , 2005, 2005 13th European Signal Processing Conference.

[22]  Javier Portilla,et al.  L0-Norm-Based Sparse Representation Through Alternate Projections , 2006, 2006 International Conference on Image Processing.