Sparsity-aware subband adaptive algorithms with adjustable penalties

Abstract We propose two sparsity-aware normalized subband adaptive filter (NSAF) algorithms by using the gradient descent method to minimize a combination of the original NSAF cost function and the l 1 -norm penalty function on the filter coefficients. This l 1 -norm penalty exploits the sparsity of a system in the coefficients update formulation, thus improving the performance when identifying sparse systems. Compared with prior work, the proposed algorithms have lower computational complexity with comparable performance. We study and devise statistical models for these sparsity-aware NSAF algorithms in the mean square sense involving their transient and steady-state behaviors. This study relies on the vectorization argument and the paraunitary assumption imposed on the analysis filter banks, and thus does not restrict the input signal to being Gaussian or having another distribution. In addition, we propose to adjust adaptively the intensity parameter of the sparsity attraction term. Finally, simulation results in sparse system identification demonstrate the effectiveness of our theoretical results.

[1]  Peng Shi,et al.  Convergence analysis of sparse LMS algorithms with l1-norm penalty based on white input signal , 2010, Signal Process..

[2]  Zeljko Zilic,et al.  Echo cancellation in IP networks , 2002, The 2002 45th Midwest Symposium on Circuits and Systems, 2002. MWSCAS-2002..

[3]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Ali H. Sayed,et al.  Sparse Distributed Learning Based on Diffusion Adaptation , 2012, IEEE Transactions on Signal Processing.

[5]  Rodrigo C. de Lamare,et al.  Sparsity-Aware Adaptive Algorithms Based on Alternating Optimization and Shrinkage , 2014, IEEE Signal Processing Letters.

[6]  Jian Wang,et al.  Performance Analysis of $l_0$ Norm Constraint Least Mean Square Algorithm , 2012, IEEE Transactions on Signal Processing.

[7]  Lu Liu,et al.  l 0-norm penalised shrinkage linear and widely linear LMS algorithms for sparse system identification , 2017, IET Signal Process..

[8]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[9]  V. U. Reddy,et al.  A new approach to subband adaptive filtering , 1999, IEEE Trans. Signal Process..

[10]  Lu Liu,et al.  VFF l 1 -norm penalised WL-RLS algorithm using DCD iterations for underwater acoustic communication , 2017, IET Commun..

[11]  Young-Seok Choi,et al.  Subband Adaptive Filtering with -Norm Constraint for Sparse System Identification , 2013 .

[12]  Kong-Aik Lee,et al.  Improving convergence of the NLMS algorithm using constrained subband updates , 2004, IEEE Signal Processing Letters.

[13]  Ali H. Sayed,et al.  Mean-square performance of a family of affine projection algorithms , 2004, IEEE Transactions on Signal Processing.

[14]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[15]  Seung Hun Kim,et al.  Mean-Square Deviation Analysis of Multiband-Structured Subband Adaptive Filter Algorithm , 2016, IEEE Transactions on Signal Processing.

[16]  Martin Vetterli,et al.  Adaptive filtering in subbands with critical sampling: analysis, experiments, and application to acoustic echo cancellation , 1992, IEEE Trans. Signal Process..

[17]  Luis Weruaga,et al.  Optimal Sparsity Tradeoff in $\ell _0$ -NLMS Algorithm , 2016, IEEE Signal Processing Letters.

[18]  José Antonio Apolinário,et al.  ${{\bf L}_1}$-Constrained Normalized LMS Algorithms for Adaptive Beamforming , 2015, IEEE Transactions on Signal Processing.

[19]  Mohammad Shams Esfand Abadi,et al.  A family of proportionate normalized subband adaptive filter algorithms , 2011, J. Frankl. Inst..

[20]  Jun Yang,et al.  An Improved Multiband-Structured Subband Adaptive Filter Algorithm , 2012, IEEE Signal Processing Letters.

[21]  Woon-Seng Gan,et al.  Subband Adaptive Filtering: Theory and Implementation , 2009 .

[22]  Jianming Liu,et al.  An improved variable step-size zero-point attracting projection algorithm , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[23]  Feng Li,et al.  A Variable Step-Size Matrix Normalized Subband Adaptive Filter , 2010, IEEE Transactions on Audio, Speech, and Language Processing.

[24]  Ali H. Sayed,et al.  Fundamentals Of Adaptive Filtering , 2003 .

[25]  Yi Yu,et al.  Memory Proportionate APA with Individual Activation Factors for Acoustic Echo Cancellation , 2014, IEEE/ACM Transactions on Audio, Speech, and Language Processing.

[26]  Jianming Liu,et al.  A new variable step-size zero-point attracting projection algorithm , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[27]  W.S. Gan,et al.  Inherent Decorrelating and Least Perturbation Properties of the Normalized Subband Adaptive Filter , 2006, IEEE Transactions on Signal Processing.

[28]  Kong-Aik Lee,et al.  Mean-Square Performance Analysis of the Normalized Subband Adaptive Filter , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[29]  Badong Chen,et al.  A New Normalized Subband Adaptive Filter Algorithm with Individual Variable Step Sizes , 2016, Circuits Syst. Signal Process..

[30]  V. Nascimento,et al.  Sparsity-aware affine projection adaptive algorithms for system identification , 2011 .

[31]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[32]  Diego B. Haddad,et al.  Transient analysis of l0-LMS and l0-NLMS algorithms , 2016, Signal Process..

[33]  Paulo S. R. Diniz,et al.  Sparsity-Aware Data-Selective Adaptive Filters , 2014, IEEE Transactions on Signal Processing.

[34]  W. F. Schreiber,et al.  Advanced television systems for terrestrial broadcasting: Some problems and some proposed solutions , 1995, Proc. IEEE.

[35]  Yi Yu,et al.  Performance analysis of the deficient length NSAF algorithm and a variable step size method for improving its performance , 2017, Digit. Signal Process..

[36]  Jun Yang,et al.  Transient and steady-state analyses of the improved multiband-structured subband adaptive filter algorithm , 2015, IET Signal Process..

[37]  Alexander Graham,et al.  Kronecker Products and Matrix Calculus: With Applications , 1981 .

[38]  Wutao Yin,et al.  Stochastic Analysis of the Normalized Subband Adaptive Filter Algorithm , 2011, IEEE Transactions on Circuits and Systems I: Regular Papers.

[39]  Lu Lu,et al.  A new normalized subband adaptive filter under minimum error entropy criterion , 2016, Signal, Image and Video Processing.

[40]  Sheng Zhang,et al.  Transient analysis of zero attracting NLMS algorithm without Gaussian inputs assumption , 2014, Signal Process..

[41]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[42]  Richard G. Baraniuk,et al.  Compressive Sensing , 2008, Computer Vision, A Reference Guide.

[43]  Jacob Benesty,et al.  An Efficient Proportionate Affine Projection Algorithm for Echo Cancellation , 2010, IEEE Signal Processing Letters.

[44]  Mrityunjoy Chakraborty,et al.  Improving the Performance of the PNLMS Algorithm Using $l_1$ Norm Regularization , 2016, IEEE/ACM Transactions on Audio, Speech, and Language Processing.