Proportionate Adaptive Filtering for Block-Sparse System Identification

In this paper, a new family of proportionate normalized least mean square (PNLMS) adaptive algorithms that improve the performance of identifying block-sparse systems is proposed. The main proposed algorithm, called block-sparse PNLMS (BS-PNLMS), is based on the optimization of a mixed l2,1 norm of the adaptive filter's coefficients. It is demonstrated that both the NLMS and the traditional PNLMS are special cases of BS-PNLMS. Meanwhile, a block-sparse improved PNLMS (BS-IPNLMS) is also derived for both sparse and dispersive impulse responses. Simulation results demonstrate that the proposed BS-PNLMS and BS-IPNLMS algorithms outperformed the NLMS, PNLMS and IPNLMS algorithms with only a modest increase in computational complexity.

[1]  Jacob Benesty,et al.  An improved proportionate NLMS algorithm based on the l0 norm , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[2]  Milos Doroslovacki,et al.  Improving convergence of the PNLMS algorithm for sparse impulse response identification , 2005, IEEE Signal Processing Letters.

[3]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[5]  Jacob Benesty,et al.  An Efficient Proportionate Affine Projection Algorithm for Echo Cancellation , 2010, IEEE Signal Processing Letters.

[6]  Hon Keung Kwan,et al.  Memory improved proportionate affine projection sign algorithm , 2012 .

[7]  Dake Liu,et al.  Embedded DSP Processor Design: Application Specific Instruction Set Processors , 2008 .

[8]  Jacob Benesty,et al.  On Regularization in Adaptive Filtering , 2011, IEEE Transactions on Audio, Speech, and Language Processing.

[9]  Hongyang Deng,et al.  Convergence of Proportionate-type LMS Adaptive Filters and Choice of Gain Matrix , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[10]  Francisco das Chagas de Souza,et al.  A PNLMS Algorithm With Individual Activation Factors , 2010, IEEE Transactions on Signal Processing.

[11]  Kevin T. Wagner,et al.  Proportionate-type Normalized Least Mean Square Algorithms , 2013 .

[12]  Patrick A. Naylor,et al.  An improved IPNLMS algorithm for echo cancellation in packet-switched networks , 2004, 2004 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[13]  Yuantao Gu,et al.  Block-Sparsity-Induced Adaptive Filter for Multi-Clustering System Identification , 2014, IEEE Transactions on Signal Processing.

[14]  José M. N. Leitão,et al.  A DSP based long distance echo canceller using short length centered adaptive filters , 1997, 1997 IEEE International Conference on Acoustics, Speech, and Signal Processing.

[15]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[16]  Patrick A. Naylor,et al.  A Partitioned Block Proportionate Adaptive Algorithm for Acoustic Echo Cancellation , 2010 .

[17]  Kevin T. Wagner,et al.  Proportionate-Type Normalized Least Mean Square Algorithms: Wagner/Proportionate-Type Normalized Least Mean Square Algorithms , 2013 .

[18]  Jacob Benesty,et al.  Proportionate Adaptive Filters From a Basis Pursuit Perspective , 2010, IEEE Signal Processing Letters.

[19]  Milos Doroslovacki,et al.  Proportionate adaptive algorithms for network echo cancellation , 2006, IEEE Transactions on Signal Processing.

[20]  Jianming Liu,et al.  A new variable step-size zero-point attracting projection algorithm , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[21]  Jianming Liu,et al.  A generalized proportionate adaptive algorithm based on convex optimization , 2014, 2014 IEEE China Summit & International Conference on Signal and Information Processing (ChinaSIP).

[22]  S.L. Gay,et al.  An efficient, fast converging adaptive filter for network echo cancellation , 1998, Conference Record of Thirty-Second Asilomar Conference on Signals, Systems and Computers (Cat. No.98CH36284).

[23]  Jianming Liu,et al.  An improved variable step-size zero-point attracting projection algorithm , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[24]  Patrick A. Naylor,et al.  A Class of Sparseness-Controlled Algorithms for Echo Cancellation , 2009, IEEE Transactions on Audio, Speech, and Language Processing.

[25]  Yahong Rosa Zheng,et al.  Proportionate Affine Projection Sign Algorithms for Network Echo Cancellation , 2011, IEEE Transactions on Audio, Speech, and Language Processing.