Online least angle regression algorithm for sparse system identification

Traditional least mean square algorithm based system identifications schemes are not effective in identifying sparse systems and a few sparse adaptive algorithms have been developed recently to overcome this limitation. Least angle regression (LARS) algorithm, which has recently emerged as an effective model selection approach, has found applications in sparse coding and sparse signal recovery. LARS has been shown to provide very fast convergence in sparse signal recovery tasks. The offline learning nature of the LARS algorithm prevents the direct use of the algorithm for online sparse system identification. With an objective to utilize the fast convergence offered by LARS algorithm, an online sparse system identification method based on LARS is developed in this letter. The new scheme has been shown to provide improved convergence behaviour over conventional sparse system identification methods.

[1]  Johan Hellgren,et al.  Analysis of feedback cancellation in hearing aids with Filtered-x LMS and the direct method of closed loop identification , 2002, IEEE Trans. Speech Audio Process..

[2]  James M. Kates,et al.  Digital hearing aids. , 2008, Harvard health letter.

[3]  Jyoti Maheshwari,et al.  Robust modeling of acoustic paths using a sparse adaptive algorithm , 2016 .

[4]  Simon Doclo,et al.  Modeling the common part of acoustic feedback paths in hearing aids using a pole-zero model , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[5]  José Antonio Apolinário,et al.  RLS sparse system identification using LAR-based situational awareness , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[6]  Guillermo Sapiro,et al.  Online dictionary learning for sparse coding , 2009, ICML '09.

[7]  PooGyeon Park,et al.  An Improved NLMS Algorithm in Sparse Systems Against Noisy Input Signals , 2015, IEEE Transactions on Circuits and Systems II: Express Briefs.

[8]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Woo-Jin Song,et al.  A Proportionate Diffusion LMS Algorithm for Sparse Distributed Estimation , 2015, IEEE Transactions on Circuits and Systems II: Express Briefs.

[10]  Bijit Kumar Das,et al.  Sparse Adaptive Filtering by an Adaptive Convex Combination of the LMS and the ZA-LMS Algorithms , 2014, IEEE Transactions on Circuits and Systems I: Regular Papers.

[11]  Bijit Kumar Das,et al.  Sparse Distributed Estimation via Heterogeneous Diffusion Adaptive Networks , 2016, IEEE Transactions on Circuits and Systems II: Express Briefs.

[12]  R. Tibshirani,et al.  Least angle regression , 2004, math/0406456.

[13]  Vahid Tarokh,et al.  Adaptive algorithms for sparse system identification , 2011, Signal Process..

[14]  Yaakov Tsaig,et al.  Fast Solution of $\ell _{1}$ -Norm Minimization Problems When the Solution May Be Sparse , 2008, IEEE Transactions on Information Theory.

[15]  Shuning Wang,et al.  Nonlinear system identification with lattice piecewise-linear functions , 2002, Proceedings of the 2002 American Control Conference (IEEE Cat. No.CH37301).

[16]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.