$$\ell _1$$ℓ1-regularized recursive total least squares based sparse system identification for the error-in-variables

In this paper an $$\ell _1$$ℓ1-regularized recursive total least squares (RTLS) algorithm is considered for the sparse system identification. Although recursive least squares (RLS) has been successfully applied in sparse system identification, the estimation performance in RLS based algorithms becomes worse, when both input and output are contaminated by noise (the error-in-variables problem). We proposed an algorithm to handle the error-in-variables problem. The proposed $$\ell _1$$ℓ1-RTLS algorithm is an RLS like iteration using the $$\ell _1$$ℓ1 regularization. The proposed algorithm not only gives excellent performance but also reduces the required complexity through the effective inversion matrix handling. Simulations demonstrate the superiority of the proposed $$\ell _1$$ℓ1-regularized RTLS for the sparse system identification setting.

[1]  Jiasong Wu,et al.  Error Gradient-based Variable-Lp Norm Constraint LMS Algorithm for Sparse System Identification , 2015, ArXiv.

[2]  Geoffrey A. Williamson,et al.  Analysis of gradient algorithms for TLS-based adaptive IIR filters , 2004, IEEE Transactions on Signal Processing.

[3]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[4]  ArabloueiReza Fast reconstruction algorithm for perturbed compressive sensing based on total least-squares and proximal splitting , 2017 .

[5]  Marco W. Soijer,et al.  Sequential Computation of Total Least-Squares Parameter Estimates , 2004 .

[6]  Gene H. Golub,et al.  An analysis of the total least squares problem , 1980, Milestones in Matrix Computation.

[7]  Ahmet Korhan Tanc Sparsity regularized recursive total least-squares , 2015, Digit. Signal Process..

[8]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[9]  Vahid Tarokh,et al.  SPARLS: The Sparse RLS Algorithm , 2010, IEEE Transactions on Signal Processing.

[10]  Reza Arablouei,et al.  Fast reconstruction algorithm for perturbed compressive sensing based on total least-squares and proximal splitting , 2016, Signal Process..

[11]  Stefan Werner,et al.  Analysis of the Gradient-Descent Total Least-Squares Adaptive Filtering Algorithm , 2014, IEEE Transactions on Signal Processing.

[12]  Carlos E. Davila,et al.  An efficient recursive total least squares algorithm for FIR adaptive filtering , 1994, IEEE Trans. Signal Process..

[13]  T. Moon,et al.  Mathematical Methods and Algorithms for Signal Processing , 1999 .

[14]  B. Dumitrescu Sparse total least squares: Analysis and greedy algorithms , 2013 .

[15]  Zheng Bao,et al.  Total least mean squares algorithm , 1998, IEEE Trans. Signal Process..

[16]  Ender M. Eksioglu,et al.  RLS Algorithm With Convex Regularization , 2011, IEEE Signal Processing Letters.

[17]  G. Williamson,et al.  Stable simplified gradient algorithms for total least squares filtering , 2000, Conference Record of the Thirty-Fourth Asilomar Conference on Signals, Systems and Computers (Cat. No.00CH37154).

[18]  Georgios B. Giannakis,et al.  Online Adaptive Estimation of Sparse Signals: Where RLS Meets the $\ell_1$ -Norm , 2010, IEEE Transactions on Signal Processing.

[19]  E. M. Eksioglu Sparsity Regularized RLS Adaptive Filtering , 2011 .

[20]  Vahid Tarokh,et al.  Adaptive algorithms for sparse system identification , 2011, Signal Process..

[21]  Stefan Werner,et al.  Recursive Total Least-Squares Algorithm Based on Inverse Power Method and Dichotomous Coordinate-Descent Iterations , 2014, IEEE Transactions on Signal Processing.

[22]  Ender M. Eksioglu,et al.  Sparsity regularised recursive least squares adaptive filtering , 2011 .

[23]  Jun-Seok Lim,et al.  Mixed norm regularized recursive total least squares for group sparse system identification , 2016 .

[24]  Georgios B. Giannakis,et al.  Sparsity-Cognizant Total Least-Squares for Perturbed Compressive Sampling , 2010, IEEE Transactions on Signal Processing.

[25]  Koeng-Mo Sung,et al.  An Efficient Recursive Total Least Squares Algorithm for Training Multilayer Feedforward Neural Networks , 2005, ISNN.