Adaptive Sparse System Identification in Compressed Space

In this paper, we propose a method for adaptive identification of sparse systems. The method requires low number of filter weights, significantly less than the number of taps of sparse system. The approach is based on compressed sensing (CS) technique. In fact, we adaptively estimate a compressed version of high dimensional sparse system. The aim is accomplished by using the structure of random filter and an interpolator at the transmission line. They are arranged such that the linear time invariant (LTI) property of the overall system (compressed system) is preserved. The unique features of the identification in the reduced dimensions are investigated. Stability in high convergence rates and robustness against highly correlated input signals are two important advantages of the proposed method. Furthermore, we propose a modified algorithm for optimization of the random filter and illustrate its impact by numerical results. Two appropriate reconstruction algorithms are evaluated for recovery of original sparse system. Simulation results indicate that at low levels of sparsity, the proposed approach outperforms the conventional least mean square (LMS) method and has comparable performance with the regularized LMS algorithms, only by half number of the filter weights.

[1]  J. Tropp,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, Commun. ACM.

[2]  Bhaskar D. Rao,et al.  Recovery of block sparse signals using the framework of block sparse Bayesian learning , 2012, 2012 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Richard G. Baraniuk,et al.  Random Filters for Compressive Sampling and Reconstruction , 2006, 2006 IEEE International Conference on Acoustics Speech and Signal Processing Proceedings.

[4]  Saeid Sanei,et al.  A gradient-based alternating minimization approach for optimization of the measurement matrix in compressive sensing , 2012, Signal Process..

[5]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[6]  Saeid Sanei,et al.  On optimization of the measurement matrix for compressive sensing , 2010, 2010 18th European Signal Processing Conference.

[7]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[8]  A. Hero,et al.  Regularized Least-Mean-Square Algorithms , 2010, 1012.5066.

[9]  Lei Guo,et al.  Compressive distributed adaptive filtering , 2016, 2016 35th Chinese Control Conference (CCC).

[10]  Bhaskar D. Rao,et al.  Extension of SBL Algorithms for the Recovery of Block Sparse Signals With Intra-Block Correlation , 2012, IEEE Transactions on Signal Processing.

[11]  Alfred O. Hero,et al.  Sparse LMS for system identification , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[12]  Mahrokh G. Shayesteh,et al.  Compressed sensing for denoising in adaptive system identification , 2012, 20th Iranian Conference on Electrical Engineering (ICEE2012).

[13]  Yuantao Gu,et al.  $l_{0}$ Norm Constraint LMS Algorithm for Sparse System Identification , 2009, IEEE Signal Processing Letters.

[14]  Ender M. Eksioglu,et al.  Sparsity regularised recursive least squares adaptive filtering , 2011 .

[15]  Donald L. Duttweiler,et al.  Proportionate normalized least-mean-squares adaptation in echo cancelers , 2000, IEEE Trans. Speech Audio Process..

[16]  Babak Hassibi,et al.  On the reconstruction of block-sparse signals with an optimal number of measurements , 2009, IEEE Trans. Signal Process..

[17]  H. Vincent Poor,et al.  Distributed Compressed Estimation Based on Compressive Sensing , 2015, IEEE Signal Processing Letters.

[18]  R.G. Baraniuk,et al.  Compressive Sensing [Lecture Notes] , 2007, IEEE Signal Processing Magazine.

[19]  D. L. Donoho,et al.  Compressed sensing , 2006, IEEE Trans. Inf. Theory.

[20]  Aggelos K. Katsaggelos,et al.  Bayesian Compressive Sensing Using Laplace Priors , 2010, IEEE Transactions on Image Processing.

[21]  Peng Shi,et al.  Adaptive sparse Volterra system identification with ℓ0-norm penalty , 2011, Signal Process..

[22]  Richard G. Baraniuk,et al.  Compressive Sensing , 2008, Computer Vision, A Reference Guide.

[23]  Bernard Widrow,et al.  Adaptive Signal Processing , 1985 .