Compressed sensing of streaming data

We introduce a recursive scheme for performing Compressed Sensing (CS) on streaming data and analyze, both analytically and experimentally, the computational complexity and estimation error. The approach consists of sampling the input stream recursively via overlapping windowing and making use of the previous measurement in obtaining the next one. The signal estimate from the previous window is utilized in order to achieve faster convergence in an iterative optimization algorithm to decode the new window. To remove the bias of the estimator a two-step estimation procedure is proposed comprising support set detection and signal amplitude estimation. Estimation accuracy is enhanced by averaging estimates obtained from overlapping windows. The proposed method is shown to have asymptotic computational complexity O(nm3/2), where n is the window length, and m is the number of samples. The variance of normalized estimation error is shown to asymptotically go to 0 if k = O(n1-∈) as n increases. The simulation results show speed up of at least ten times with respect to applying traditional CS on a stream of data while obtaining significantly lower reconstruction error under mild conditions on the signal magnitudes and the noise level.

[1]  Marc Teboulle,et al.  A Fast Iterative Shrinkage-Thresholding Algorithm for Linear Inverse Problems , 2009, SIAM J. Imaging Sci..

[2]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[3]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[4]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[5]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[6]  Stephen P. Boyd,et al.  Proximal Algorithms , 2013, Found. Trends Optim..

[7]  Stephen J. Wright,et al.  Sparse Reconstruction by Separable Approximation , 2008, IEEE Transactions on Signal Processing.

[8]  K. Schittkowski,et al.  NONLINEAR PROGRAMMING , 2022 .

[9]  E. Candès,et al.  Near-ideal model selection by ℓ1 minimization , 2008, 0801.0345.

[10]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[11]  Michael Elad,et al.  From Sparse Solutions of Systems of Equations to Sparse Modeling of Signals and Images , 2009, SIAM Rev..

[12]  Thierry Blu,et al.  Sampling signals with finite rate of innovation , 2002, IEEE Trans. Signal Process..

[13]  José M. Bioucas-Dias,et al.  Fast Image Recovery Using Variable Splitting and Constrained Optimization , 2009, IEEE Transactions on Image Processing.

[14]  Panos M. Pardalos,et al.  Convex optimization theory , 2010, Optim. Methods Softw..

[15]  Alberto Bemporad,et al.  Proximal Newton methods for convex composite optimization , 2013, 52nd IEEE Conference on Decision and Control.