Recovery of Structured Signals With Prior Information via Maximizing Correlation

This paper considers the problem of recovering a structured signal from a relatively small number of noisy measurements with the aid of a similar signal which is known beforehand. We propose a new approach to integrate prior information into the standard recovery procedure by maximizing the correlation between the prior knowledge and the desired signal. We then establish performance guarantees (in terms of the number of measurements) for the proposed method under sub-Gaussian measurements. Specific structured signals including sparse vectors, block-sparse vectors, and low-rank matrices are also analyzed. Furthermore, we present an interesting geometrical interpretation for the proposed procedure. Our results demonstrate that if prior information is good enough, then the proposed approach can (remarkably) outperform the standard recovery procedure. Simulations are provided to verify our results.

[1]  Weiyu Xu,et al.  Analyzing Weighted $\ell_1$ Minimization for Sparse Recovery With Nonuniform Sparse Models , 2010, IEEE Transactions on Signal Processing.

[2]  Yonina C. Eldar,et al.  Reference-based compressed sensing: A sample complexity approach , 2016, 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[3]  Aswin C. Sankaranarayanan,et al.  CS-MUVI: Video compressive sensing for spatial-multiplexing cameras , 2012, 2012 IEEE International Conference on Computational Photography (ICCP).

[4]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[5]  R. Tibshirani,et al.  A note on the group lasso and a sparse group lasso , 2010, 1001.0736.

[6]  Wei Cui,et al.  Compressed sensing with prior information via maximizing correlation , 2017, 2017 IEEE International Symposium on Information Theory (ISIT).

[7]  Yonina C. Eldar,et al.  Compressed sensing for longitudinal MRI: An adaptive-weighted approach. , 2014, Medical physics.

[8]  G. Watson.  Characterization of the subdifferential of some matrix norms , 1992 .

[9]  Chun-Shien Lu,et al.  Distributed compressive video sensing , 2009, 2009 IEEE International Conference on Acoustics, Speech and Signal Processing.

[10]  Stephen P. Boyd,et al.  Enhancing Sparsity by Reweighted ℓ1 Minimization , 2007, 0711.1612.

[11]  Rayan Saab,et al.  Weighted ℓ1-Minimization for Sparse Recovery under Arbitrary Prior Information , 2016, ArXiv.

[12]  Michael A. Saunders,et al.  Atomic Decomposition by Basis Pursuit , 1998, SIAM J. Sci. Comput..

[13]  Yonina C. Eldar,et al.  Reference-based MRI. , 2015, Medical physics.

[14]  R. Tibshirani.  Regression Shrinkage and Selection via the Lasso , 1996 .

[15]  Sara van de Geer,et al.  Statistics for High-Dimensional Data: Methods, Theory and Applications , 2011 .

[16]  Miles E. Lopes.  Estimating Unknown Sparsity in Compressed Sensing , 2013 .

[17]  Aswin C. Sankaranarayanan,et al.  Video Compressive Sensing for Spatial Multiplexing Cameras Using Motion-Flow Models , 2015, SIAM J. Imaging Sci..

[18]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[19]  Hassan Mansour,et al.  Recovery Analysis for Weighted ℓ1-Minimization Using a Null Space Property , 2014, ArXiv.

[20]  Samuel Cheng,et al.  Compressive image sampling with side information , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[21]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[22]  Miguel R. D. Rodrigues,et al.  Compressed Sensing with Prior Information: Optimal Strategies, Geometry, and Bounds , 2014, ArXiv.

[23]  Wei Lu,et al.  Modified-CS: Modifying compressive sensing for problems with partially known support , 2009, 2009 IEEE International Symposium on Information Theory.

[24]  T. Blumensath,et al.  Theory and Applications , 2011 .

[25]  Abbas Mehrabian,et al.  A simple tool for bounding the deviation of random matrices on geometric sets , 2016, ArXiv.

[26]  Jamie S. Evans,et al.  Compressed Sensing With Prior Information: Information-Theoretic Limits and Practical Decoders , 2013, IEEE Transactions on Signal Processing.

[27]  Emmanuel J. Candès,et al.  Exact Matrix Completion via Convex Optimization , 2008, Found. Comput. Math..

[28]  Jie Tang,et al.  Prior image constrained compressed sensing (PICCS): a method to accurately reconstruct dynamic CT images from highly undersampled projection data sets. , 2008, Medical physics.

[29]  Philip Schniter,et al.  Tracking and smoothing of time-varying sparse signals via approximate belief propagation , 2010, 2010 Conference Record of the Forty Fourth Asilomar Conference on Signals, Systems and Computers.

[30]  Rina Foygel,et al.  Corrupted Sensing: Novel Guarantees for Separating Structured Signals , 2013, IEEE Transactions on Information Theory.

[31]  Pablo A. Parrilo,et al.  The Convex Geometry of Linear Inverse Problems , 2010, Foundations of Computational Mathematics.

[32]  Miguel R. D. Rodrigues,et al.  Compressed Sensing With Prior Information: Strategies, Geometry, and Bounds , 2017, IEEE Transactions on Information Theory.

[33]  Justin K. Romberg,et al.  Sparsity penalties in dynamical system estimation , 2011, 2011 45th Annual Conference on Information Sciences and Systems.

[34]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[35]  Mark Rudelson,et al.  Sampling from large matrices: An approach through geometric functional analysis , 2005, JACM.

[36]  Toshiyuki Tanaka,et al.  Optimal incorporation of sparsity information by weighted ℓ1 optimization , 2010, 2010 IEEE International Symposium on Information Theory.

[37]  Volkan Cevher,et al.  Adaptive-Rate Reconstruction of Time-Varying Signals With Application in Compressive Foreground Extraction , 2016, IEEE Transactions on Signal Processing.

[38]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[39]  Yulong Liu,et al.  Stable Recovery of Structured Signals From Corrupted Sub-Gaussian Measurements , 2019, IEEE Transactions on Information Theory.