Recovery of sparse signals via Branch and Bound Least-Squares

We present an algorithm, referred to as Branch and Bound Least-Squares (BBLS), for the recovery of sparse signals from a few linear combinations of their entries. Sparse signal reconstruction is readily cast as the problem of finding a sparse solution to an underdetermined system of linear equations. To solve it, BBLS employs an efficient search strategy of traversing a tree whose nodes represent the columns of the coefficient matrix and selects a subset of those columns by relying on Orthogonal Least-Squares (OLS) procedure. We state sufficient conditions under which in noise-free settings BBLS with high probability constructs a tree path which corresponds to the true support of the unknown sparse signal. Moreover, we empirically demonstrate that BBLS provides performance superior to that of existing algorithms in terms of accuracy, running time, or both. In the scenarios where the columns of the coefficient matrix are characterized by high correlation, BBLS is particularly beneficial and significantly outperforms existing methods.

[1]  Michael Elad,et al.  On the Role of Sparse and Redundant Representations in Image Processing , 2010, Proceedings of the IEEE.

[2]  Jian Wang,et al.  Multipath Matching Pursuit , 2013, IEEE Transactions on Information Theory.

[3]  René Vidal,et al.  Sparse subspace clustering , 2009, CVPR.

[4]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[5]  Yonina C. Eldar,et al.  Spatial compressive sensing in MIMO radar with random arrays , 2012, 2012 46th Annual Conference on Information Sciences and Systems (CISS).

[6]  D. Donoho,et al.  Sparse MRI: The application of compressed sensing for rapid MR imaging , 2007, Magnetic resonance in medicine.

[7]  Joel A. Tropp,et al.  Greed is good: algorithmic results for sparse approximation , 2004, IEEE Transactions on Information Theory.

[8]  Sundeep Rangan,et al.  Orthogonal Matching Pursuit: A Brownian Motion Analysis , 2011, IEEE Transactions on Signal Processing.

[9]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[10]  Y. C. Pati,et al.  Orthogonal matching pursuit: recursive function approximation with applications to wavelet decomposition , 1993, Proceedings of 27th Asilomar Conference on Signals, Systems and Computers.

[11]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[12]  Sheng Chen,et al.  Orthogonal least squares methods and their application to non-linear system identification , 1989 .

[13]  Charles Soussen,et al.  Relaxed Recovery Conditions for OMP/OLS by Exploiting Both Coherence and Decay , 2014, IEEE Transactions on Information Theory.

[14]  Yi Shen,et al.  A Remark on the Restricted Isometry Property in Orthogonal Matching Pursuit , 2012, IEEE Transactions on Information Theory.

[15]  Yonina C. Eldar,et al.  The Viterbi Algorithm for Subset Selection , 2015, IEEE Signal Processing Letters.

[16]  Bhaskar D. Rao,et al.  Application of tree-based searches to matching pursuit , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[17]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[18]  Jian Wang,et al.  Recovery of Sparse Signals Using Multiple Orthogonal Least Squares , 2014, IEEE Transactions on Signal Processing.

[19]  Haris Vikalo,et al.  Sparse linear regression via generalized orthogonal least-squares , 2016, 2016 IEEE Global Conference on Signal and Information Processing (GlobalSIP).

[20]  R. Gribonval,et al.  Exact Recovery Conditions for Sparse Representations With Partial Support Information , 2013, IEEE Transactions on Information Theory.

[21]  Haris Vikalo,et al.  Sampling Requirements and Accelerated Schemes for Sparse Linear Regression with Orthogonal Least-Squares , 2016, ArXiv.

[22]  Charles Soussen,et al.  Joint K-Step Analysis of Orthogonal Matching Pursuit and Orthogonal Least Squares , 2011, IEEE Transactions on Information Theory.

[23]  Lie Wang,et al.  Orthogonal Matching Pursuit for Sparse Signal Recovery With Noise , 2011, IEEE Transactions on Information Theory.

[24]  Hakan Erdogan,et al.  A* orthogonal matching pursuit: Best-first search for compressed sensing signal recovery , 2010, Digit. Signal Process..

[25]  Urbashi Mitra,et al.  Sparse channel estimation with zero tap detection , 2004, 2004 IEEE International Conference on Communications (IEEE Cat. No.04CH37577).

[26]  Abhimanyu Das,et al.  Submodular meets Spectral: Greedy Algorithms for Subset Selection, Sparse Approximation and Dictionary Selection , 2011, ICML.

[27]  Babak Hassibi,et al.  Recovering Sparse Signals Using Sparse Measurement Matrices in Compressed DNA Microarrays , 2008, IEEE Journal of Selected Topics in Signal Processing.