Fundamental limits for support recovery of tree-sparse signals from noisy compressive samples

Recent breakthrough results in compressive sensing (CS) have established that many high dimensional signals can be accurately recovered from a relatively small number of non-adaptive linear observations, provided that the signals possess a sparse representation in some basis. Subsequent efforts have shown that the performance of CS can be improved by exploiting structure in the locations of the nonzero signal coefficients during inference, or by utilizing some form of data-dependent adaptive measurement scheme during the sensing process. Our previous work established that an adaptive sensing strategy specifically tailored to signals that are tree-sparse can significantly outperform adaptive and non-adaptive sensing strategies that are agnostic to the underlying structure in noisy support recovery tasks. In this paper we establish corresponding fundamental performance limits for these support recovery tasks, in settings where measurements may be obtained either non-adaptively (using a randomized Gaussian measurement strategy motivated by initial CS investigations) or by any adaptive sensing strategy. Our main results here imply that the adaptive tree sensing procedure analyzed in our previous work is nearly optimal, in the sense that no other sensing and estimation strategy can perform fundamentally better for identifying the support of tree-sparse signals.

[1]  Matthew Malloy,et al.  Sequential Testing for Sparse Recovery , 2012, IEEE Transactions on Information Theory.

[2]  Matthew Malloy,et al.  Sequential analysis in high-dimensional multiple testing and sparse recovery , 2011, 2011 IEEE International Symposium on Information Theory Proceedings.

[3]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[4]  Gongguo Tang,et al.  ADAPTIVE SENSING WITH STRUCTURED SPARSITY , 2013 .

[5]  Marco F. Duarte,et al.  Fast Reconstruction of Piecewise Smooth Signals from Incoherent Projections , 2005 .

[6]  Matthias W. Seeger,et al.  Compressed sensing and Bayesian experimental design , 2008, ICML '08.

[7]  Jarvis D. Haupt,et al.  Efficient adaptive compressive sensing using sparse hierarchical learned dictionaries , 2011, 2011 Conference Record of the Forty Fifth Asilomar Conference on Signals, Systems and Computers (ASILOMAR).

[8]  Jarvis D. Haupt,et al.  On the Fundamental Limits of Recovering Tree Sparse Vectors From Noisy Linear Measurements , 2013, IEEE Transactions on Information Theory.

[9]  Venkatesh Saligrama,et al.  Information Theoretic Bounds for Compressed Sensing , 2008, IEEE Transactions on Information Theory.

[10]  Robert D. Nowak,et al.  Sequentially designed compressed sensing , 2012, 2012 IEEE Statistical Signal Processing Workshop (SSP).

[11]  Yonina C. Eldar,et al.  Structured Compressed Sensing: From Theory to Applications , 2011, IEEE Transactions on Signal Processing.

[12]  Robert D. Nowak,et al.  Compressive distilled sensing: Sparse recovery using adaptivity in compressive measurements , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[13]  Robert D. Nowak,et al.  Distilled Sensing: Adaptive Sampling for Sparse Detection and Estimation , 2010, IEEE Transactions on Information Theory.

[14]  Robert D. Nowak,et al.  Adaptive sensing for sparse recovery , 2012, Compressed Sensing.

[15]  Volkan Cevher,et al.  Model-Based Compressive Sensing , 2008, IEEE Transactions on Information Theory.

[16]  Matthew Malloy,et al.  Near-Optimal Adaptive Compressed Sensing , 2012, IEEE Transactions on Information Theory.

[17]  Minh N. Do,et al.  Signal reconstruction using sparse tree representations , 2005, SPIE Optics + Photonics.

[18]  Robert D. Nowak,et al.  Finding needles in noisy haystacks , 2008, 2008 IEEE International Conference on Acoustics, Speech and Signal Processing.

[19]  L P Panych,et al.  A dynamically adaptive imaging algorithm for wavelet‐encoded MRI , 1994, Magnetic resonance in medicine.

[20]  R. Castro Adaptive sensing performance lower bounds for sparse signal detection and support estimation , 2012, 1206.0648.

[21]  Akshay Krishnamurthy,et al.  Recovering graph-structured activations using adaptive compressive measurements , 2013, 2013 Asilomar Conference on Signals, Systems and Computers.

[22]  Emmanuel J. Candès,et al.  On the Fundamental Limits of Adaptive Sensing , 2011, IEEE Transactions on Information Theory.

[23]  Sivaraman Balakrishnan,et al.  Recovering block-structured activations using compressive measurements , 2012, 1209.3431.

[24]  Martin J. Wainwright,et al.  Information-theoretic limits on sparsity recovery in the high-dimensional and noisy setting , 2009, IEEE Trans. Inf. Theory.

[25]  Junzhou Huang,et al.  Learning with structured sparsity , 2009, ICML '09.