On sparse sensing and sparse sampling of coded signals at sub-Landau rates

Advances in information-theoretic analysis of sparse sampling of continuous uncoded signals at sampling rates exceeding the Landau rate were reported in recent works. This work examines sparse sampling of coded signals at sub-Landau sampling rates. It is shown that with coded and with discrete signals, the Landau condition may be relaxed, and the sampling rates required for signal reconstruction and for support detection can be lower than the effective bandwidth. Equivalently, the number of measurements in the corresponding sparse sensing problem can be smaller than the support size. Tight bounds on information rates and on signal and support detection performance are derived for the Gaussian sparsely sampled channel and for the frequency-sparse channel using the context of state dependent channels. Support detection results are verified by a simulation. When the system is high-dimensional, the required signal to noise ratio is shown to be finite but high and rising with decreasing sampling rate; in some practical applications, it can be lowered by reducing the a-priory uncertainty about the support, for example, by concentrating the frequency support into a finite number of subbands. The sub-Landau sampling rates are analysed also in large systems with discrete signal constellations replacing the coding. Copyright © 2013 John Wiley & Sons, Ltd.

[1]  Urbashi Mitra,et al.  Joint Transmission and State Estimation: A Constrained Channel Coding Approach , 2011, IEEE Transactions on Information Theory.

[2]  Antonia Maria Tulino,et al.  Random Matrix Theory and Wireless Communications , 2004, Found. Trends Commun. Inf. Theory.

[3]  Sergio Verdú,et al.  Optimal Phase Transitions in Compressed Sensing , 2011, IEEE Transactions on Information Theory.

[4]  Galen Reeves,et al.  Approximate Sparsity Pattern Recovery: Information-Theoretic Lower Bounds , 2010, IEEE Transactions on Information Theory.

[5]  Andrea Montanari,et al.  Accurate Prediction of Phase Transitions in Compressed Sensing via a Connection to Minimax Denoising , 2011, IEEE Transactions on Information Theory.

[6]  S. Shamai,et al.  On sparse sensing of coded signals at Sub-Landau sampling rates , 2012, 2012 IEEE 27th Convention of Electrical and Electronics Engineers in Israel.

[7]  Shlomo Shamai,et al.  Mutual information and minimum mean-square error in Gaussian channels , 2004, IEEE Transactions on Information Theory.

[8]  Jie Chen,et al.  Theoretical Results on Sparse Representations of Multiple-Measurement Vectors , 2006, IEEE Transactions on Signal Processing.

[9]  Shlomo Shamai,et al.  Support Recovery With Sparsely Sampled Free Random Matrices , 2011, IEEE Transactions on Information Theory.

[10]  Michael Elad,et al.  Optimally sparse representation in general (nonorthogonal) dictionaries via ℓ1 minimization , 2003, Proceedings of the National Academy of Sciences of the United States of America.

[11]  Ronen Dar,et al.  The Jacobi MIMO Channel , 2013, IEEE Trans. Inf. Theory.

[12]  Urbashi Mitra,et al.  Causal State Communication , 2012, IEEE Transactions on Information Theory.

[13]  Andrew R. Barron,et al.  High-rate sparse superposition codes with iteratively optimal estimates , 2012, 2012 IEEE International Symposium on Information Theory Proceedings.

[14]  T. Blumensath,et al.  Theory and Applications , 2011 .

[15]  Shlomo Shamai,et al.  LDPC coded MIMO multiple access with iterative joint decoding , 2005, IEEE Transactions on Information Theory.

[16]  Aaron D. Wyner,et al.  Channels with Side Information at the Transmitter , 1993 .

[17]  Jiaru Lin,et al.  A joint recovery algorithm for distributed compressed sensing , 2012, Trans. Emerg. Telecommun. Technol..

[18]  Ping Feng,et al.  Spectrum-blind minimum-rate sampling and reconstruction of multiband signals , 1996, 1996 IEEE International Conference on Acoustics, Speech, and Signal Processing Conference Proceedings.

[19]  Galen Reeves,et al.  The Sampling Rate-Distortion Tradeoff for Sparsity Pattern Recovery in Compressed Sensing , 2010, IEEE Transactions on Information Theory.

[20]  Emre Telatar,et al.  Capacity of Multi-antenna Gaussian Channels , 1999, Eur. Trans. Telecommun..

[21]  Neri Merhav,et al.  Channel Coding in the Presence of Side Information , 2008, Found. Trends Commun. Inf. Theory.

[22]  Yoram Bresler,et al.  Subspace Methods for Joint Sparse Recovery , 2010, IEEE Transactions on Information Theory.

[23]  Mihailo Stojnic,et al.  Compressed sensing of block-sparse positive vectors , 2013, ArXiv.

[24]  Dongning Guo,et al.  Capacity of Gaussian Channels With Duty Cycle and Power Constraints , 2012, IEEE Transactions on Information Theory.

[25]  Y. Bresler Spectrum-blind sampling and compressive sensing for continuous-index signals , 2008, 2008 Information Theory and Applications Workshop.

[26]  H. Landau Necessary density conditions for sampling and interpolation of certain entire functions , 1967 .

[27]  Shlomo Shamai,et al.  Support recovery with sparsely sampled free random matrices , 2011, ISIT.

[28]  Yonina C. Eldar,et al.  Super-resolution and reconstruction of sparse images carried by incoherent light. , 2010, Optics letters.

[29]  Shlomo Shamai,et al.  Capacity of Channels With Frequency-Selective and Time-Selective Fading , 2010, IEEE Transactions on Information Theory.

[30]  Sergio Verdú,et al.  Randomly spread CDMA: asymptotics via statistical physics , 2005, IEEE Transactions on Information Theory.

[31]  Young-Han Kim,et al.  State Amplification , 2008, IEEE Transactions on Information Theory.