Information-Theoretic Characterization and Undersampling Ratio Determination for Compressive Radar Imaging in a Simulated Environment

Assuming sparsity or compressibility of the underlying signals, compressed sensing or compressive sampling (CS) exploits the informational efficiency of under-sampled measurements for increased efficiency yet acceptable accuracy in information gathering, transmission and processing, though it often incurs extra computational cost in signal reconstruction. Shannon information quantities and theorems, such as source rate-distortion, trans-information and rate distortion theorem concerning lossy data compression, provide a coherent framework, which is complementary to classic CS theory, for analyzing informational quantities and for determining the necessary number of measurements in CS. While there exists some information-theoretic research in the past on CS in general and compressive radar imaging in particular, systematic research is needed to handle issues related to scene description in cluttered environments and trans-information quantification in complex sparsity-clutter-sampling-noise settings. The novelty of this paper lies in furnishing a general strategy for information-theoretic analysis of scene compressibility, trans-information of radar echo data about the scene and the targets of interest, respectively, and limits to undersampling ratios necessary for scene reconstruction subject to distortion given sparsity-clutter-noise constraints. A computational experiment was performed to demonstrate informational analysis regarding the scene-sampling-reconstruction process and to generate phase transition diagrams showing relations between undersampling ratios and sparsity-clutter-noise-distortion constraints. The strategy proposed in this paper is valuable for information-theoretic analysis and undersampling theorem developments in compressive radar imaging and other computational imaging applications.

[1]  Xiaotao Huang,et al.  Segmented Reconstruction for Compressed Sensing SAR Imaging , 2013, IEEE Transactions on Geoscience and Remote Sensing.

[2]  Stéphane Mallat,et al.  Solving Inverse Problems With Piecewise Linear Estimators: From Gaussian Mixture Models to Structured Sparsity , 2010, IEEE Transactions on Image Processing.

[3]  Venkatesh Saligrama,et al.  Information Theoretic Bounds for Compressed Sensing , 2008, IEEE Transactions on Information Theory.

[4]  Joachim H. G. Ender,et al.  On compressive sensing applied to radar , 2010, Signal Process..

[5]  S. Lawrence Marple,et al.  Compressed sensing radar amid noise and clutter using interference covariance information , 2014, IEEE Transactions on Aerospace and Electronic Systems.

[6]  Lee C Potter,et al.  Pitfalls and possibilities of radar compressive sensing. , 2015, Applied optics.

[7]  Richard G. Baraniuk,et al.  Bayesian Compressive Sensing Via Belief Propagation , 2008, IEEE Transactions on Signal Processing.

[8]  Florent Krzakala,et al.  Compressed sensing of approximately-sparse signals: Phase transitions and optimal reconstruction , 2012, 2012 50th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[9]  Thomas Strohmer,et al.  High-Resolution Radar via Compressed Sensing , 2008, IEEE Transactions on Signal Processing.

[10]  Robert W. Ives,et al.  Compression of complex-valued SAR images , 1999, IEEE Trans. Image Process..

[11]  A. W. Rihaczek,et al.  Man-made target backscattering behavior: applicability of conventional radar resolution theory , 1996, IEEE Transactions on Aerospace and Electronic Systems.

[12]  Philip M. Woodward,et al.  Probability and Information Theory with Applications to Radar , 1954 .

[13]  Thomas Strohmer,et al.  Measure What Should be Measured: Progress and Challenges in Compressive Sensing , 2012, ArXiv.

[14]  Wen Hong,et al.  Sparse microwave imaging: Principles and applications , 2012, Science China Information Sciences.

[15]  S. Quegan,et al.  Understanding Synthetic Aperture Radar Images , 1998 .

[16]  James L. Massey,et al.  Proper complex random processes with applications to information theory , 1993, IEEE Trans. Inf. Theory.

[17]  Alan S. Willsky,et al.  Feature-preserving regularization method for complex-valued inverse problems with application to coherent imaging , 2006 .

[18]  Michael Elad,et al.  Sparse and Redundant Representation Modeling—What Next? , 2012, IEEE Signal Processing Letters.

[19]  Sundeep Rangan,et al.  Necessary and Sufficient Conditions for Sparsity Pattern Recovery , 2008, IEEE Transactions on Information Theory.

[20]  John A. Richards,et al.  Efficient transmission and classification of hyperspectral image data , 2003, IEEE Trans. Geosci. Remote. Sens..

[21]  Sergio Verdú,et al.  Optimal Phase Transitions in Compressed Sensing , 2011, IEEE Transactions on Information Theory.

[22]  Galen Reeves,et al.  The Sampling Rate-Distortion Tradeoff for Sparsity Pattern Recovery in Compressed Sensing , 2010, IEEE Transactions on Information Theory.

[23]  Mark R. Bell Information theory and radar waveform design , 1993, IEEE Trans. Inf. Theory.

[24]  Xueming Qian,et al.  SAR complex image data compression based on quadtree and zerotree Coding in Discrete Wavelet Transform Domain: A Comparative Study , 2015, Neurocomputing.

[25]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[26]  Mengdao Xing,et al.  Sparse Regularization of Interferometric Phase and Amplitude for InSAR Image Formation Based on Bayesian Representation , 2015, IEEE Transactions on Geoscience and Remote Sensing.

[27]  David L. Donoho,et al.  Precise Undersampling Theorems , 2010, Proceedings of the IEEE.

[28]  Gene W. Zeoli,et al.  A lower bound on the date rate for synthetic aperture radar , 1976, IEEE Trans. Inf. Theory.

[29]  Venkatesh Saligrama,et al.  On sensing capacity of sensor networks for a class of linear observation models , 2007, 2007 IEEE/SP 14th Workshop on Statistical Signal Processing.

[30]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[31]  Xiao Wang,et al.  Identifying Chaotic FitzHugh-Nagumo Neurons Using Compressive Sensing , 2014, Entropy.

[32]  Alon Orlitsky,et al.  Limit results on pattern entropy , 2004, IEEE Transactions on Information Theory.

[33]  Meir Feder,et al.  Joint source-channel coding of a Gaussian mixture source over the Gaussian broadcast channel , 2002, IEEE Trans. Inf. Theory.

[34]  A. Robert Calderbank,et al.  Reconstruction of Signals Drawn From a Gaussian Mixture Via Noisy Compressive Measurements , 2013, IEEE Transactions on Signal Processing.

[35]  Emre Ertin,et al.  Sparsity and Compressed Sensing in Radar Imaging , 2010, Proceedings of the IEEE.

[36]  Deanna Needell,et al.  CoSaMP: Iterative signal recovery from incomplete and inaccurate samples , 2008, ArXiv.

[37]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[38]  Kush R. Varshney,et al.  Sparsity-Driven Synthetic Aperture Radar Imaging: Reconstruction, autofocusing, moving targets, and compressed sensing , 2014, IEEE Signal Processing Magazine.

[39]  Joel A. Tropp,et al.  Signal Recovery From Random Measurements Via Orthogonal Matching Pursuit , 2007, IEEE Transactions on Information Theory.

[40]  Ke Yang,et al.  Informational Analysis for Compressive Sampling in Radar Imaging , 2015, Sensors.

[41]  Cem Aksoylar,et al.  Information-Theoretic Characterization of Sparse Recovery , 2014, AISTATS.

[42]  Zachary Chance,et al.  Information-theoretic structure of multistatic radar imaging , 2011, 2011 IEEE RadarCon (RADAR).

[43]  Vahid Tarokh,et al.  Shannon-Theoretic Limits on Noisy Compressive Sampling , 2007, IEEE Transactions on Information Theory.

[44]  Nathan A. Goodman,et al.  Theory and Application of SNR and Mutual Information Matched Illumination Waveforms , 2011, IEEE Transactions on Aerospace and Electronic Systems.

[45]  Andrea Montanari,et al.  Accurate Prediction of Phase Transitions in Compressed Sensing via a Connection to Minimax Denoising , 2011, IEEE Transactions on Information Theory.

[46]  V.S. Frost,et al.  The Information Content of Synthetic Aperture Radar Images of Terrain , 1983, IEEE Transactions on Aerospace and Electronic Systems.

[47]  Thomas Strohmer,et al.  Compressed Remote Sensing of Sparse Objects , 2009, SIAM J. Imaging Sci..

[48]  Martin Vetterli,et al.  Rate Distortion Behavior of Sparse Sources , 2012, IEEE Transactions on Information Theory.

[49]  S. Frick,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[50]  Paco López-Dekker,et al.  A Novel Strategy for Radar Imaging Based on Compressive Sensing , 2010, IEEE Transactions on Geoscience and Remote Sensing.

[51]  Ian G. Cumming,et al.  Digital Processing of Synthetic Aperture Radar Data: Algorithms and Implementation , 2005 .

[52]  Bernie Mulgrew,et al.  Compressed sensing based compression of SAR raw data , 2009 .

[53]  Richard G. Baraniuk,et al.  Compressed Sensing , 2014, Computer Vision, A Reference Guide.

[54]  Martin J. Wainwright,et al.  Information-Theoretic Limits on Sparsity Recovery in the High-Dimensional and Noisy Setting , 2007, IEEE Transactions on Information Theory.