Performance Limits of Compressive Sensing-Based Signal Classification

Most of the recent compressive sensing (CS) literature has focused on sparse signal recovery based on compressive measurements. However, exact signal recovery may not be required in certain signal processing applications such as in inference problems. In this paper, we provide performance limits of classification of sparse as well as not necessarily sparse signals based on compressive measurements. When signals are not necessarily sparse, we show that Kullback-Leibler and Chernoff distances between two probability density functions under any two hypotheses are preserved up to a factor of M/N with M(<;N)-length compressive measurements compared to that with N-length original measurements when the pdfs of the original-length observation vectors exhibit certain properties. These results are used to quantify the performance limits in terms of upper and lower bounds on the probability of error in signal classification with M-length compressive measurements. When the signals of interest are sparse in the standard canonical basis, performance limits are derived in terms of lower bounds on the probability of error in classifying sparse signals with any classification rule.

[1]  Emmanuel J. Candès,et al.  Robust uncertainty principles: exact signal reconstruction from highly incomplete frequency information , 2004, IEEE Transactions on Information Theory.

[2]  Richard G. Baraniuk,et al.  The smashed filter for compressive classification and target recognition , 2007, Electronic Imaging.

[3]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[4]  Pramod K. Varshney,et al.  Performance Bounds for Sparsity Pattern Recovery With Quantized Noisy Random Projections , 2012, IEEE Journal of Selected Topics in Signal Processing.

[5]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[6]  Antonia Maria Tulino,et al.  Random Matrix Theory and Wireless Communications , 2004, Found. Trends Commun. Inf. Theory.

[7]  Antonio Artés-Rodríguez,et al.  Compressive sensing detection of stochastic signals , 2008, 2008 42nd Annual Conference on Information Sciences and Systems.

[8]  Rebecca Willett,et al.  Hyperspectral target detection from incoherent projections , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[9]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[10]  Richard G. Baraniuk,et al.  Signal Processing With Compressive Measurements , 2010, IEEE Journal of Selected Topics in Signal Processing.

[11]  Galen Reeves,et al.  Sampling bounds for sparse support recovery in the presence of noise , 2008, 2008 IEEE International Symposium on Information Theory.

[12]  Sergio Verdú,et al.  Generalizing the Fano inequality , 1994, IEEE Trans. Inf. Theory.

[13]  Gongguo Tang,et al.  Performance Analysis for Sparse Support Recovery , 2009, IEEE Transactions on Information Theory.

[14]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[15]  Robert D. Nowak,et al.  Compressive Sampling for Signal Detection , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[16]  John R. Hershey,et al.  Approximating the Kullback Leibler Divergence Between Gaussian Mixture Models , 2007, 2007 IEEE International Conference on Acoustics, Speech and Signal Processing - ICASSP '07.

[17]  Rebecca Willett,et al.  Hyperspectral target detection from incoherent projections: Nonequiprobable targets and inhomogeneous SNR , 2010, 2010 IEEE International Conference on Image Processing.

[18]  Sundeep Rangan,et al.  Necessary and Sufficient Conditions for Sparsity Pattern Recovery , 2008, IEEE Transactions on Information Theory.

[19]  Qingling Zhang,et al.  Eigenvalue Inequalities for Matrix Product , 2006, IEEE Transactions on Automatic Control.

[20]  Martin J. Wainwright,et al.  Information-theoretic limits on sparsity recovery in the high-dimensional and noisy setting , 2009, IEEE Trans. Inf. Theory.

[21]  J. Haupt,et al.  Compressive Sampling for Signal Classification , 2006, 2006 Fortieth Asilomar Conference on Signals, Systems and Computers.

[22]  Zhu Han,et al.  Sparse event detection in wireless sensor networks using compressive sensing , 2009, 2009 43rd Annual Conference on Information Sciences and Systems.