Compressed Sensing Performance Bounds Under Poisson Noise

This paper describes performance bounds for compressed sensing (CS) where the underlying sparse or compressible (sparsely approximable) signal is a vector of nonnegative intensities whose measurements are corrupted by Poisson noise. In this setting, standard CS techniques cannot be applied directly for several reasons. First, the usual signal-independent and/or bounded noise models do not apply to Poisson noise, which is nonadditive and signal-dependent. Second, the CS matrices typically considered are not feasible in real optical systems because they do not adhere to important constraints, such as nonnegativity and photon flux preservation. Third, the typical l2 - l1 minimization leads to overfitting in the high-intensity regions and oversmoothing in the low-intensity areas. In this paper, we describe how a feasible positivity- and flux-preserving sensing matrix can be constructed, and then analyze the performance of a CS reconstruction approach for Poisson data that minimizes an objective function consisting of a negative Poisson log likelihood term and a penalty term which measures signal sparsity. We show that, as the overall intensity of the underlying signal increases, an upper bound on the reconstruction error decays at an appropriate rate (depending on the compressibility of the signal), but that for a fixed signal intensity, the error bound actually grows with the number of measurements or sensors. This surprising fact is both proved theoretically and justified based on physical intuition.

[1]  Emmanuel J. Candès,et al.  Decoding by linear programming , 2005, IEEE Transactions on Information Theory.

[2]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[3]  Jean-Luc Starck,et al.  Astronomical Data Analysis and Sparsity: From Wavelets to Compressed Sensing , 2009, Proceedings of the IEEE.

[4]  Rebecca Willett,et al.  Multiscale Photon-Limited Spectral Image Reconstruction , 2010, SIAM J. Imaging Sci..

[5]  R. White,et al.  Image recovery from data acquired with a charge-coupled-device camera. , 1993, Journal of the Optical Society of America. A, Optics and image science.

[6]  M. Neifeld,et al.  Optical architectures for compressive imaging. , 2006, Applied optics.

[7]  Joel A. Tropp,et al.  Just relax: convex programming methods for identifying sparse signals in noise , 2006, IEEE Transactions on Information Theory.

[8]  A. Robert Calderbank,et al.  Performance Bounds for Expander-Based Compressed Sensing in Poisson Noise , 2010, IEEE Transactions on Signal Processing.

[9]  Jon A. Wellner,et al.  Weak Convergence and Empirical Processes: With Applications to Statistics , 1996 .

[10]  Zachary T. Harmany,et al.  Sparse poisson intensity reconstruction algorithms , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[11]  Cong Huang,et al.  MDL, penalized likelihood, and statistical risk , 2008, 2008 IEEE Information Theory Workshop.

[12]  Jeffrey A. Fessler,et al.  Sparsity regularization for image reconstruction with Poisson data , 2009, Electronic Imaging.

[13]  I. Rish,et al.  Sparse signal recovery with exponential-family noise , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[14]  M E Gehm,et al.  Single-shot compressive spectral imaging with a dual-disperser architecture. , 2007, Optics express.

[15]  I. Csiszár Why least squares and maximum entropy? An axiomatic approach to inference for linear inverse problems , 1991 .

[16]  Alexandros G. Dimakis,et al.  Sparse Recovery of Nonnegative Signals With Minimal Expansion , 2011, IEEE Transactions on Signal Processing.

[17]  Robert D. Nowak,et al.  Platelets: a multiscale approach for recovering edges and surfaces in photon-limited medical imaging , 2003, IEEE Transactions on Medical Imaging.

[18]  Thomas M. Cover,et al.  Elements of Information Theory , 2005 .

[19]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[20]  Mohamed-Jalal Fadili,et al.  A Proximal Iteration for Deconvolving Poisson Noisy Images Using Sparse Representations , 2008, IEEE Transactions on Image Processing.

[21]  S. Mendelson,et al.  Reconstruction and Subgaussian Operators in Asymptotic Geometric Analysis , 2007 .

[22]  Andrew R. Barron,et al.  Mixture Density Estimation , 1999, NIPS.

[23]  Florentina Bunea,et al.  Sparse Density Estimation with l1 Penalties , 2007, COLT.

[24]  Robert D. Nowak,et al.  Multiscale Poisson Intensity and Density Estimation , 2007, IEEE Transactions on Information Theory.

[25]  Emmanuel J. Candès,et al.  Near-Optimal Signal Recovery From Random Projections: Universal Encoding Strategies? , 2004, IEEE Transactions on Information Theory.

[26]  Olgica Milenkovic,et al.  Weighted Superimposed Codes and Constrained Integer Compressed Sensing , 2008, IEEE Transactions on Information Theory.

[27]  S. Mendelson,et al.  Uniform Uncertainty Principle for Bernoulli and Subgaussian Ensembles , 2006, math/0608665.

[28]  Mário A. T. Figueiredo,et al.  Deconvolution of Poissonian images using variable splitting and augmented Lagrangian optimization , 2009, 2009 IEEE/SP 15th Workshop on Statistical Signal Processing.

[29]  P. L. Combettes,et al.  A proximal decomposition method for solving convex variational inverse problems , 2008, 0807.2617.

[30]  Andrzej Stachurski,et al.  Parallel Optimization: Theory, Algorithms and Applications , 2000, Parallel Distributed Comput. Pract..

[31]  Alexandros G. Dimakis,et al.  Sparse Recovery of Positive Signals with Minimal Expansion , 2009, ArXiv.

[32]  R. Nowak,et al.  Multiscale likelihood analysis and complexity penalized estimation , 2004, math/0406424.

[33]  Ronald R. Coifman,et al.  Application of spatial light modulators for new modalities in spectrometry and imaging , 2003, SPIE BiOS.

[34]  H. Chernoff A Measure of Asymptotic Efficiency for Tests of a Hypothesis Based on the sum of Observations , 1952 .

[35]  A. Robert Calderbank,et al.  Performance bounds for expander-based compressed sensing in the presence of Poisson noise , 2009, 2009 Conference Record of the Forty-Third Asilomar Conference on Signals, Systems and Computers.

[36]  Robert D. Nowak,et al.  Signal Reconstruction From Noisy Random Projections , 2006, IEEE Transactions on Information Theory.

[37]  Gabriele Steidl,et al.  Restoration of images with rotated shapes , 2008, Numerical Algorithms.

[38]  R. Tibshirani Regression Shrinkage and Selection via the Lasso , 1996 .

[39]  Nelly Pustelnik,et al.  Nested Iterative Algorithms for Convex Constrained Image Recovery Problems , 2008, SIAM J. Imaging Sci..