Variance-stabilization-based compressive inversion under Poisson or Poisson–Gaussian noise with analytical bounds

Most existing bounds for signal reconstruction from compressivemeasurements make the assumption of additive signal-independent noise. However in many compressive imaging systems, the noise statistics are more accurately represented by Poisson or Poisson-Gaussian noise models. In this paper, we derive upper bounds for signal reconstruction error from compressive measurements which are corrupted by Poisson or Poisson-Gaussian noise. The features of our bounds are as follows: (1) The bounds are derived for a computationally tractable convex estimator with statistically motivated parameter selection. The estimator penalizes signal sparsity subject to a constraint that imposes a novel statistically motivated upper bound on a term baseda#13; on variance stabilization transforms to approximate the Poisson or Poisson-Gaussian distributions by distributions with (nearly) constant variance. (2) The bounds are applicable to signals that are sparse as well as compressible in any orthonormal basis,a#13; and are derived for compressive systems obeying realistic constraints such as non-negativity and flux-preservation. Our bounds are motivated by several properties of the variance stabilization transforms that we develop and analyze. We present extensivea#13; numerical results for signal reconstruction under varying number of measurements and varying signal intensity levels. Ours is the first piece of work to derive bounds on compressive inversion for the Poisson-Gaussian noise model. We also use the propertiesa#13; of the variance stabilizer to develop a principle for selection of the regularization parameter in penalized estimators for any type of Poisson and Poisson-Gaussian inverse problem.

[1]  Luca Zanni,et al.  A discrepancy principle for Poisson data , 2010 .

[2]  Thierry Blu,et al.  Image Denoising in Mixed Poisson–Gaussian Noise , 2011, IEEE Transactions on Image Processing.

[3]  R. Zhang,et al.  The dominance of Poisson noise in color digital cameras , 2012, 2012 19th IEEE International Conference on Image Processing.

[4]  Jean-Luc Starck,et al.  Astronomical Data Analysis and Sparsity: From Wavelets to Compressed Sensing , 2009, Proceedings of the IEEE.

[5]  P. Massart,et al.  Adaptive estimation of a quadratic functional by model selection , 2000 .

[6]  E. Candès The restricted isometry property and its implications for compressed sensing , 2008 .

[7]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[8]  Xin Jiang,et al.  Minimax Optimal Rates for Poisson Inverse Problems With Physical Constraints , 2014, IEEE Transactions on Information Theory.

[9]  J. Curtiss On Transformations Used in the Analysis of Variance , 1943 .

[10]  I. Rish,et al.  Sparse signal recovery with exponential-family noise , 2009, 2009 47th Annual Allerton Conference on Communication, Control, and Computing (Allerton).

[11]  Franck Picard,et al.  Adaptive Lasso and group-Lasso for functional Poisson regression , 2014, J. Mach. Learn. Res..

[12]  Yuan Li,et al.  Minimax Optimal Convex Methods for Poisson Inverse Problems Under $\ell_{q}$ -Ball Sparsity , 2016, IEEE Transactions on Information Theory.

[13]  Ajit Rajwade,et al.  Performance bounds for Poisson compressed sensing using Variance Stabilization Transforms , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[14]  Jean-Luc Starck,et al.  Compressed Sensing in Astronomy , 2008, IEEE Journal of Selected Topics in Signal Processing.

[15]  Daniel J. Lum,et al.  Photon counting compressive depth mapping , 2013, Optics express.

[16]  Volkan Cevher,et al.  Consistency of ℓ1-regularized maximum-likelihood for compressive Poisson regression , 2015, 2015 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[17]  Jeffrey A. Fessler,et al.  Sparsity regularization for image reconstruction with Poisson data , 2009, Electronic Imaging.

[18]  S. Yun,et al.  Frame-based Poisson image restoration using a proximal linearized alternating direction method , 2013 .

[19]  J. Tukey,et al.  Transformations Related to the Angular and the Square Root , 1950 .

[20]  Fionn Murtagh,et al.  Image restoration with noise suppression using a multiresolution support. , 1995 .

[21]  F. J. Anscombe,et al.  THE TRANSFORMATION OF POISSON, BINOMIAL AND NEGATIVE-BINOMIAL DATA , 1948 .

[22]  Venkatesh Saligrama,et al.  Minimax Optimal Sparse Signal Recovery With Poisson Statistics , 2015, IEEE Transactions on Signal Processing.

[23]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[24]  Rebecca Willett,et al.  A Data-Dependent Weighted LASSO Under Poisson Noise , 2015, IEEE Transactions on Information Theory.

[25]  R. Dudfield A Critical Examination of the Methods of Recording and Publishing Statistical Data Bearing on Public Health; with Suggestions for the Improvement of such Methods , 1905 .

[26]  Johnathan M. Bardsley,et al.  Regularization parameter selection methods for ill-posed Poisson maximum likelihood estimation , 2009 .

[27]  M. Bartlett The Square Root Transformation in Analysis of Variance , 1936 .

[28]  Valeria Ruggiero,et al.  Numerical Methods for Parameter Estimation in Poisson Data Inversion , 2014, Journal of Mathematical Imaging and Vision.

[29]  Ajit Rajwade,et al.  Reconstruction Error Bounds for Compressed Sensing under Poisson Noise using the Square Root of the Jensen-Shannon Divergence , 2016, ArXiv.

[30]  E. Candès,et al.  Compressive fluorescence microscopy for biological and hyperspectral imaging , 2012, Proceedings of the National Academy of Sciences.

[31]  Roummel F. Marcia,et al.  Compressed Sensing Performance Bounds Under Poisson Noise , 2009, IEEE Transactions on Signal Processing.

[32]  P. Vandergheynst,et al.  Compressed sensing imaging techniques for radio interferometry , 2008, 0812.4933.

[33]  R. Ramlau,et al.  Morozov's discrepancy principle for Tikhonov-type functionals with nonlinear operators , 2010 .

[34]  Rebecca Willett,et al.  This is SPIRAL-TAP: Sparse Poisson Intensity Reconstruction ALgorithms—Theory and Practice , 2010, IEEE Transactions on Image Processing.

[35]  Ajit Rajwade,et al.  Poisson Noise Removal for Image Demosaicing , 2016, BMVC.

[36]  Hugues Talbot,et al.  A Convex Approach for Image Restoration with Exact Poisson-Gaussian Likelihood , 2015, SIAM J. Imaging Sci..

[37]  François Laviolette,et al.  Domain-Adversarial Training of Neural Networks , 2015, J. Mach. Learn. Res..

[38]  Stephen P. Boyd,et al.  Convex Optimization , 2004, Algorithms and Theory of Computation Handbook.

[39]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[40]  Richard G. Baraniuk,et al.  Democracy in Action: Quantization, Saturation, and Compressive Sensing , 2011 .

[41]  Bin Yu,et al.  THE LASSO UNDER POISSON-LIKE HETEROSCEDASTICITY , 2013 .

[42]  Yaniv Plan,et al.  The Generalized Lasso With Non-Linear Observations , 2015, IEEE Transactions on Information Theory.

[43]  J. H. Pollard,et al.  A Handbook of Numerical and Statistical Techniques: With Examples Mainly from the Life Sciences , 1979 .

[44]  Jianwei Ma,et al.  Single-Pixel Remote Sensing , 2009, IEEE Geoscience and Remote Sensing Letters.

[45]  Mohamed-Jalal Fadili,et al.  Wavelets, Ridgelets, and Curvelets for Poisson Noise Removal , 2008, IEEE Transactions on Image Processing.

[46]  Michael T. Heath,et al.  Scientific Computing: An Introductory Survey , 1996 .

[47]  E. Candès,et al.  Stable signal recovery from incomplete and inaccurate measurements , 2005, math/0503066.

[48]  Ambuj Tewari,et al.  Learning Exponential Families in High-Dimensions: Strong Convexity and Sparsity , 2009, AISTATS.

[49]  Terence Tao,et al.  The Dantzig selector: Statistical estimation when P is much larger than n , 2005, math/0506081.

[50]  Mohamed-Jalal Fadili,et al.  A Proximal Iteration for Deconvolving Poisson Noisy Images Using Sparse Representations , 2008, IEEE Transactions on Image Processing.

[51]  Bradley L. Preece,et al.  Performance assessment of a single-pixel compressive sensing imaging system , 2016, SPIE Defense + Security.

[52]  Karthik S. Gurumoorthy,et al.  Using an Information Theoretic Metric for Compressive Recovery under Poisson Noise , 2019, Signal Process..

[53]  Vivek K. Goyal,et al.  Performance Analysis of Low-Flux Least-Squares Single-Pixel Imaging , 2016, IEEE Signal Processing Letters.

[54]  Thierry Blu,et al.  Multiframe sure-let denoising of timelapse fluorescence microscopy images , 2008, 2008 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[55]  Axel Munk,et al.  Statistical Multiresolution Estimation for Variational Imaging: With an Application in Poisson-Biophotonics , 2012, Journal of Mathematical Imaging and Vision.

[56]  Abbas El Gamal,et al.  CMOS Image Sensor With Per-Column ΣΔ ADC and Programmable Compressed Sensing , 2013, IEEE Journal of Solid-State Circuits.

[57]  Pavan K. Turaga,et al.  ReconNet: Non-Iterative Reconstruction of Images from Compressively Sensed Measurements , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).