Two penalized estimators based on variance stabilization transforms for sparse compressive recovery with Poisson measurement noise

Abstract In this paper, we consider compressive inversion of a signal/image that is sparse in typical orthonormal bases used in image processing, given its measurements that have been corrupted by Poisson noise. The square-root operation is known to convert a Poisson random variable into one that is approximately Gaussian distributed with a constant variance. We present two different computationally tractable, penalized estimators with a data-fidelity term based on the aforementioned square-root based ‘variance stabilization transform’. The first estimator has been proposed earlier in the literature, but this is the first paper to analyze its theoretical performance in compressed sensing. Our second estimator is completely novel, and also has the interesting statistical property of being an approximately pivotal estimator. For both estimators, we specifically consider the case of a physically realistic sensing matrix in our analysis. We present detailed performance bounds on the l 2 recovery error for purely sparse signals for both estimators, making use of many different Poisson concentration inequalities. Several numerical results are presented, showing the practicality of the proposed estimators.

[1]  Mohamed-Jalal Fadili,et al.  A Proximal Iteration for Deconvolving Poisson Noisy Images Using Sparse Representations , 2008, IEEE Transactions on Image Processing.

[2]  P. Alam ‘G’ , 2021, Composites Engineering: An A–Z Guide.

[3]  Trevor Hastie,et al.  Statistical Learning with Sparsity: The Lasso and Generalizations , 2015 .

[4]  Gábor Lugosi,et al.  Concentration Inequalities - A Nonasymptotic Theory of Independence , 2013, Concentration Inequalities.

[5]  Ajit Rajwade,et al.  Performance bounds for Poisson compressed sensing using Variance Stabilization Transforms , 2017, 2017 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[6]  Martin J. Wainwright,et al.  A unified framework for high-dimensional analysis of $M$-estimators with decomposable regularizers , 2009, NIPS.

[7]  R. Zhang,et al.  The dominance of Poisson noise in color digital cameras , 2012, 2012 19th IEEE International Conference on Image Processing.

[8]  Ting Sun,et al.  Single-pixel imaging via compressive sampling , 2008, IEEE Signal Process. Mag..

[9]  Jeffrey A. Fessler,et al.  Sparsity regularization for image reconstruction with Poisson data , 2009, Electronic Imaging.

[10]  Yuan Li,et al.  Minimax Optimal Convex Methods for Poisson Inverse Problems Under $\ell_{q}$ -Ball Sparsity , 2016, IEEE Transactions on Information Theory.

[11]  Ajit Rajwade,et al.  Low radiation tomographic reconstruction with and without template information , 2019, Signal Process..

[12]  P. Alam,et al.  R , 1823, The Herodotus Encyclopedia.

[13]  Karthik S. Gurumoorthy,et al.  Using an Information Theoretic Metric for Compressive Recovery under Poisson Noise , 2019, Signal Process..

[14]  A. Belloni,et al.  Square-Root Lasso: Pivotal Recovery of Sparse Signals via Conic Programming , 2010, 1009.5689.

[15]  Amit Ashok,et al.  Information-optimal Scalable Compressive Imaging System , 2014 .

[16]  F. J. Anscombe,et al.  THE TRANSFORMATION OF POISSON, BINOMIAL AND NEGATIVE-BINOMIAL DATA , 1948 .

[17]  Sudarsanan Rajasekaran,et al.  Analyzing Cross-validation in Compressed Sensing with Poisson Noise , 2020 .

[18]  Ajit Rajwade,et al.  Poisson Noise Removal for Image Demosaicing , 2016, BMVC.

[19]  E.J. Candes,et al.  An Introduction To Compressive Sampling , 2008, IEEE Signal Processing Magazine.

[20]  R. DeVore,et al.  A Simple Proof of the Restricted Isometry Property for Random Matrices , 2008 .

[21]  Rebecca Willett,et al.  This is SPIRAL-TAP: Sparse Poisson Intensity Reconstruction ALgorithms—Theory and Practice , 2010, IEEE Transactions on Image Processing.

[22]  Karthik S. Gurumoorthy,et al.  Variance-stabilization-based compressive inversion under Poisson or Poisson–Gaussian noise with analytical bounds , 2019, Inverse Problems.

[23]  Alan G. Hawkes,et al.  A handbook of numerical and statistical techniques , 1977 .

[24]  Xin Jiang,et al.  Minimax Optimal Rates for Poisson Inverse Problems With Physical Constraints , 2014, IEEE Transactions on Information Theory.

[25]  J. Curtiss On Transformations Used in the Analysis of Variance , 1943 .

[26]  Yuantao Gu,et al.  On the theoretical analysis of cross validation in compressive sensing , 2014, 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP).

[27]  Member Eurasip,et al.  Application of simulated poisson statistical processes to stem imaging , 1985 .

[28]  Rebecca Willett,et al.  Poisson Noise Reduction with Non-local PCA , 2012, Journal of Mathematical Imaging and Vision.

[29]  Thomas Arildsen,et al.  Compressed sensing with linear correlation between signal and measurement noise , 2013, Signal Process..

[30]  Venkatesh Saligrama,et al.  Minimax Optimal Sparse Signal Recovery With Poisson Statistics , 2015, IEEE Transactions on Signal Processing.

[31]  Ajit Rajwade,et al.  Nonlinear Blind Compressed Sensing Under Signal-Dependent Noise , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[32]  G. Casella,et al.  Statistical Inference , 2003, Encyclopedia of Social Network Analysis and Mining.

[33]  Roummel F. Marcia,et al.  Compressed Sensing Performance Bounds Under Poisson Noise , 2009, IEEE Transactions on Signal Processing.

[34]  Jinzhu Jia,et al.  Sparse Poisson regression with penalized weighted score function , 2017, Electronic Journal of Statistics.

[35]  P. Bickel,et al.  SIMULTANEOUS ANALYSIS OF LASSO AND DANTZIG SELECTOR , 2008, 0801.1095.

[36]  Holger Rauhut,et al.  A Mathematical Introduction to Compressive Sensing , 2013, Applied and Numerical Harmonic Analysis.

[37]  Rebecca Willett,et al.  A Data-Dependent Weighted LASSO Under Poisson Noise , 2015, IEEE Transactions on Information Theory.

[38]  Alessandro Foi,et al.  Optimal Inversion of the Generalized Anscombe Transformation for Poisson-Gaussian Noise , 2013, IEEE Transactions on Image Processing.

[39]  Abbas El Gamal,et al.  CMOS Image Sensor With Per-Column ΣΔ ADC and Programmable Compressed Sensing , 2013, IEEE Journal of Solid-State Circuits.

[40]  Pavan K. Turaga,et al.  ReconNet: Non-Iterative Reconstruction of Images from Compressively Sensed Measurements , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[41]  M. Wainwright Basic tail and concentration bounds , 2019, High-Dimensional Statistics.

[42]  F. Natterer The Mathematics of Computerized Tomography , 1986 .

[43]  Yong Ho Moon,et al.  Simplified noise model parameter estimation for signal-dependent noise , 2014, Signal Process..

[44]  Mathukumalli Vidyasagar,et al.  An Introduction to Compressed Sensing , 2019 .

[45]  Martin J. Wainwright,et al.  Restricted Eigenvalue Properties for Correlated Gaussian Designs , 2010, J. Mach. Learn. Res..