Bits From Photons: Oversampled Image Acquisition Using Binary Poisson Statistics

We study a new image sensor that is reminiscent of a traditional photographic film. Each pixel in the sensor has a binary response, giving only a 1-bit quantized measurement of the local light intensity. To analyze its performance, we formulate the oversampled binary sensing scheme as a parameter estimation problem based on quantized Poisson statistics. We show that, with a single-photon quantization threshold and large oversampling factors, the Cramér-Rao lower bound (CRLB) of the estimation variance approaches that of an ideal unquantized sensor, i.e., as if there were no quantization in the sensor measurements. Furthermore, the CRLB is shown to be asymptotically achievable by the maximum-likelihood estimator (MLE). By showing that the log-likelihood function of our problem is concave, we guarantee the global optimality of iterative algorithms in finding the MLE. Numerical results on both synthetic data and images taken by a prototype sensor verify our theoretical analysis and demonstrate the effectiveness of our image reconstruction algorithm. They also suggest the potential application of the oversampled binary sensing scheme in high dynamic range photography.

[1]  H.-S. Philip Wong,et al.  A Multi-Aperture Image Sensor With 0.7 $\mu{\hbox{m}}$ Pixels in 0.11 $\mu{\hbox{m}}$ CMOS Technology , 2008, IEEE Journal of Solid-State Circuits.

[2]  Vivek K Goyal Quantized Overcomplete Expansions : Analysis , Synthesis and Algorithms , 1995 .

[3]  N. Mott,et al.  The Theory of the Photographic Process , 1944, Nature.

[4]  E. Wolf,et al.  Principles of Optics (7th Ed) , 1999 .

[5]  D. Malacara-Hernández,et al.  PRINCIPLES OF OPTICS , 2011 .

[6]  Robert D. Nowak,et al.  A statistical multiscale framework for Poisson inverse problems , 2000, IEEE Trans. Inf. Theory.

[7]  Keiji Mabuchi,et al.  A 1/2.3-inch 10.3Mpixel 50frame/s Back-Illuminated CMOS image sensor , 2010, 2010 IEEE International Solid-State Circuits Conference - (ISSCC).

[8]  Robert Bregovic,et al.  Multirate Systems and Filter Banks , 2002 .

[9]  Michael Unser,et al.  Splines: a perfect fit for signal and image processing , 1999, IEEE Signal Process. Mag..

[10]  E. R. Fossum,et al.  What to Do with Sub-Diffraction-Limit (SDL) Pixels?-A Proposal for a Gigapixel Digital Film Sensor (DFS) , 2005 .

[11]  Erik Reinhard,et al.  High Dynamic Range Imaging: Acquisition, Display, and Image-Based Lighting , 2010 .

[12]  H. Vincent Poor,et al.  An Introduction to Signal Detection and Estimation , 1994, Springer Texts in Electrical Engineering.

[13]  Robert D. Nowak,et al.  Multiscale Modeling and Estimation of Poisson Processes with Application to Photon-Limited Imaging , 1999, IEEE Trans. Inf. Theory.

[14]  H. Vincent Poor,et al.  An introduction to signal detection and estimation (2nd ed.) , 1994 .

[15]  Torben Hagerup,et al.  A Guided Tour of Chernoff Bounds , 1990, Inf. Process. Lett..

[16]  Alan V. Oppenheim,et al.  Quantization Noise Shaping on Arbitrary Frame Expansions , 2005, Proceedings. (ICASSP '05). IEEE International Conference on Acoustics, Speech, and Signal Processing, 2005..

[17]  Robert D. Nowak,et al.  Platelets: a multiscale approach for recovering edges and surfaces in photon-limited medical imaging , 2003, IEEE Transactions on Medical Imaging.

[18]  Robert D. Nowak,et al.  Multiscale Poisson Intensity and Density Estimation , 2007, IEEE Transactions on Information Theory.

[19]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[20]  Valentin Simeonov,et al.  École polytechnique fédérale de Lausanne (EPFL) , 2018, The Grants Register 2019.

[21]  Ingrid Daubechies,et al.  Single-Bit Oversampled A/D Conversion With Exponential Accuracy in the Bit Rate , 2007, IEEE Transactions on Information Theory.

[22]  S.Y. Kim,et al.  Fully Integrated 56 nm DRAM Technology for 1 Gb DRAM , 2007, 2007 IEEE Symposium on VLSI Technology.

[23]  Gabor C. Temes,et al.  Oversampling delta-sigma data converters : theory, design, and simulation , 1992 .

[24]  Jelena Kovacevic,et al.  Wavelets and Subband Coding , 2013, Prentice Hall Signal Processing Series.

[25]  Edoardo Charbon,et al.  A gamma, x-ray and high energy proton radiation-tolerant CIS for space applications , 2009, 2009 IEEE International Solid-State Circuits Conference - Digest of Technical Papers.

[26]  Michael Unser,et al.  Maximum likelihood estimation of liner signal parameters for Poisson processes , 1988, IEEE Trans. Acoust. Speech Signal Process..

[27]  Vivek K. Goyal,et al.  Quantized Overcomplete Expansions in IRN: Analysis, Synthesis, and Algorithms , 1998, IEEE Trans. Inf. Theory.