Optimal scheduling of capture times in a multiple-capture imaging system

Several papers have discussed the idea of extending image sensor dynamic range by capturing several images during a normal exposure time. Most of these papers assume that the images are captured according to a uniform or an exponentially increasing exposure time schedule. Even though such schedules can be justified by certain implementation considerations, there has not been any systematic study of how capture time schedules should be optimally determined. In this paper we formulae the multiple capture time scheduling problem when the incident illumination probability density function (pdf) is completely known as a constrained optimization problem. We aim to find the capture times that maximize the average signal SNR. The formulation leads to a general upper bound on achievable average SNR using multiple capture for any given illumination pdf. For a uniform pdf, the average SNR is a concave function in capture times and therefore well-known convex optimization techniques can be applied to find the global optimum. For a general piece-wise uniform pdf, the average SNR is not necessarily concave. The cost function, however, is a Difference of Convex (D.C.) function and well-established D.C. or global optimization techniques can be used.

[1]  Shoji Kawahito,et al.  A CMOS Image Sensor with Non-Destructive Intermediate Readout Mode for Adaptive Iterative Search Motion Vector Estimation , 2001 .

[2]  R. Horst,et al.  Global Optimization: Deterministic Approaches , 1992 .

[3]  Orly Yadid-Pecht,et al.  Wide intrascene dynamic range CMOS APS using dual sampling , 1997 .

[4]  Panos M. Pardalos,et al.  Introduction to Global Optimization , 2000, Introduction to Global Optimization.

[5]  Abbas El Gamal,et al.  Comparative analysis of SNR for image sensors with enhanced dynamic range , 1999, Electronic Imaging.

[6]  S. Kleinfelder,et al.  A 10 kframe/s 0.18 /spl mu/m CMOS digital pixel sensor with pixel-level memory , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[7]  Barry Fowler,et al.  A 640×512 CMOS Image Sensor with Ultra Wide Dynamic Range Floating-Point Pixel-Level ADC , 1999 .

[8]  Suk Hwan Lim,et al.  A 10,000 Frames/s 0.18 μm CMOS Digital Pixel Sensor with Pixel-Level Memory , 2001 .

[9]  A. Matsuzawa,et al.  A CMOS image sensor for focal-plane low-power motion vector estimation , 2000, 2000 Symposium on VLSI Circuits. Digest of Technical Papers (Cat. No.00CH37103).

[10]  Abbas El Gamal,et al.  Photocurrent estimation from multiple nondestructive samples in CMOS image sensor , 2001, IS&T/SPIE Electronic Imaging.

[11]  A. El Gamal,et al.  A 640/spl times/512 CMOS image sensor with ultra wide dynamic range floating-point pixel-level ADC , 1999, 1999 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC. First Edition (Cat. No.99CH36278).