Predictive multiple sampling algorithm with overlapping integration intervals for linear wide dynamic range integrating image sensors

Many tasks performed by intelligent transportation systems involve processing of natural scenes. Wide dynamic range visible spectrum image sensors are required to achieve optimal processing performance. Recently several approaches that rely on the multiple sampling technique to achieve wide dynamic range have been presented. The behavior of a novel predictive variant of these algorithms is analyzed together with its key assumptions and limits to its performance and flexibility.

[1]  Orly Yadid-Pecht,et al.  CMOS active pixel sensor star tracker with regional electronic shutter , 1997 .

[2]  Theodore I. Kamins,et al.  Device Electronics for Integrated Circuits , 1977 .

[3]  Franjo Pernus,et al.  A machine vision system for inspecting bearings , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[4]  Bart Dierickx,et al.  Random addressable active pixel image sensors , 1996, Advanced Imaging and Network Technologies.

[5]  Orly Yadid-Pecht,et al.  Wide intrascene dynamic range CMOS APS using dual sampling , 1997 .

[6]  B.J. Hosticka,et al.  A high dynamic range CMOS image sensor for automotive applications , 2000, Proceedings of the 25th European Solid-State Circuits Conference.

[7]  L.G. Mellrath,et al.  A low power, low noise, ultra-wide dynamic range CMOS imager with pixel-parallel A/D conversion , 2000, 2000 Symposium on VLSI Circuits. Digest of Technical Papers (Cat. No.00CH37103).

[8]  David Mumford,et al.  Statistics of natural images and models , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[9]  Ioannis Pitas,et al.  Extraction of facial regions and features using color and shape information , 1996, Proceedings of 13th International Conference on Pattern Recognition.

[10]  Barry Fowler,et al.  A 640×512 CMOS Image Sensor with Ultra Wide Dynamic Range Floating-Point Pixel-Level ADC , 1999 .

[11]  Markus Böhm,et al.  100.000 pixel 120 dB imager in TFA-technology , 1999 .

[12]  Gregory J. Ward,et al.  The RADIANCE lighting simulation and rendering system , 1994, SIGGRAPH.

[13]  P. M. Acosta-Serafini,et al.  A 1/3'' VGA linear wide dynamic range CMOS image sensor implementing a predictive multiple sampling algorithm with overlapping integration intervals , 2003, IEEE Journal of Solid-State Circuits.

[14]  Xinqiao Liu,et al.  A 10000 frames/s CMOS digital pixel sensor , 2001, IEEE J. Solid State Circuits.

[15]  A. Khan,et al.  Locally adaptive active pixel sensors , 1997, Proceedings of 1997 IEEE International Symposium on Circuits and Systems. Circuits and Systems in the Information Age ISCAS '97.

[16]  S. Stern,et al.  A 70 ns high density 64K CMOS dynamic RAM , 1983, IEEE Journal of Solid-State Circuits.

[17]  Keiichi Yamada,et al.  Robust license-plate recognition method for passing vehicles under outside environment , 2000, IEEE Trans. Veh. Technol..

[18]  Frank Lindner,et al.  Autonomous Driving approaches Downtown , 1999 .

[19]  Dariu Gavrila,et al.  The Issues , 2011 .

[20]  Youngjoong Joo,et al.  Wide dynamic range CMOS image sensor with pixel level ADC , 2003 .

[21]  S. Decker,et al.  A 256/spl times/256 CMOS imaging array with wide dynamic range pixels and column-parallel digital output , 1998, 1998 IEEE International Solid-State Circuits Conference. Digest of Technical Papers, ISSCC. First Edition (Cat. No.98CH36156).

[22]  Ran Ginosar,et al.  A random access photodiode array for intelligent image capture , 1991 .

[23]  A. El Gamal,et al.  A 640/spl times/512 CMOS image sensor with ultra wide dynamic range floating-point pixel-level ADC , 1999, 1999 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC. First Edition (Cat. No.99CH36278).

[24]  Richard Hornsey,et al.  CMOS image sensor camera with focal plane edge detection , 2001, Canadian Conference on Electrical and Computer Engineering 2001. Conference Proceedings (Cat. No.01TH8555).

[25]  M. Sawan,et al.  A new CMOS architecture for wide dynamic range image sensing , 2003, CCECE 2003 - Canadian Conference on Electrical and Computer Engineering. Toward a Caring and Humane Technology (Cat. No.03CH37436).

[26]  M. Wagner,et al.  100000-pixel, 120-dB imager in TFA technology , 1999, IEEE Journal of Solid-State Circuits.

[27]  O. Yadid-Pecht,et al.  Autoscaling CMOS APS with customized increase of dynamic range , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[28]  Bedrich J. Hosticka,et al.  Single-chip CMOS image sensors for a retina implant system , 1999 .

[29]  José Blasco,et al.  Assessment of citrus fruit quality using a real-time machine vision system , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[30]  Takayuki Hamamoto,et al.  Adaptive-integration-time image sensor with real-time reconstruction function , 2003 .

[31]  Orly Yadid-Pecht,et al.  Wide-dynamic-range sensors , 1999 .

[32]  L. McIlrath.  A low-power low-noise ultrawide-dynamic-range CMOS imager with pixel-parallel A/D conversion , 2001, IEEE J. Solid State Circuits.

[33]  Keiichi Yamada,et al.  Robust recognition methods for inclined license plates under various illumination conditions outdoors , 1999, Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems (Cat. No.99TH8383).

[34]  Kiyoharu Aizawa,et al.  A computational image sensor with pixel-based integration time control , 2000, Proceedings 2000 International Conference on Image Processing (Cat. No.00CH37101).

[35]  Abbas El Gamal,et al.  High dynamic range image sensors , 2002 .

[36]  Edward H. Adelson,et al.  Statistics of real-world illumination , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[37]  Kwabena Boahen,et al.  A retinomorphic vision system , 1996, IEEE Micro.

[38]  Peter Seitz,et al.  Image sensing with programmable offset pixels for increased dynamic range of more than 150 dB , 1996, Electronic Imaging.

[39]  Amine Bermak,et al.  A wide dynamic range CMOS imager with extended shunting inhibition image processing capabilities , 2001, ISCAS 2001. The 2001 IEEE International Symposium on Circuits and Systems (Cat. No.01CH37196).

[40]  Kyoung-Rok Cho,et al.  High dynamic range CMOS image sensor with conditional reset , 2002, Proceedings of the IEEE 2002 Custom Integrated Circuits Conference (Cat. No.02CH37285).

[41]  B. Fowler,et al.  A CMOS area image sensor with pixel-level A/D conversion , 1994, Proceedings of IEEE International Solid-State Circuits Conference - ISSCC '94.

[42]  J. Schemmel,et al.  A self-calibrating single-chip CMOS camera with logarithmic response , 2001, IEEE J. Solid State Circuits.

[43]  Ming-Jer Kao,et al.  A new design for a 1280/spl times/1024 digital CMOS image sensor with enhanced sensitivity, dynamic range and FPN , 1999, 1999 International Symposium on VLSI Technology, Systems, and Applications. Proceedings of Technical Papers. (Cat. No.99TH8453).

[44]  T. Chan,et al.  A 488×430 interline transfer CCD imager with integrated exposure and blooming control , 1984, 1984 IEEE International Solid-State Circuits Conference. Digest of Technical Papers.

[45]  Fritz J. Kub,et al.  Compressing photodetectors for long optical pulses using a lateral blooming drain structure , 1993 .

[46]  B.J. Hosticka,et al.  A 1K×1K high dynamic range CMOS image sensor with on-chip programmable region of interest readout , 2002, Proceedings of the 27th European Solid-State Circuits Conference.

[47]  Charles G. Sodini,et al.  Microelectronics: An Integrated Approach , 1996 .

[48]  A. Theuwissen,et al.  Solid-State Imaging with Charge-Coupled Devices , 1995 .

[49]  B. L. Cochrun,et al.  Linear Infrared Charge-Coupled Device (IRCCD) Focal Plane With Programmable Stare Time , 1984, Optics & Photonics.

[50]  Woodward Yang,et al.  A wide-dynamic-range, low-power photosensor array , 1994, Proceedings of IEEE International Solid-State Circuits Conference - ISSCC '94.

[51]  H. Ohkubo,et al.  A signal-processing CMOS image sensor using a simple analog operation , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[52]  J. M. Raynor,et al.  A linear array of photodetectors with wide dynamic range and near photon quantum-noise limit , 1997 .

[53]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[54]  Glenn H. Chapman,et al.  CMOS photodetector with built-in light adaptation mechanism , 1993 .

[55]  Andreas G. Andreou,et al.  A 590,000 transistor 48,000 pixel, contrast sensitive, edge enhancing, CMOS imager-silicon retina , 1995, Proceedings Sixteenth Conference on Advanced Research in VLSI.

[56]  Eric R. Fossum,et al.  128 x 128 CMOS photodiode-type active pixel sensor with on-chip timing, control, and signal chain electronics , 1995, Electronic Imaging.

[57]  Liyuan Li,et al.  Fusion of two different motion cues for intelligent video surveillance , 2001, Proceedings of IEEE Region 10 International Conference on Electrical and Electronic Technology. TENCON 2001 (Cat. No.01CH37239).

[58]  Kwabena Boahen.  Retinomorphic vision systems , 1996, Proceedings of Fifth International Conference on Microelectronics for Neural Networks.

[60]  Orly Yadid-Pecht,et al.  In-pixel autoexposure CMOS APS , 2003 .

[61]  Gregory K. Wallace,et al.  The JPEG still picture compression standard , 1991, CACM.

[62]  Ichiro Masaki,et al.  ASIC Approaches for Vision-Based Vehicle Guidance , 1993 .

[63]  Keith Michael Findlater.  CMOS camera employing a double junction active pixel , 2001 .

[64]  Robert G. Meyer,et al.  Analysis and Design of Analog Integrated Circuits , 1993 .

[65]  Ichiro Masaki,et al.  Machine-Vision Systems for Intelligent Transportation Systems , 1998, IEEE Intell. Syst..

[66]  Charles G. Sodini,et al.  An integrated computing structure for pixel-parallel image processing , 1997 .

[67]  Bedabrata Pain,et al.  Analysis and Enhancement of Low-Light-Level Performance of Photodiode-Type CMOS Active Pixel Images Operated with Sub-Threshold Reset , 1999 .

[68]  Bruce A. Wooley,et al.  A 128×128-pixel standard-CMOS image sensor with electronic shutter , 1996 .

[69]  S.G. Chamberlain,et al.  A novel wide dynamic range silicon photodetector and linear imaging array , 1984, IEEE Journal of Solid-State Circuits.