A CMOS image sensor with programmable pixel-level analog processing

A prototype of a 34 /spl times/ 34 pixel image sensor, implementing real-time analog image processing, is presented. Edge detection, motion detection, image amplification, and dynamic-range boosting are executed at pixel level by means of a highly interconnected pixel architecture based on the absolute value of the difference among neighbor pixels. The analog operations are performed over a kernel of 3 /spl times/ 3 pixels. The square pixel, consisting of 30 transistors, has a pitch of 35 /spl mu/m with a fill-factor of 20%. The chip was fabricated in a 0.35 /spl mu/m CMOS technology, and its power consumption is 6 mW with 3.3 V power supply. The device was fully characterized and achieves a dynamic range of 50 dB with a light power density of 150 nW/mm/sup 2/ and a frame rate of 30 frame/s. The measured fixed pattern noise corresponds to 1.1% of the saturation level. The sensor's dynamic range can be extended up to 96 dB using the double-sampling technique.

[1]  A. Rodriguez-Vazquez,et al.  A 1000FPS@128/spl times/128 vision processor with 8-bit digitized I/O , 2003, ESSCIRC 2004 - 29th European Solid-State Circuits Conference (IEEE Cat. No.03EX705).

[2]  A. El Gamal,et al.  A 640/spl times/512 CMOS image sensor with ultra wide dynamic range floating-point pixel-level ADC , 1999, 1999 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC. First Edition (Cat. No.99CH36278).

[3]  R. Gregorian,et al.  A programmable gain/loss circuit , 1987 .

[4]  S. Yoshimura,et al.  A 48 kframe/s CMOS image sensor for real-time 3-D sensing and motion detection , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[5]  Y. Lida,et al.  A 100 frame/s CMOS active pixel sensor for 3D-gesture recognition system , 1999, 1999 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC. First Edition (Cat. No.99CH36278).

[6]  H. Ohkubo,et al.  A signal-processing CMOS image sensor using a simple analog operation , 2001, 2001 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC (Cat. No.01CH37177).

[7]  Pierre-Yves Burgi,et al.  A 128 /spl times/ 128 pixel 120 dB dynamic range vision sensor chip for image contrast and orientation extraction , 2003, 2003 IEEE International Solid-State Circuits Conference, 2003. Digest of Technical Papers. ISSCC..

[8]  V. Gruev,et al.  A pipelined temporal difference imager , 2002, IEEE Journal of Solid-State Circuits.

[9]  Y. Ni,et al.  A 256/spl times/256 pixel smart CMOS image sensor for line-based stereo vision applications , 2000, IEEE Journal of Solid-State Circuits.

[10]  S. Espejo,et al.  A 1000 FPS at 128/spl times/128 vision processor with 8-bit digitized I/O , 2004, IEEE Journal of Solid-State Circuits.

[11]  P. Dudek,et al.  A general-purpose CMOS vision chip with a processor-per-pixel SIMD array , 2001, Proceedings of the 27th European Solid-State Circuits Conference.

[12]  Richard Hornsey,et al.  On-chip binary image processing with CMOS image sensors , 2002, IS&T/SPIE Electronic Imaging.

[13]  Markus Böhm,et al.  Design and fabrication of a high-dynamic-range image sensor in TFA technology , 1999 .

[14]  S. Kavadias,et al.  A logarithmic response CMOS image sensor with on-chip calibration , 2000, IEEE Journal of Solid-State Circuits.

[15]  L. Gonzo,et al.  Novel CMOS image sensor with a 132-dB dynamic range , 2002, IEEE J. Solid State Circuits.

[16]  Barry Fowler,et al.  A 640×512 CMOS Image Sensor with Ultra Wide Dynamic Range Floating-Point Pixel-Level ADC , 1999 .

[17]  David Stoppa,et al.  with New Pixel Architecture , 2002 .

[18]  Massimo Barbaro,et al.  A 100/spl times/100 pixel silicon retina for gradient extraction with steering filter capabilities and temporal output coding , 2002 .

[19]  A. Dickinson,et al.  A 256/spl times/256 CMOS active pixel image sensor with motion detection , 1995, Proceedings ISSCC '95 - International Solid-State Circuits Conference.

[20]  Ángel Rodríguez-Vázquez,et al.  A processing element architecture for high-density focal plane analog programmable array processors , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[21]  Ralph Etienne-Cummings,et al.  A programmable focal-plane MIMD image processor chip , 2001, IEEE J. Solid State Circuits.

[22]  R. Schuffny,et al.  CMOS image sensor with mixed-signal processor array , 2003 .

[23]  X. Arreguit,et al.  A CMOS motion detector system for pointing devices , 1996, 1996 IEEE International Solid-State Circuits Conference. Digest of TEchnical Papers, ISSCC.

[24]  S. Decker,et al.  A 256/spl times/256 CMOS imaging array with wide dynamic range pixels and column-parallel digital output , 1998, 1998 IEEE International Solid-State Circuits Conference. Digest of Technical Papers, ISSCC. First Edition (Cat. No.98CH36156).

[25]  F. Heitger,et al.  A 100×100 pixel silicon retina for gradient extraction with steering filter capabilities and temporal output coding , 2002, IEEE J. Solid State Circuits.

[26]  Ralph Etienne-Cummings,et al.  Implementation of steerable spatiotemporal image filters on the focal plane , 2002 .

[27]  Orly Yadid-Pecht,et al.  Wide intrascene dynamic range CMOS APS using dual sampling , 1997 .

[28]  Sunetra K. Mendis,et al.  CMOS active pixel image sensor , 1994 .

[29]  Tetsuya Yagi,et al.  An analog VLSI chip emulating sustained and transient response channels of the vertebrate retina , 2003, IEEE Trans. Neural Networks.

[30]  Junwei Guan,et al.  A 256×256–pixel smart CMOS image sensor for line based stereo vision applications , 1999 .

[31]  S. Zöld,et al.  The computational infrastructure of analogic CNN computing. I. The CNN-UM chip prototyping system , 1999 .

[32]  J. Ohta,et al.  An artificial retina chip with current-mode focal plane image processing functions , 1997 .

[33]  Kiyoharu Aizawa,et al.  A computational image sensor with adaptive pixel-based integration time , 2001 .

[34]  István Petrás,et al.  A bio-inspired two-layer mixed-signal flexible programmable chip for early vision , 2003, IEEE Trans. Neural Networks.

[35]  Alan A. Stocker,et al.  Analog integrated 2-D optical flow sensor with programmable pixels , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[36]  Haruyoshi Toyoda,et al.  A 256×256 compact CMOS image sensor with on-chip motion detection function , 2003, IEEE J. Solid State Circuits.

[37]  S. G. Chamberlain,et al.  A novel wide dynamic range silicon photodetector and linear imaging array , 1984 .

[38]  Alan A. Stocker,et al.  Analog VLSI focal-plane array with dynamic connections for the estimation of piecewise-smooth optical flow , 2004, IEEE Transactions on Circuits and Systems I: Regular Papers.

[39]  F. Devos,et al.  Histogram-Equalization based Adaptive Image Sensor for real-time Vision , 1996, ESSCIRC '96: Proceedings of the 22nd European Solid-State Circuits Conference.