Focal-Plane Spatially Oversampling CMOS Image Compression Sensor

Image compression algorithms employ computationally expensive spatial convolutional transforms. The CMOS image sensor performs spatially compressing image quantization on the focal plane yielding digital output at a rate proportional to the mere information rate of the video. A bank of column-parallel first-order incremental DeltaSigma-modulated analog-to-digital converters (ADCs) performs column-wise distributed focal-plane oversampling of up to eight adjacent pixels and concurrent weighted average quantization. Number of samples per pixel and switched-capacitor sampling sequence order set the amplitude and sign of the pixel coefficient, respectively. A simple digital delay and adder loop performs spatial accumulation over up to eight adjacent ADC outputs during readout. This amounts to computing a two-dimensional block matrix transform with up to 8times8-pixel programmable kernel in parallel for all columns. Noise shaping reduces power dissipation below that of a conventional digital imager while the need for a peripheral DSP is eliminated. A 128times128 active pixel array integrated with a bank of 128 DeltaSigma-modulated ADCs was fabricated in a 0.35-mum CMOS technology. The 3.1 mm times 1.9-mm prototype captures 8-bit digital video at 30 frames/s and yields 4 GMACS projected computational throughput when scaled to HDTV 1080i resolution in discrete cosine transform (DCT) compression

[1]  R. Etienne-Cummings,et al.  Temporal change threshold detection imager , 2005, ISSCC. 2005 IEEE International Digest of Technical Papers. Solid-State Circuits Conference, 2005..

[2]  Kiyoharu Aizawa,et al.  On sensor image compression , 1997, IEEE Trans. Circuits Syst. Video Technol..

[3]  Gabor C. Temes,et al.  A 16-bit low-voltage CMOS A/D converter , 1987 .

[4]  Gert Cauwenberghs,et al.  Delta-sigma algorithmic analog-to-digital conversion , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[5]  E. Dijkstra,et al.  On configurable oversampled A/D converters , 1993 .

[6]  Orly Yadid-Pecht,et al.  Adaptive multiple resolution CMOS active pixel sensor , 2004, 2004 IEEE International Symposium on Circuits and Systems (IEEE Cat. No.04CH37512).

[7]  Akira Matsuzawa,et al.  A CMOS image sensor with analog two-dimensional DCT-based compression circuits for one-chip cameras , 1997, IEEE J. Solid State Circuits.

[8]  Larry H. Matthies,et al.  Multiresolution image sensor , 1997, IEEE Trans. Circuits Syst. Video Technol..

[9]  Eric R. Fossum,et al.  CMOS image sensors: electronic camera-on-a-chip , 1997 .

[10]  Liang-Gee Chen,et al.  A programmable VLSI architecture for 2-D discrete wavelet transform , 2000, 2000 IEEE International Symposium on Circuits and Systems. Emerging Technologies for the 21st Century. Proceedings (IEEE Cat No.00CH36353).

[11]  S. Okada,et al.  Image processor capable of block-noise-free JPEG2000 compression with 30 frames/s for digital camera applications , 2003, 2003 IEEE International Solid-State Circuits Conference, 2003. Digest of Technical Papers. ISSCC..

[12]  Eric R. Fossum,et al.  CMOS image sensors: electronic camera on a chip , 1995, Proceedings of International Electron Devices Meeting.

[13]  R. Genov,et al.  CMOS wavelet compression imager architecture , 2005, 2005 IEEE 7th CAS Symposium on Emerging Technologies: Circuits and Systems for 4G Mobile Wireless Communications.

[14]  Abhishek Bandyopadhyay,et al.  A 80 /spl mu/W/frame 104/spl times/128 CMOS imager front end for JPEG compression , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[15]  R. Schuffny,et al.  CMOS image sensor with mixed-signal processor array , 2003 .

[16]  Ralph Etienne-Cummings,et al.  Implementation of steerable spatiotemporal image filters on the focal plane , 2002 .

[17]  Roman Genov,et al.  Algorithmic Delta-Sigma-modulated FIR filter. , 2006 .

[18]  I. Defilippis,et al.  Discrete cosine transform chip for real-time video applications , 1990, IEEE International Symposium on Circuits and Systems.

[19]  Ian Galton,et al.  Delta-Sigma modulator based A/D conversion without oversampling , 1995 .

[20]  Kiyoharu Aizawa,et al.  Image sensor for compression and enhancement , 1995, VLSI Signal Processing, VIII.

[21]  R. Genov,et al.  Mixed-signal CMOS wavelet compression imager architecture , 2005, 48th Midwest Symposium on Circuits and Systems, 2005..

[22]  Michael W. Hoffman,et al.  A CMOS imager with pixel prediction for image compression , 2003, Proceedings of the 2003 International Symposium on Circuits and Systems, 2003. ISCAS '03..

[23]  Graham A. Jullien,et al.  A wide dynamic range CMOS active pixel sensor with frame difference , 2005, 2005 IEEE International Symposium on Circuits and Systems.

[24]  Guido Torelli,et al.  A single-chip optical sensor with analog memory for motion detection , 1995, IEEE J. Solid State Circuits.

[25]  J.G. Harris,et al.  A novel integration of on-sensor wavelet compression for a CMOS imager , 2002, 2002 IEEE International Symposium on Circuits and Systems. Proceedings (Cat. No.02CH37353).

[26]  Zhimin Zhou,et al.  Frame-transfer CMOS active pixel sensor with pixel binning , 1997 .

[27]  Orly Yadid-Pecht,et al.  Morton (Z) scan based real-time variable resolution CMOS image sensor , 2004, Proceedings of the 2004 11th IEEE International Conference on Electronics, Circuits and Systems, 2004. ICECS 2004..