A Spatial-Temporal Multiresolution CMOS Image Sensor With Adaptive Frame Rates for Tracking the Moving Objects in Region-of-Interest and Suppressing Motion Blur

In this paper, we report a CMOS image sensor for spatial-temporal multiresolution images. This image sensor simultaneously generates two outputs: one for normal images (<30 fps) of stationery background and the other for adaptable frame-rate images (over 960 fps) of moving objects. The moving objects are tracked with a reduced spatial resolution in the region-of-interest (ROI). The entire image is reconstructed from the two images with the details in stationery objects and the suppressed motion blur in moving objects. High frame rate only applies to the ROI; therefore, the proposed scheme can significantly reduce power consumption by adjusting the optimal use of bandwidth. In order to provide real-time decision of ROI, the sensor employs on-chip motion-detection circuits based on the inter-pixel switch operation by storing the previous frame signal in a floating diffusion node. This allows a small pixel implementation without adding any extra in-pixel memory components. A prototype chip has been implemented using a 0.35 mum 1P4M standard CMOS process and multiresolution images have been successfully captured. The fabricated chip operates at 3.3 V and consumes 75 mW in the multiresolution readout of a 256times256 normal image at 30 fps and a 64times64 ROI image at 240 fps.

[1]  M. Mori,et al.  1/4-inch 2-mpixel MOS image sensor with 1.75 transistors/pixel , 2004, IEEE Journal of Solid-State Circuits.

[2]  B. Pain,et al.  A CMOS imager with on-chip variable resolution for light-adaptive imaging , 1998, 1998 IEEE International Solid-State Circuits Conference. Digest of Technical Papers, ISSCC. First Edition (Cat. No.98CH36156).

[3]  S. Lauxtermann,et al.  A high speed CMOS imager acquiring 5000 frames/sec , 1999, International Electron Devices Meeting 1999. Technical Digest (Cat. No.99CH36318).

[4]  Hirofumi Yamashita,et al.  Low-leakage-current and low-operating-voltage buried photodiode for a CMOS imager , 2003 .

[5]  Sergio Pernici,et al.  Low-voltage double-sampled ΣΔ converters , 1997 .

[6]  Eric R. Fossum,et al.  A high-speed, 240-frames/s, 4.1-Mpixel CMOS sensor , 2003 .

[7]  T. Kurashina,et al.  A high-speed, profile data acquiring image sensor , 2005, ISSCC. 2005 IEEE International Digest of Technical Papers. Solid-State Circuits Conference, 2005..

[8]  Xinqiao Liu,et al.  A 10000 frames/s CMOS digital pixel sensor , 2001, IEEE J. Solid State Circuits.

[9]  Euisik Yoon,et al.  A CMOS image sensor with reset level control using dynamic reset current source for noise suppression , 2004, 2004 IEEE International Solid-State Circuits Conference (IEEE Cat. No.04CH37519).

[10]  B.J. Hosticka,et al.  A 1K×1K high dynamic range CMOS image sensor with on-chip programmable region of interest readout , 2002, Proceedings of the 27th European Solid-State Circuits Conference.

[11]  G. Nicollini,et al.  Low-voltage double-sampled /spl Sigma//spl Delta/ converters , 1997, 1997 IEEE International Solids-State Circuits Conference. Digest of Technical Papers.

[12]  R. Etienne-Cummings,et al.  Temporal change threshold detection imager , 2005, ISSCC. 2005 IEEE International Digest of Technical Papers. Solid-State Circuits Conference, 2005..

[13]  Liang-Gee Chen,et al.  A single chip CMOS APS camera with direct frame difference output , 1999, Proceedings of the IEEE 1999 Custom Integrated Circuits Conference (Cat. No.99CH36327).

[14]  Euisik Yoon,et al.  A High Dynamic Range CMOS Image Sensor with In-Pixel Floating-Node Analog Memory for Pixel Level Integration Time Control , 2006, 2006 Symposium on VLSI Circuits, 2006. Digest of Technical Papers..

[15]  Orly Yadid-Pecht,et al.  Morton (Z) scan based real-time variable resolution CMOS image sensor , 2004, Proceedings of the 2004 11th IEEE International Conference on Electronics, Circuits and Systems, 2004. ICECS 2004..

[16]  Alexander I. Krymski,et al.  A 9-V/Lux-s 5000-frames/s 512/spl times/512 CMOS sensor , 2003 .

[17]  Young Chan Kim,et al.  1/2-inch 7.2MPixel CMOS Image Sensor with 2.25/spl mu/m Pixels Using 4-Shared Pixel Structure for Pixel-Level Summation , 2006, 2006 IEEE International Solid State Circuits Conference - Digest of Technical Papers.

[18]  Alice Biber,et al.  Megapixel CMOS imager with charge binning , 2001, IS&T/SPIE Electronic Imaging.

[19]  Alexander I. Krymski,et al.  A 9V / Lux-s 5000-Frames / s 512 512 CMOS Sensor , 2001 .

[20]  이광현,et al.  (A) CMOS active pixel sensor with controlled reset and spatial-temporal mulit-resolution readout = 리셋전압 제어를 이용한 CMOS영상센서 및 가변해상도 영상획득으로의 응용 , 2004 .

[21]  Larry H. Matthies,et al.  Multiresolution image sensor , 1997, IEEE Trans. Circuits Syst. Video Technol..