From electronic photography to seeing chips-the future of image sensing

Thanks to the advances of semiconductor technology, solid state image sensors with impressive properties can be realized today: CCDs with 26 million pixels are commercially available. Pixel size has been reduced to 5/spl times/5 /spl mu/m/sup 2/ and less. This enables one to integrate electronic circuitry with each pixel, providing added functionality for custom photo-ASICs and smart image sensors: single-chip cameras with on-chip analog-to-digital converters for less than $20 are advertised; image sensors have been developed including novel functionality such as real-time selectable pixel size and shape, the capability of performing arbitrary convolutions simultaneously with the exposure, as well as variable, programmable sensitivity of the pixels leading to image sensors with a dynamic range exceeding 100 dB. It is concluded that the possibilities offered with custom smart image sensors will influence the design and the performance of future imaging systems in many disciplines, reaching from optical metrology to machine vision on the factory floor and in robotics applications.

[1]  F. M. Klaassen,et al.  Thermal noise of MOS transistors , 1967 .

[2]  D. R. Lamb,et al.  Charge-coupled devices and their applications , 1980 .

[3]  Peter Seitz,et al.  Lock-in CCD and the convolver CCD: applications of exposure-concurrent photocharge transfer in optical metrology and machine vision , 1995, Electronic Imaging.

[4]  Christof Koch.  Implementing early vision algorithms in analog hardware: an overview , 1991, Defense, Security, and Sensing.

[5]  Peter Seitz,et al.  Smart optical and image sensors fabricated with industrial CMOS/CCD semiconductor processes , 1993, Electronic Imaging.

[6]  An array-type PSD (position-sensitive detector) for light pattern measurement , 1990 .

[7]  P. Seitz,et al.  Planar distance and velocity sensor , 1994 .

[8]  Eric R. Fossum,et al.  128 x 128 CMOS photodiode-type active pixel sensor with on-chip timing, control, and signal chain electronics , 1995, Electronic Imaging.

[9]  E. Dereniak,et al.  Optical radiation detectors , 1984 .

[10]  Christof Koch,et al.  Seeing Chips: Analog VLSI Circuits for Computer Vision , 1989, Neural Computation.

[11]  Peter Seitz,et al.  Active machine vision system for surface quality inspection , 1994, Electronic Imaging.

[12]  M. F. Tompsett,et al.  Charge-coupled imaging devices: Experimental results , 1971 .

[13]  Peter Seitz,et al.  The lock-in CCD-two-dimensional synchronous detection of light , 1995 .

[14]  Peter Seitz,et al.  Smart sensing using custom photo-application-specific integrated circuits and charge-coupled device technology , 1995 .

[15]  David Renshaw,et al.  Intelligent CMOS imaging , 1995, Electronic Imaging.

[16]  Eugene Hecht,et al.  Optics, 2nd Edition , 1987 .

[17]  Jin Luo,et al.  Single-chip imager and feature extractor , 1991, Defense, Security, and Sensing.

[18]  Eric R. Fossum,et al.  Active pixel sensors: are CCDs dinosaurs? , 1993, Electronic Imaging.

[19]  Gary W. Hughes,et al.  High fill-factor CCD imager with high frame-rate readout , 1990, Defense, Security, and Sensing.

[20]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[21]  James J. Little,et al.  Interaction of algorithm and implementation for analog VLSI stereo vision , 1991, Defense, Security, and Sensing.

[22]  Sarit Chen,et al.  Adaptive sensitivity CCD image sensor , 1995 .

[23]  Takeo Kanade,et al.  Integrated sensor and range-finding analog signal processor , 1991 .

[24]  M. Y. Lu,et al.  ASIC vision , 1990, IEEE Proceedings of the Custom Integrated Circuits Conference.

[25]  Hirofumi Yamashita,et al.  A highly sensitive on-chip charge detector for CCD area image sensor , 1991 .

[26]  James E. Gunn,et al.  New advancements in charge-coupled device technology: subelectron noise and 4096 x 4096 pixel CCDs , 1990, Other Conferences.

[27]  C. Mead,et al.  The silicon retina. , 1991 .

[28]  Helmut Stiebig,et al.  A Novel α-Si(C):H Color Sensor Array , 1994 .

[29]  M. L. Meade.  Lock-in amplifiers : principles and applications , 1983 .

[30]  Henry Baltes,et al.  Photo-ASICs: integrated optical metrology systems with industrial CMOS technology , 1993 .

[31]  Joseph A. Izatt,et al.  MICRON~RESOLUTION BIOMEDICAL IMAGING WITH OPTICAL COHERENCE TOMOGRAPHY , 1993 .

[32]  M. F. Tompsett,et al.  Charge Transfer Devices , 1972 .

[33]  Eric R. Fossum,et al.  Architectures For Focal Plane Image Processing , 1989 .

[34]  Eric R. Fossum,et al.  Infrared readout electronics for space-science sensors: state of the art and future directions , 1993, Optics & Photonics.

[35]  D. Hubel.  Eye, brain, and vision , 1988 .

[36]  Bryan D. Ackland,et al.  TP 13.5: A 256x256 CMOS Active Pixel image Sensor with Motion Detection , 1995 .

[37]  J. Politch,et al.  High-accuracy distance measurements with multiple-wavelength interferometry , 1995 .

[38]  Bedabrata Pain,et al.  Low-power low-noise analog circuits for on-focal-plane signal processing of infrared sensors , 1993, Defense, Security, and Sensing.

[39]  P. Aubert,et al.  Monolithic optical position encoder with on-chip photodiodes , 1988 .

[40]  M. Yamamoto,et al.  Cameras and display systems , 1995 .

[41]  Sarit Chen,et al.  Adaptive sensitivity CCD image sensor , 1994, Proceedings of the 12th IAPR International Conference on Pattern Recognition, Vol. 2 - Conference B: Computer Vision & Image Processing. (Cat. No.94CH3440-5).

[42]  P Seitz,et al.  Inexpensive range camera operating at video speed. , 1993, Applied optics.