A 100/spl times/100 pixel silicon retina for gradient extraction with steering filter capabilities and temporal output coding

A 100/spl times/100 pixel analog very large scale integration retina is proposed to extract the magnitude and direction of spatial gradients contained in sensed images. The retina implements in a massively parallel fashion, at pixel level, an algorithm based on the concept of steerable filters to compute the gradients. An output rate of up to 1000 frames per second is achieved in a standard CMOS 0.5 /spl mu/m process. The retina provides address-event coded output on two asynchronous buses, one dedicated to the the gradient's direction and another to the gradient's magnitude. The gradient information is temporally ordered from the largest to the smallest gradient's magnitude. Rationales for such an order are borrowed from information theory. Precise timing of the address events is controlled by a decreasing threshold function, whose slope can be dynamically modified to regulate the data flow on the communication bus so as to reduce the number of collisions. Quantitative experimental results from a fully functional silicon demonstrator are presented.

[1]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Bertram E. Shi,et al.  Focal Plane Implementation of 2D Steerable and Scalable Gabor-Type Filters , 1999, J. VLSI Signal Process..

[3]  Eric A. Vittoz Pseudo-Resistive Networks and their Applications to Analog Collective Computation , 1997, ICANN.

[4]  Ralph Etienne-Cummings,et al.  A programmable focal-plane MIMD image processor chip , 2001, IEEE J. Solid State Circuits.

[5]  Jin Luo,et al.  Analog hardware for detecting discontinuities in early vision , 1990, International Journal of Computer Vision.

[6]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[7]  M. Ishikawa,et al.  A CMOS vision chip with SIMD processing element array for 1 ms image processing , 1999, 1999 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC. First Edition (Cat. No.99CH36278).

[8]  Eric A. Vittoz,et al.  Analog VLSI signal processing: Why, where, and how? , 1994, J. VLSI Signal Process..

[9]  R. Etienne-Cummings,et al.  A foveated silicon retina for two-dimensional tracking , 2000 .

[10]  Eric A. Vittoz,et al.  A 12-transistor PFM demodulator for analog neural networks communication , 1995, IEEE Trans. Neural Networks.

[11]  Takeo Kanade,et al.  A VLSI sorting image sensor: global massively parallel intensity-to-time processing for low-latency adaptive vision , 1999, IEEE Trans. Robotics Autom..

[12]  Eric A. Vittoz,et al.  A communication scheme for analog VLSI perceptive systems , 1995 .

[13]  Norberto M. Grzywacz,et al.  Occlusions and their relationship with the distribution of contrasts in natural images , 2000, Vision Research.

[14]  Thierry Pun,et al.  Asynchrony in image analysis: using the luminance-to-response-latency relationship to improve segmentation , 1994 .

[15]  Chung-Yu Wu,et al.  A new structure of the 2-D silicon retina , 1995 .

[16]  Pierre-Yves Burgi,et al.  A fast 100/spl times/100 pixel silicon retina for edge extraction with application in OCR , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[17]  Luigi Raffo,et al.  Analog VLSI circuits as physical structures for perception in early visual tasks , 1998, IEEE Trans. Neural Networks.

[18]  Toshiro Kubota,et al.  Computation of Orientational Filters for Real-time Computer Vision Problems III: Steerable System and VLSI Architecture , 1997, Real Time Imaging.

[19]  R. Domínguez-Castro,et al.  High resolution CMOS current comparators: design and applications to current-mode function generation , 1995 .

[20]  Alireza Moini,et al.  Vision Chips , 1999 .

[21]  Andreas G. Andreou,et al.  Analog VLSI neuromorphic image acquisition and pre-processing systems , 1995, Neural Networks.

[22]  Hae-Seung Lee,et al.  Analog VLSI systems for image acquisition and fast early vision processing , 1992, International Journal of Computer Vision.