A 100×100 pixel silicon retina for gradient extraction with steering filter capabilities and temporal output coding

A 100/spl times/100 pixel analog very large scale integration retina is proposed to extract the magnitude and direction of spatial gradients contained in sensed images. The retina implements in a massively parallel fashion, at pixel level, an algorithm based on the concept of steerable filters to compute the gradients. An output rate of up to 1000 frames per second is achieved in a standard CMOS 0.5 /spl mu/m process. The retina provides address-event coded output on two asynchronous buses, one dedicated to the the gradient's direction and another to the gradient's magnitude. The gradient information is temporally ordered from the largest to the smallest gradient's magnitude. Rationales for such an order are borrowed from information theory. Precise timing of the address events is controlled by a decreasing threshold function, whose slope can be dynamically modified to regulate the data flow on the communication bus so as to reduce the number of collisions. Quantitative experimental results from a fully functional silicon demonstrator are presented.

[1]  Hae-Seung Lee,et al.  Analog VLSI systems for image acquisition and fast early vision processing , 1992, International Journal of Computer Vision.

[2]  Jin Luo,et al.  Analog hardware for detecting discontinuities in early vision , 1990, International Journal of Computer Vision.

[3]  Ralph Etienne-Cummings,et al.  A programmable focal-plane MIMD image processor chip , 2001, IEEE J. Solid State Circuits.

[4]  Pierre-Yves Burgi,et al.  A fast 100/spl times/100 pixel silicon retina for edge extraction with application in OCR , 2001, Proceedings of the Sixth International Symposium on Signal Processing and its Applications (Cat.No.01EX467).

[5]  Norberto M. Grzywacz,et al.  Occlusions and their relationship with the distribution of contrasts in natural images , 2000, Vision Research.

[6]  R. Etienne-Cummings,et al.  A foveated silicon retina for two-dimensional tracking , 2000 .

[7]  Bertram E. Shi,et al.  Focal Plane Implementation of 2D Steerable and Scalable Gabor-Type Filters , 1999, J. VLSI Signal Process..

[8]  M. Ishikawa,et al.  A CMOS vision chip with SIMD processing element array for 1 ms image processing , 1999, 1999 IEEE International Solid-State Circuits Conference. Digest of Technical Papers. ISSCC. First Edition (Cat. No.99CH36278).

[9]  Takeo Kanade,et al.  A VLSI sorting image sensor: global massively parallel intensity-to-time processing for low-latency adaptive vision , 1999, IEEE Trans. Robotics Autom..

[10]  Alireza Moini,et al.  Vision Chips , 1999 .

[11]  Luigi Raffo,et al.  Analog VLSI circuits as physical structures for perception in early visual tasks , 1998, IEEE Trans. Neural Networks.

[12]  Eric A. Vittoz Pseudo-Resistive Networks and their Applications to Analog Collective Computation , 1997, ICANN.

[13]  Toshiro Kubota,et al.  Computation of Orientational Filters for Real-time Computer Vision Problems III: Steerable System and VLSI Architecture , 1997, Real Time Imaging.

[14]  Andreas G. Andreou,et al.  Analog VLSI neuromorphic image acquisition and pre-processing systems , 1995, Neural Networks.

[15]  Eric A. Vittoz,et al.  A 12-transistor PFM demodulator for analog neural networks communication , 1995, IEEE Trans. Neural Networks.

[16]  Chung-Yu Wu,et al.  A new structure of the 2-D silicon retina , 1995 .

[17]  Eric A. Vittoz,et al.  A communication scheme for analog VLSI perceptive systems , 1995 .

[18]  R. Domínguez-Castro,et al.  High resolution CMOS current comparators: design and applications to current-mode function generation , 1995 .

[19]  David J. Field,et al.  What Is the Goal of Sensory Coding? , 1994, Neural Computation.

[20]  Eric A. Vittoz,et al.  Analog VLSI signal processing: Why, where, and how? , 1994, J. VLSI Signal Process..

[21]  Thierry Pun,et al.  Asynchrony in image analysis: using the luminance-to-response-latency relationship to improve segmentation , 1994 .

[22]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..