Silicon retina with correlation-based, velocity-tuned pixels

A functional two-dimensional silicon retina that computes a complete set of local direction-selective outputs is reported. The chip motion computation uses unidirectional delay lines as tuned filters for moving edges. Photoreceptors detect local changes in image intensity, and the outputs from these photoreceptors are coupled into the delay line, where they propagate with a particular speed in one direction. If the velocity of the moving edges matches that of the delay line, then the signal on the delay line is reinforced. The output of each pixel is the power in the delay line signal, computed within each pixel. This power computation provides the essential nonlinearity for velocity selectivity. The delay line architecture differs from the usual pairwise correlation models in that motion information is aggregated over an extended spatiotemporal range. As a result, the detectors are sensitive to motion over a wide range of spatial frequencies. The design of functional one- and two-dimensional silicon retinas with direction-selective, velocity-tuned pixels is described. It is shown that pixels with three hexagonal directions of motion selectivity are approximately (225 mum)(2) in area in a 2-mum CMOS technology and consume less than 5 muW of power.

[1]  H. Barlow,et al.  The mechanism of directionally selective units in rabbit's retina. , 1965, The Journal of physiology.

[2]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[3]  T. Delbruck 'Bump' circuits for computing similarity and dissimilarity of analog voltages , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[4]  John Tanner,et al.  Integrated optical motion detection , 1986 .

[5]  John Lazzaro,et al.  A Delay-Line Based Motion Detection Chip , 1990, NIPS.

[6]  P.A. Ruetz,et al.  Video compression makes big gains , 1991, IEEE Spectrum.

[7]  S. Lehky,et al.  Neural model of stereoacuity and depth interpolation based on a distributed representation of stereo disparity [published erratum appears in J Neurosci 1991 Mar;11(3):following Table of Contents] , 1990, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[8]  Misha Anne Mahowald,et al.  VLSI analogs of neuronal visual processing: a synthesis of form and function , 1992 .

[9]  Robert R. de Ruyter van Steveninck,et al.  Adaptive strategies in fly vision: On their image-processing qualities , 1983, IEEE Transactions on Systems, Man, and Cybernetics.

[10]  Tobi Delbrück,et al.  An Electronic Photoreceptor Sensitive to Small Changes in Intensity , 1988, NIPS.

[11]  Danny Cohen,et al.  MOSIS - The ARPA Silicon Broker , 1981 .

[12]  C.A.T. Salama,et al.  Image-motion detection using analog VLSI , 1992 .

[13]  Tobi Delbrück,et al.  Direction Selective Silicon Retina that Uses Null Inhibition , 1991, NIPS.

[14]  A. Yuille,et al.  A model for the estimate of local image velocity by cells in the visual cortex , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[15]  Misha A. Mahowald,et al.  Silicon retina with adaptive photoreceptors , 1991, Defense, Security, and Sensing.

[16]  K. Nakayama,et al.  Temporal and spatial characteristics of the upper displacement limit for motion in random dots , 1984, Vision Research.

[17]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[18]  Carver A. Mead,et al.  An Integrated Analog Optical Motion Sensor , 1986 .

[19]  J. H. Van Hateren,et al.  Directional tuning curves, elementary movement detectors, and the estimation of the direction of visual movement , 1990, Vision Research.

[20]  Carver A. Mead,et al.  Scanners for visualizing activity of analog VLSI circuitry , 1991 .

[21]  T. Maddess,et al.  Afterimage-like effects in the motion-sensitive neuron H1 , 1986, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[22]  C L Baker,et al.  Spatial- and temporal-frequency selectivity as a basis for velocity preference in cat striate cortex neurons , 1990, Visual Neuroscience.

[23]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[24]  N. Franceschini,et al.  Real time visuomotor control: from flies to robots , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[25]  Paul A. Viola,et al.  Recurrent Eye Tracking Network Using a Distributed Representation of Image Motion , 1991, NIPS.

[26]  Tobias Delbrück,et al.  Investigations of analog VLSI visual transduction and motion processing , 1993 .

[27]  Carver A. Mead,et al.  Time-derivative adaptive silicon photoreceptor array , 1991, Optics & Photonics.

[28]  Nicolas Franceschini,et al.  Visual Guidance Of A Mobile Robot Equipped With A Network Of Self-Motion Sensors , 1990, Other Conferences.