Analog VLSI architectures for motion processing: from fundamental limits to system applications

This paper discusses some of the fundamental issues in the design of highly parallel, dense, low-power motion sensors in analog VLSI. Since photoreceptor circuits are an integral part of all visual motion sensors, we discuss how the sizing of photosensitive areas can affect the performance of such systems. We review the classic gradient and correlation algorithms and give a survey of analog motion-sensing architectures inspired by them. We calculate how the measurable speed range scales with signal-to-noise ratio (SNR) for a classic Reichardt sensor with a fixed time constant. We show how this speed range may be improved using a nonlinear filter with an adaptive time constant, constructed out of a diode and a capacitor, and present data from a velocity sensor based on such a filter. Finally, we describe how arrays of such velocity sensors call be employed to compute the heading direction of a moving subject and to estimate the time-to-contact between the sensor and a moving object.

[1]  J. van Santen,et al.  Temporal covariance model of human motion perception. , 1984, Journal of the Optical Society of America. A, Optics and image science.

[2]  Eric R. Fossum,et al.  Architectures For Focal Plane Image Processing , 1989 .

[3]  Rahul Sarpeshkar,et al.  Visual Motion Computation in Analog VLSI Using Pulses , 1992, NIPS.

[4]  Giacomo Indiveri,et al.  System implementations of analog VLSI velocity sensors , 1996, Proceedings of Fifth International Conference on Microelectronics for Neural Networks.

[5]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[6]  Tobi Delbrück,et al.  Silicon retina with correlation-based, velocity-tuned pixels , 1993, IEEE Trans. Neural Networks.

[7]  Shimon Ullman,et al.  Analysis of Visual Motion by Biological and Computer Systems , 1981, Computer.

[8]  A. Verri,et al.  Differential techniques for optical flow , 1990 .

[9]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[10]  Tomaso Poggio,et al.  Computational vision and regularization theory , 1985, Nature.

[11]  T. Delbruck.  Silicon retina with correlation-based, velocity-tuned pixels , 1993 .

[12]  H. Barlow,et al.  The mechanism of directionally selective units in rabbit's retina. , 1965, The Journal of physiology.

[13]  Stephen P. DeWeerth,et al.  Analog VLSI circuits for manufacturing inspection , 1995, Proceedings Sixteenth Conference on Advanced Research in VLSI.

[14]  Andreas G. Andreou,et al.  A Contrast Sensitive Silicon Retina with Reciprocal Synapses , 1991, NIPS.

[15]  Jj Org Kramer.  Compact Integrated Motion Sensor with Three-pixel Interaction , 1996 .

[16]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[17]  R. Etienne-Cummings,et al.  A new temporal domain optical flow measurement technique for focal plane VLSI implementation , 1993, 1993 Computer Architectures for Machine Perception.

[18]  Jin Luo,et al.  Figure-ground segregation using an analog VLSI chip , 1992, IEEE Micro.

[19]  A. Verri,et al.  Computational aspects of motion perception in natural and artificial vision systems. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[20]  Christof Koch,et al.  Analog VLSI motion discontinuity detectors for image segmentation , 1996, 1996 IEEE International Symposium on Circuits and Systems. Circuits and Systems Connecting the World. ISCAS 96.

[21]  Giacomo Indiveri,et al.  Parallel analog VLSI architectures for computation of heading direction and time-to-contact , 1995, NIPS.

[22]  Christof Koch,et al.  Vision Chips: Implementing Vision Algorithms with Analog VLSI Circuits , 1994 .

[23]  John Lazzaro,et al.  A Delay-Line Based Motion Detection Chip , 1990, NIPS.

[24]  S. Ullman,et al.  The interpretation of visual motion , 1977 .

[25]  Tomaso A. Poggio,et al.  Motion Field and Optical Flow: Qualitative Properties , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[27]  T. Delbruck.  'Bump' circuits for computing similarity and dissimilarity of analog voltages , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[28]  A J Ahumada,et al.  Model of human visual-motion sensing. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[29]  Andreas G. Andreou,et al.  Silicon retina for motion computation , 1991, 1991., IEEE International Sympoisum on Circuits and Systems.

[30]  Christof Koch,et al.  An Analog VLSI Chip for Finding Edges from Zero-crossings , 1990, NIPS.

[31]  Jörg Kramer.  Compact Integrated Motion Sensor With Three-Pixel Interaction , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  C. Mead,et al.  White noise in MOS transistors and resistors , 1993, IEEE Circuits and Devices Magazine.

[33]  Giulio Sandini,et al.  On the Advantages of Polar and Log-Polar Mapping for Direct Estimation of Time-To-Impact from Optical Flow , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[34]  Tobi Delbrück,et al.  Direction Selective Silicon Retina that Uses Null Inhibition , 1991, NIPS.

[35]  C. Koch,et al.  The analysis of visual motion: from computational theory to neuronal mechanisms. , 1986, Annual review of neuroscience.

[36]  Carver A. Mead,et al.  Analog VLSI Phototransduction by continuous-time, adaptive, logarithmic photoreceptor circuits , 1995 .

[37]  Tomaso Poggio,et al.  Optical flow: computational properties and networks, biological and analog , 1989 .

[38]  G. G. Stokes.  "J." , 1890, The New Yale Book of Quotations.

[39]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[40]  Carver A. Mead,et al.  An Integrated Analog Optical Motion Sensor , 1986 .

[41]  Rahul Sarpeshkar,et al.  Pulse-Based Analog VLSI Velocity Sensors , 1997 .

[42]  A. Verri,et al.  Green Theorems and Qualitative Properties of the Optical Flow , 1991 .

[43]  Rahul Sarpeshkar,et al.  An analog VLSI velocity sensor , 1995, Proceedings of ISCAS'95 - International Symposium on Circuits and Systems.

[44]  Jin Luo,et al.  Computing motion using analog and binary resistive networks , 1988, Computer.

[45]  Y. J. Tejwani,et al.  Robot vision , 1989, IEEE International Symposium on Circuits and Systems,.