Pulse-based 2-D motion sensors

We present two compact CMOS integrated circuits for computing the two-dimensional (2-D) local direction of motion of an image focused directly onto the chip. These circuits incorporate onboard photoreceptors and focal plane motion processing. With fully functional 14/spl times/13 and 12/spl times/13 implementations consuming less than 50 /spl mu/W per pixel, we conclude that practical pixel resolutions of at least 64/spl times/64 are easily achievable. Measurements characterizing the elementary one-dimensional motion detectors are presented along with a discussion of 2-D performance and example 2-D motion vector fields. As an example application of the sensor, it is shown that the array as fabricated can directly compute the focus of expansion of a 2-D motion vector field.

[1]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[2]  Carver A. Mead,et al.  An Integrated Analog Optical Motion Sensor , 1986 .

[3]  A. Verri,et al.  Computational aspects of motion perception in natural and artificial vision systems. , 1992, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[4]  Tobi Delbrück,et al.  Silicon retina with correlation-based, velocity-tuned pixels , 1993, IEEE Trans. Neural Networks.

[5]  Y. Aloimonos,et al.  Direct Perception of Three-Dimensional Motion from Patterns of Visual Motion , 1995, Science.

[6]  Carver A. Mead,et al.  Analog VLSI Phototransduction by continuous-time, adaptive, logarithmic photoreceptor circuits , 1995 .

[7]  Thierry M. Bernard,et al.  Advanced Focal Plane Arrays and Electronic Cameras , 1996 .

[8]  Jörg Kramer.  Compact Integrated Motion Sensor With Three-Pixel Interaction , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[9]  Giacomo Indiveri,et al.  Analog VLSI architectures for motion processing: from fundamental limits to system applications , 1996, Proc. IEEE.

[10]  Rahul Sarpeshkar,et al.  Pulse-Based Analog VLSI Velocity Sensors , 1997 .

[11]  J. Van der Spiegel,et al.  A Foveated Visual Tracking Chip , 1997, 1997 IEEE International Solids-State Circuits Conference. Digest of Technical Papers.

[12]  Christof Koch,et al.  Real-Time Analog VLSI Sensors for 2-D Direction of Motion , 1997, ICANN.

[13]  Jan Van der Spiegel,et al.  A focal plane visual motion measurement sensor , 1997 .

[14]  Christof Koch,et al.  An Integrated Vision Sensor for the Computation of Optical Flow Singular Points , 1998, NIPS.

[15]  Christof Koch,et al.  Compact real-time 2D gradient-based analog VLSI motion sensor , 1998, Other Conferences.