A Neuromorphic Visual Motion Sensor For Real-World Robots

Sensing visual motion gives a creature valuable information about its interactions with the environment. Flies in particular use visual motion information to navigate through turbulent air, avoid obstacles, and land safely. Mobile robots are ideal candidates for using this sensory modality to enhance their performance, but so far have been limited by the computational expense of processing video in realtime. Also, the complex structure of natural visual scenes poses an algo-rithmic challenge for extracting useful information in a robust manner. We address both issues by creating a small, low-power visual sensor with integrated ana-log parallel processing to extract motion in real-time. Because our architecture is based on biological motion detectors, we gain the advantages of this highly evolved system: A design that contains an implicit model of the statistical structure of natural dynamic scenes. We show that this sensor is suitable for use in the real world, and suggest robotic applications.

[1]  A. Borst,et al.  A look into the cockpit of the fly: visual orientation, algorithms, and identified neurons , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[2]  M. Ibbotson,et al.  An adaptive Reichardt detector model of motion adaptation in insects and mammals , 1997, Visual Neuroscience.

[3]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[4]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[5]  Mandyam V. Srinivasan,et al.  Robot Navigation by Visual Dead-Reckoning Inspiration From Insects , 1997, Int. J. Pattern Recognit. Artif. Intell..

[6]  A. Borst,et al.  Transient and steady-state response properties of movement detectors. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[7]  Paul Hasler,et al.  Floating-gate CMOS analog memory cell array , 1998, ISCAS '98. Proceedings of the 1998 IEEE International Symposium on Circuits and Systems (Cat. No.98CH36187).

[8]  V. Braitenberg Vehicles, Experiments in Synthetic Psychology , 1984 .

[9]  W. Reichardt,et al.  Properties of individual movement detectors as derived from behavioural experiments on the visual system of the fly , 1988, Biological Cybernetics.

[10]  Alexander Borst,et al.  Principles of visual motion detection , 1989, Trends in Neurosciences.

[11]  J. Atick,et al.  Temporal decorrelation: a theory of lagged and nonlagged responses in the lateral geniculate nucleus , 1995 .

[12]  M. Anthony Lewis,et al.  Visual Navigation in a Robot Using Zig-Zag Behavior , 1997, NIPS.