A Robust Analog VLSI Motion Sensor Based on the Visual System of the Fly

Sensing visual motion gives a creature valuable information about its interactions with the environment. Flies in particular use visual motion information to navigate through turbulent air, avoid obstacles, and land safely. Mobile robots are ideal candidates for using this sensory modality to enhance their performance, but so far have been limited by the computational expense of processing video. Also, the complex structure of natural visual scenes poses an algorithmic challenge for extracting useful information in a robust manner. We address both issues by creating a small, low-power visual sensor with integrated analog parallel processing to extract motion in real-time. Because our architecture is based on biological motion detectors, we gain the advantages of this highly evolved system: A design that robustly and continuously extracts relevant information from its visual environment. We show that this sensor is suitable for use in the real world, and demonstrate its ability to compensate for an imperfect motor system in the control of an autonomous robot. The sensor attenuates open-loop rotation by a factor of 31 with less than 1 mW power dissipation.

[1]  Christof Koch,et al.  An Analog VLSI Model of the Fly Elementary Motion Detector , 1997, NIPS.

[2]  Erann Gat,et al.  Mars microrover navigation: performance evaluation and enhancement , 1995, Proceedings 1995 IEEE/RSJ International Conference on Intelligent Robots and Systems. Human Robot Interaction and Cooperative Robots.

[3]  A. Borst,et al.  Direction selectivity of blowfly motion-sensitive neurons is computed in a two-stage process. , 1990, Proceedings of the National Academy of Sciences of the United States of America.

[4]  A. Borst,et al.  A look into the cockpit of the fly: visual orientation, algorithms, and identified neurons , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[5]  William Bialek,et al.  Statistics of Natural Images: Scaling in the Woods , 1993, NIPS.

[6]  Leslie Pack Kaelbling,et al.  Ecological Robotics , 1998, Adapt. Behav..

[7]  J. Rothwell.  Principles of Neural Science , 1982 .

[8]  Carver Mead,et al.  Analog VLSI and neural systems , 1989 .

[9]  Mandyam V. Srinivasan,et al.  Robot Navigation by Visual Dead-Reckoning Inspiration From Insects , 1997, Int. J. Pattern Recognit. Artif. Intell..

[10]  A. Borst,et al.  Transient and steady-state response properties of movement detectors. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[11]  Rainer A. Deutschmann,et al.  Pulse-based 2d Motion Sensors Pulse-based 2d Motion Sensors , 1999 .

[12]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[13]  Giacomo Indiveri,et al.  Analog VLSI architectures for motion processing: from fundamental limits to system applications , 1996, Proc. IEEE.

[14]  R. Hengstenberg,et al.  Estimation of self-motion by optic flow processing in single visual interneurons , 1996, Nature.

[15]  M. Egelhaaf.  On the neuronal basis of figure-ground discrimination by relative motion in the visual system of the fly , 1985 .

[16]  Charles M. Higgins,et al.  Pulse-based 2-D motion sensors , 1999 .

[17]  W. Reichardt,et al.  Computational structure of a biological motion-detection system as revealed by local detector analysis in the fly's nervous system. , 1989, Journal of the Optical Society of America. A, Optics and image science.

[18]  Martin Egelhaaf.  On the neuronal basis of figure-ground discrimination by relative motion in the visual system of the fly. 2: Figure-dectection cells, a new class of visual interneurones , 1985 .

[19]  J. Gibson.  The perception of the visual world , 1951 .

[20]  M. Anthony Lewis,et al.  Visual Navigation in a Robot Using Zig-Zag Behavior , 1997, NIPS.

[21]  Martin Egelhaaf,et al.  Neural Mechanisms of Visual Course Control in Insects , 1989 .

[22]  A. Borst,et al.  Dendritic integration and its role in computing image velocity. , 1998, Science.

[23]  Martin Egelhaaf,et al.  INTRINSIC PROPERTIES OF BIOLOGICAL MOTION DETECTORS PREVENT THE OPTOMOTOR CONTROL SYSTEM FROM GETTING UNSTABLE , 1996 .

[24]  C. Mead,et al.  Neuromorphic analogue VLSI. , 1995, Annual review of neuroscience.

[25]  Werner Reichardt,et al.  Figure-ground discrimination by relative movement , 1983 .

[26]  Simon B. Laughlin,et al.  Presynaptic enhancement of signal transients in photoreceptor terminals in the compound eye , 1992, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[27]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[28]  A. Borst.  How Do Flies Land?From behavior to neuronal circuits , 1990 .

[29]  T. Delbruck.  Silicon retina with correlation-based, velocity-tuned pixels , 1993 .

[30]  S. Laughlin,et al.  Insect motion detectors matched to visual ecology , 1996, Nature.

[31]  Susanne Huber.  Studies of the visual orientation behavior in flies using the artificial life approach. , 1997 .

[32]  M. Egelhaaf,et al.  Edge detection by landing honeybees: Behavioural analysis and model simulations of the underlying mechanism , 1997, Vision Research.

[33]  B. Kimmerle,et al.  Object detection in the fly during simulated translatory flight , 1997, Journal of Comparative Physiology A.

[34]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[35]  B. Kimmerle,et al.  Object detection in the ̄y during simulated translatory ̄ight , 1997 .

[36]  G Indiveri,et al.  Neuromorphic Vision Sensors , 2000, Science.

[37]  Carver A. Mead,et al.  Analog VLSI Phototransduction by continuous-time, adaptive, logarithmic photoreceptor circuits , 1995 .

[38]  G. Laurent,et al.  Elementary Computation of Object Approach by a Wide-Field Visual Neuron , 1995, Science.

[39]  N. Franceschini,et al.  From insect vision to robot vision , 1992 .

[40]  Tobi Delbrück,et al.  Silicon retina with correlation-based, velocity-tuned pixels , 1993, IEEE Trans. Neural Networks.

[41]  Alexander Borst,et al.  Principles of visual motion detection , 1989, Trends in Neurosciences.

[42]  A. Borst,et al.  Encoding of Visual Motion Information and Reliability in Spiking and Graded Potential Neurons , 1997, The Journal of Neuroscience.

[43]  Derek Abbott,et al.  An insect vision-based motion detection chip , 1997, IEEE J. Solid State Circuits.

[44]  J. Atick,et al.  STATISTICS OF NATURAL TIME-VARYING IMAGES , 1995 .