Biomimetic visual detection based on insect neurobiology

With a visual system that accounts for as much as 30% of the lifted mass, flying insects such as dragonflies and hoverflies invest more in vision than any other animal. Impressive visual performance is subserved by a surprisingly simple visual system. In a typical insect eye, between 2,000 and 30,000 pixels in the image are analyzed by fewer than 200,000 neurons in underlying neural circuits. The combination of sophisticated visual processing with an approachable level of complexity has made the insect visual system a leading model for biomimetic approaches to computer vision. Much neurobiological research has focused on neural circuits used for detection of moving patterns (e.g. optical flow during flight) and moving targets (e.g. prey). Research from several labs has led to great advances in our understanding of the neural mechanisms involved, and has spawned neuromorphic hardware based on key processes identified in neurobiological experiments. Despite its attractions, the highly non-linear nature of several key stages in insect visual processing presents a challenge to understanding. I will describe examples of adaptive elements of neural circuits in the fly visual system which analyze the direction and velocity of wide-field optical flow patterns and the result of experiments that suggest that these non-linearities may contribute to robust responses to natural image motion.

[1]  David O'Carroll,et al.  Feature-detecting neurons in dragonflies , 1993, Nature.

[2]  A. Borst,et al.  Neural circuit tuning fly visual interneurons to motion of small objects. I. Dissection of the circuit by pharmacological and photoinactivation techniques. , 1993, Journal of neurophysiology.

[3]  R. Hengstenberg,et al.  Estimation of self-motion by optic flow processing in single visual interneurons , 1996, Nature.

[4]  Robert A. Harris,et al.  Adaptation and the temporal delay filter of fly motion detectors , 1999, Vision Research.

[5]  S. Laughlin,et al.  Adaptation of the motion-sensitive neuron H1 is generated locally and governed by contrast frequency , 1985, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[6]  Robert A. Harris,et al.  Contrast Gain Reduction in Fly Motion Adaptation , 2000, Neuron.

[7]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[8]  David C. O’Carroll,et al.  Motion adaptation and evidence for parallel processing in the lobula plate of the bee-fly Bombylius major , 2001 .

[9]  Hateren,et al.  Blowfly flight and optic flow. I. Thorax kinematics and flight dynamics , 1999, The Journal of experimental biology.

[10]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[11]  S. Laughlin,et al.  Insect motion detectors matched to visual ecology , 1996, Nature.

[12]  Patrick A. Shoemaker,et al.  Implementation of visual motion detection with contrast adaptation , 2001, SPIE Micro + Nano Materials, Devices, and Applications.

[13]  Christof Koch,et al.  A Silicon Implementation of the Fly's Optomotor Control System , 2000, Neural Computation.

[14]  Alexander Borst,et al.  Photo-ablation of single neurons in the fly visual system reveals neural circuit for the detection of small moving objects , 1992, Neuroscience Letters.

[15]  Shih-Chii Liu Silicon Model of Motion Adaptation in the Fly , 1996 .

[16]  R Hengstenberg,et al.  Dendritic structure and receptive-field organization of optic flow processing interneurons in the fly. , 1998, Journal of neurophysiology.

[17]  J. H. Hateren,et al.  Information theoretical evaluation of parametric models of gain control in blowfly photoreceptor cells , 2001, Vision Research.

[18]  R. Olberg,et al.  Prey pursuit and interception in dragonflies , 2000, Journal of Comparative Physiology A.

[19]  S. Laughlin,et al.  Spatio-temporal properties of motion detectors matched to low image velocities in hovering insects , 1997, Vision Research.

[20]  M. Ibbotson,et al.  An adaptive Reichardt detector model of motion adaptation in insects and mammals , 1997, Visual Neuroscience.

[21]  Hateren,et al.  Blowfly flight and optic flow. II. Head movements during flight , 1999, The Journal of experimental biology.

[22]  Martin Egelhaaf,et al.  Neural Mechanisms of Visual Course Control in Insects , 1989 .

[23]  Nicholas J. Strausfeld,et al.  Pathways in Dipteran Insects for Early Visual Motion Processing , 2001 .

[24]  Christof Koch,et al.  An Analog VLSI Model of the Fly Elementary Motion Detector , 1997, NIPS.