Active Vision in Blowflies: Strategies and Mechanisms of Spatial Orientation

With its miniature brain blowflies are able to control highly aerobatic flight manoeuvres and, in this regard, outperform any man-made autonomous flying system. To accomplish this extraordinary performance, flies shape actively by the specific succession of characteristic movements the dynamics of the image sequences on their eyes (‘optic flow’): They shift their gaze only from time to time by saccadic turns of body and head and keep it fixed between these saccades. Utilising the intervals of stable vision between saccades, an ensemble of motion-sensitive visual interneurons extracts from the optic flow information about different aspects of the self-motion of the animal and the spatial layout of the environment. This is possible in a computationally parsimonious way because the retinal image flow evoked by translational self-motion contains information about the spatial layout of the environment. Detection of environmental objects is even facilitated by adaptation mechanisms in the visual motion pathway. The consistency of our experimentally established hypotheses is tested by modelling the blowfly motion vision system and using this model to control the locomotion of a ‘Cyberfly’ moving in virtual environments. This CyberFly is currently being integrated in a robotic platform steering in three dimensions with a dynamics similar to that of blowflies.

[1]  M. Lehrer,et al.  Small-scale navigation in the honeybee: active acquisition of visual information about the goal , 1996, The Journal of experimental biology.

[2]  M. Egelhaaf,et al.  Responses of blowfly motion-sensitive neurons to reconstructed optic flow along outdoor flight paths , 2005, Journal of Comparative Physiology A.

[3]  Reza Shadmehr,et al.  Learning of action through adaptive combination of motor primitives , 2000, Nature.

[4]  J. P. Lindemann,et al.  Function of a Fly Motion-Sensitive Neuron Matches Eye Movements during Free Flight , 2005, PLoS biology.

[5]  M. Srinivasan,et al.  Range perception through apparent image speed in freely flying honeybees , 1991, Visual Neuroscience.

[6]  R Hengstenberg,et al.  Dendritic structure and receptive-field organization of optic flow processing interneurons in the fly. , 1998, Journal of neurophysiology.

[7]  B. Webb,et al.  Sensorimotor control of navigation in arthropod and artificial systems. , 2004, Arthropod structure & development.

[8]  M. Srinivasan,et al.  Motion cues provide the bee's visual world with a third dimension , 1988, Nature.

[9]  Esch,et al.  Distance estimation by foraging honeybees , 1996, The Journal of experimental biology.

[10]  C. Schilstra,et al.  Stabilizing gaze in flying blowflies , 1998, Nature.

[11]  Michael B. Reiser,et al.  A test bed for insect-inspired robotic control , 2003, Philosophical Transactions of the Royal Society of London. Series A: Mathematical, Physical and Engineering Sciences.

[12]  Christian Bauckhage,et al.  Synthesizing Movements for Computer Game Characters , 2004, DAGM-Symposium.

[13]  M Egelhaaf,et al.  On the Computations Analyzing Natural Optic Flow: Quantitative Model Analysis of the Blowfly Motion Vision Pathway , 2005, The Journal of Neuroscience.

[14]  R. Hengstenberg Common visual response properties of giant vertical cells in the lobula plate of the blowflyCalliphora , 1982, Journal of comparative physiology.

[15]  Hanspeter A. Mallot,et al.  Biomimetic robot navigation , 2000, Robotics Auton. Syst..

[16]  H. C. Longuet-Higgins,et al.  The interpretation of a moving retinal image , 1980, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[17]  F. A. Miles,et al.  Visual Motion and Its Role in the Stabilization of Gaze , 1992 .

[18]  T Köhler,et al.  Bio-inspired motion detection in an FPGA-based smart camera module , 2009, Bioinspiration & biomimetics.

[19]  Michael H Dickinson,et al.  The influence of visual landscape on the free flight behavior of the fruit fly Drosophila melanogaster. , 2002, The Journal of experimental biology.

[20]  Nicholas J. Strausfeld,et al.  Pathways in Dipteran Insects for Early Visual Motion Processing , 2001 .

[21]  Karl Kral,et al.  Motion parallax as a source of distance information in locusts and mantids , 2007, Journal of Insect Behavior.

[22]  Martin Egelhaaf,et al.  Motion Adaptation Enhances Object-Induced Neural Activity in Three-Dimensional Virtual Environment , 2008, The Journal of Neuroscience.

[23]  Shaowu Zhang,et al.  Honeybee dances communicate distances measured by optic flow , 2001, Nature.

[24]  Anil K. Jain,et al.  Algorithms for Clustering Data , 1988 .

[25]  M. Srinivasan,et al.  Honeybee Odometry: Performance in Varying Natural Terrain , 2004, PLoS biology.

[26]  H G Krapp,et al.  Neuronal matched filters for optic flow processing in flying insects. , 2000, International review of neurobiology.

[27]  V. Hateren,et al.  Processing of natural time series of intensities by the visual system of the blowfly , 1997, Vision Research.

[28]  M V Srinivasan,et al.  Honeybee navigation: nature and calibration of the "odometer". , 2000, Science.

[29]  S B Laughlin,et al.  Matched filtering by a photoreceptor membrane , 1996, Vision Research.

[30]  Michael H Dickinson,et al.  Visual Edge Orientation Shapes Free-Flight Behavior in Drosophila , 2007, Fly.

[31]  Dario Floreano,et al.  Fly-inspired visual steering of an ultralight indoor aircraft , 2006, IEEE Transactions on Robotics.

[32]  M. Lappe Neuronal processing of optic flow , 2000 .

[33]  Alexander Borst,et al.  Principles of visual motion detection , 1989, Trends in Neurosciences.

[34]  Martin Egelhaaf,et al.  Saccadic flight strategy facilitates collision avoidance: closed-loop performance of a cyberfly , 2008, Biological Cybernetics.

[35]  R. Hengstenberg,et al.  The number and structure of giant vertical cells (VS) in the lobula plate of the blowflyCalliphora erythrocephala , 1982, Journal of comparative physiology.

[36]  M. Egelhaaf,et al.  Chasing a dummy target: smooth pursuit and velocity control in male blowflies , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[37]  K. Prazdny,et al.  Egomotion and relative depth map from optical flow , 2004, Biological Cybernetics.

[38]  J. Zeil Orientation flights of solitary wasps (Cerceris; Sphecidae; Hymenoptera) , 1993, Journal of Comparative Physiology A.

[39]  P. J. Sobey Active navigation with a monocular robot , 1994, Biological Cybernetics.

[40]  R. Hardie,et al.  Facets of Vision , 1989, Springer Berlin Heidelberg.

[41]  A. Borst,et al.  Neural networks in the cockpit of the fly , 2002, Journal of Comparative Physiology A.

[42]  A. Borst,et al.  Sharing Receptive Fields with Your Neighbors: Tuning the Vertical System Cells to Wide Field Motion , 2005, The Journal of Neuroscience.

[43]  J. V. van Hateren,et al.  Encoding of naturalistic optic flow by a population of blowfly motion-sensitive neurons. , 2006, Journal of neurophysiology.

[44]  S. W. Zhang,et al.  How honeybees measure their distance from objects of unknown size , 2004, Journal of Comparative Physiology A.

[45]  R. Hengstenberg,et al.  Binocular contributions to optic flow processing in the fly visual system. , 2001, Journal of neurophysiology.

[46]  A. S. French,et al.  Information processing by graded-potential transmission through tonically active synapses , 1996, Trends in Neurosciences.

[47]  Holger G. Krapp,et al.  Neural encoding of behaviourally relevant visual-motion information in the fly , 2002, Trends in Neurosciences.

[48]  D. Varjú,et al.  Visual position stabilization in the hummingbird hawk moth, Macroglossum stellatarum L. I. Behavioural analysis , 1998, Journal of Comparative Physiology A.

[49]  Martin Egelhaaf,et al.  Neural Mechanisms of Visual Course Control in Insects , 1989 .

[50]  Zhang,et al.  Honeybee navigation en route to the goal: visual flight control and odometry , 1996, The Journal of experimental biology.

[51]  Michael H Dickinson,et al.  Closing the loop between neurobiology and flight behavior in Drosophila , 2004, Current Opinion in Neurobiology.

[52]  T. Schack The cognitive architecture of complex movement , 2004 .

[53]  Tim Köhler,et al.  A flexible bio-inspired FPGA-based high-speed camera with 10,000 elementary motion detectors , 2008 .

[54]  Helge J. Ritter Cognitive Interaction Technology , 2010, KI - Künstliche Intelligenz.

[55]  Klaus Hausen,et al.  Motion sensitive interneurons in the optomotor system of the fly , 1982, Biological Cybernetics.

[56]  Hateren,et al.  Blowfly flight and optic flow. I. Thorax kinematics and flight dynamics , 1999, The Journal of experimental biology.

[57]  A. Borst,et al.  Motion computation and visual orientation in flies. , 1993, Comparative biochemistry and physiology. Comparative physiology.

[58]  M. Srinivasan,et al.  Visual control of flight speed in honeybees , 2005, Journal of Experimental Biology.

[59]  J. Zeil,et al.  Structure and function of learning flights in bees and wasps , 1996 .

[60]  J. Zanker,et al.  Motion vision : computational, neural, and ecological constraints , 2001 .

[61]  J. P. Lindemann,et al.  FliMax, a novel stimulus device for panoramic and highspeed presentation of behaviourally generated optic flow , 2003, Vision Research.

[62]  M Egelhaaf,et al.  Representation of behaviourally relevant information by blowfly motion-sensitive visual interneurons requires precise compensatory head movements , 2006, Journal of Experimental Biology.

[63]  D. Varjú,et al.  The regulation of distance to dummy flowers during hovering flight in the hawk moth Macroglossum stellatarum , 1994, Journal of Comparative Physiology A.

[64]  N. Franceschini,et al.  From insect vision to robot vision , 1992 .

[65]  B. Kimmerle,et al.  Object detection by relative motion in freely flying flies , 1996, Naturwissenschaften.

[66]  Hateren,et al.  Blowfly flight and optic flow. II. Head movements during flight , 1999, The Journal of experimental biology.

[67]  J. Zeil Orientation flights of solitary wasps (Cerceris; Sphecidae; Hymenoptera) , 1993, Journal of Comparative Physiology A.

[68]  Martin Egelhaaf,et al.  Steering a virtual blowfly: simulation of visual pursuit , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[69]  HighWire Press Philosophical Transactions of the Royal Society of London , 1781, The London Medical Journal.

[70]  M. F. Land,et al.  Maps of the acute zones of fly eyes , 1985, Journal of Comparative Physiology A.

[71]  A. Borst,et al.  Detecting visual motion: theory and models. , 1993, Reviews of oculomotor research.

[72]  M Egelhaaf,et al.  Movement detection in arthropods. , 1993, Reviews of oculomotor research.

[73]  F. G. Barth,et al.  A stingless bee (Melipona seminigra) uses optic flow to estimate flight distances , 2003, Journal of Comparative Physiology A.

[74]  K. Hausen Motion sensitive interneurons in the optomotor system of the fly , 1982, Biological Cybernetics.

[75]  Holger G. Krapp,et al.  Arrangement of optical axes and spatial resolution in the compound eye of the female blowfly Calliphora , 2000, Journal of Comparative Physiology A.