Peripheral Processing Facilitates Optic Flow-Based Depth Perception

Flying insects, such as flies or bees, rely on consistent information regarding the depth structure of the environment when performing their flight maneuvers in cluttered natural environments. These behaviors include avoiding collisions, approaching targets or spatial navigation. Insects are thought to obtain depth information visually from the retinal image displacements (“optic flow”) during translational ego-motion. Optic flow in the insect visual system is processed by a mechanism that can be modeled by correlation-type elementary motion detectors (EMDs). However, it is still an open question how spatial information can be extracted reliably from the responses of the highly contrast- and pattern-dependent EMD responses, especially if the vast range of light intensities encountered in natural environments is taken into account. This question will be addressed here by systematically modeling the peripheral visual system of flies, including various adaptive mechanisms. Different model variants of the peripheral visual system were stimulated with image sequences that mimic the panoramic visual input during translational ego-motion in various natural environments, and the resulting peripheral signals were fed into an array of EMDs. We characterized the influence of each peripheral computational unit on the representation of spatial information in the EMD responses. Our model simulations reveal that information about the overall light level needs to be eliminated from the EMD input as is accomplished under light-adapted conditions in the insect peripheral visual system. The response characteristics of large monopolar cells (LMCs) resemble that of a band-pass filter, which reduces the contrast dependency of EMDs strongly, effectively enhancing the representation of the nearness of objects and, especially, of their contours. We furthermore show that local brightness adaptation of photoreceptors allows for spatial vision under a wide range of dynamic light conditions.

[1]  Christof Koch,et al.  A Robust Analog VLSI Motion Sensor Based on the Visual System of the Fly , 1999, Auton. Robots.

[2]  Martin Egelhaaf,et al.  The neural computation of visual motion information. , 2006 .

[3]  James E. Fitzgerald,et al.  Symmetries in stimulus statistics shape the form of visual motion estimators , 2011, Proceedings of the National Academy of Sciences.

[4]  Hateren,et al.  Blowfly flight and optic flow. II. Head movements during flight , 1999, The Journal of experimental biology.

[5]  J. V. van Hateren,et al.  Real and optimal neural images in early vision , 1992, Nature.

[6]  H. Bourgeois,et al.  [Contrast sensitivity]. , 1987, L'Annee therapeutique et clinique en ophtalmologie.

[7]  R. O. Uusitalo,et al.  Transfer of graded potentials at the photoreceptor-interneuron synapse , 1995, The Journal of general physiology.

[8]  M Egelhaaf,et al.  On the Computations Analyzing Natural Optic Flow: Quantitative Model Analysis of the Blowfly Motion Vision Pathway , 2005, The Journal of Neuroscience.

[9]  Patrick A. Shoemaker,et al.  Velocity constancy and models for wide-field visual motion detection in insects , 2005, Biological Cybernetics.

[10]  Karl Kral,et al.  Motion parallax as a source of distance information in locusts and mantids , 2007, Journal of Insect Behavior.

[11]  Martin Egelhaaf,et al.  Neuronal encoding of object and distance information: a model simulation study on naturalistic optic flow processing , 2011, Front. Neural Circuits.

[12]  Michael B. Reiser,et al.  Wide-Field Feedback Neurons Dynamically Tune Early Visual Processing , 2014, Neuron.

[13]  M Egelhaaf,et al.  Movement detection in arthropods. , 1993, Reviews of oculomotor research.

[14]  J. H. van Hateren,et al.  Real and optimal neural images in early vision , 1992, Nature.

[15]  Martin Egelhaaf,et al.  Depth information in natural environments derived from optic flow by insect motion detection system: a model analysis , 2014, Front. Comput. Neurosci..

[16]  R. B. Pinter,et al.  Nonlinear Vision: Determination of Neural Receptive Fields, Function, and Networks , 1992 .

[17]  Martin Egelhaaf,et al.  Prototypical Components of Honeybee Homing Flight Behavior Depend on the Visual Appearance of Objects Surrounding the Goal , 2012, Front. Behav. Neurosci..

[18]  V. Hateren,et al.  Processing of natural time series of intensities in the early visual system of the blowfly , 1997 .

[19]  Simon K. Rushton,et al.  Optic Flow and Beyond , 2004 .

[20]  Alexander Borst,et al.  Visualizing retinotopic half-wave rectified input to the motion detection circuitry of Drosophila , 2010, Nature Neuroscience.

[21]  M. Kawato,et al.  Change in neuronal firing patterns in the process of motor command generation for the ocular following response. , 2001, Journal of neurophysiology.

[22]  Martin Egelhaaf,et al.  Gaze Strategy in the Free Flying Zebra Finch (Taeniopygia guttata) , 2008, PloS one.

[23]  Damon A. Clark,et al.  Processing properties of ON and OFF pathways for Drosophila motion detection , 2014, Nature.

[24]  J. H. Hateren,et al.  Theoretical predictions of spatiotemporal receptive fields of fly LMCs, and experimental validation , 1992, Journal of Comparative Physiology A.

[25]  J. Sanes,et al.  Design Principles of Insect and Vertebrate Visual Systems , 2010, Neuron.

[26]  Derek Abbott,et al.  Effect of spatial sampling on pattern noise in insect-based motion detection , 2005, SPIE Micro + Nano Materials, Devices, and Applications.

[27]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[28]  William Bialek,et al.  Adaptive Rescaling Maximizes Information Transmission , 2000, Neuron.

[29]  D. Burr,et al.  Spatial and temporal selectivity of the human motion detection system , 1985, Vision Research.

[30]  Michael H. Dickinson,et al.  Body saccades of Drosophila consist of stereotyped banked turns , 2015, The Journal of Experimental Biology.

[31]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[32]  J. van Santen,et al.  Elaborated Reichardt detectors. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[33]  Martin Egelhaaf,et al.  Spatial vision in insects is facilitated by shaping the dynamics of visual input through behavioral action , 2012, Front. Neural Circuits.

[34]  Thomas S. Collett,et al.  SHORT COMMUNICATION PEERING - A LOCUST BEHAVIOUR PATTERN FOR OBTAINING MOTION PARALLAX INFORMATION , 1978 .

[35]  Tobi Delbrück,et al.  Adaptive photoreceptor with wide dynamic range , 1994, Proceedings of IEEE International Symposium on Circuits and Systems - ISCAS '94.

[36]  S. Laughlin.  Matching coding, circuits, cells, and molecules to signals: General principles of retinal design in the fly's eye , 1994, Progress in Retinal and Eye Research.

[37]  Fritz-Olaf Lehmann,et al.  The free-flight response of Drosophila to motion of the visual environment , 2008, Journal of Experimental Biology.

[38]  Martin Egelhaaf,et al.  Motion as a source of environmental information: a fresh view on biological motion computation by insect brains , 2014, Front. Neural Circuits.

[39]  Justin M. Ales,et al.  Flies and humans share a motion estimation strategy that exploits natural scene statistics , 2014, Nature Neuroscience.

[40]  Roger C. Hardie,et al.  Common strategies for light adaptation in the peripheral visual systems of fly and dragonfly , 1978, Journal of comparative physiology.

[41]  F. Ruffier,et al.  A bio-inspired analog silicon retina with Michaelis-Menten auto-adaptive pixels sensitive to small and large changes in light. , 2015, Optics express.

[42]  Damon A. Clark,et al.  Modular Use of Peripheral Input Channels Tunes Motion-Detecting Circuitry , 2013, Neuron.

[43]  Alexander Borst,et al.  Optogenetic and Pharmacologic Dissection of Feedforward Inhibition in Drosophila Motion Vision , 2014, The Journal of Neuroscience.

[44]  T Köhler,et al.  Bio-inspired motion detection in an FPGA-based smart camera module , 2009, Bioinspiration & biomimetics.

[45]  J. H. Van Hateren,et al.  Spatiotemporal contrast sensitivity of early vision , 1993, Vision Research.

[46]  K. Naka,et al.  S‐potentials from colour units in the retina of fish (Cyprinidae) , 1966, The Journal of physiology.

[47]  J. H. Hateren,et al.  Information theoretical evaluation of parametric models of gain control in blowfly photoreceptor cells , 2001, Vision Research.

[48]  Martin Buss,et al.  Bio-inspired visual ego-rotation sensor for MAVs , 2012, Biological Cybernetics.

[49]  A. Borst,et al.  Detecting visual motion: theory and models. , 1993, Reviews of oculomotor research.

[50]  J. P. Lindemann,et al.  Translational sequences of panoramic high dynamic range images in natural environments , 2014 .

[51]  Martin Egelhaaf,et al.  Blowfly flight characteristics are shaped by environmental features and controlled by optic flow information , 2012, Journal of Experimental Biology.

[52]  Yvette E. Fisher,et al.  Orientation Selectivity Sharpens Motion Detection in Drosophila , 2015, Neuron.

[53]  James E. Fitzgerald,et al.  Nonlinear circuits for naturalistic visual motion estimation , 2015, eLife.

[54]  Alexander Borst,et al.  Models of motion detection , 2000, Nature Neuroscience.

[55]  R O Dror,et al.  Accuracy of velocity estimation by Reichardt correlators. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[56]  A. Borst,et al.  Internal Structure of the Fly Elementary Motion Detector , 2011, Neuron.

[57]  J. P. Lindemann,et al.  Temporal Statistics of Natural Image Sequences Generated by Movements with Insect Flight Characteristics , 2014, PloS one.

[58]  S. Laughlin.  A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[59]  A. S. French,et al.  Information processing by graded-potential transmission through tonically active synapses , 1996, Trends in Neurosciences.

[60]  M. Egelhaaf,et al.  Bumblebee Homing: The Fine Structure of Head Turning Movements , 2015, PloS one.

[61]  Karin Nordström,et al.  Local and global responses of insect motion detectors to the spatial structure of natural scenes. , 2011, Journal of vision.

[62]  A. Borst,et al.  Functional Specialization of Neural Input Elements to the Drosophila ON Motion Detector , 2015, Current Biology.

[63]  W. Beaudot,et al.  Sensory coding in the vertebrate retina: towards an adaptive control of visual sensitivity. , 1996, Network.

[64]  A. C. James.  Nonlinear Operator Network Models of Processing in the Fly Lamina , 2018 .

[65]  Simon B. Laughlin,et al.  Adaptation reduces sensitivity to save energy without information loss in the fly visual system , 2011 .

[66]  Martin Egelhaaf,et al.  The fine structure of honeybee head and body yaw movements in a homing task , 2010, Proceedings of the Royal Society B: Biological Sciences.

[67]  A. Borst,et al.  Fly motion vision. , 2010, Annual review of neuroscience.

[68]  R. A. Normann,et al.  Evaluating sensitivity changing mechanisms in light-adapted photoreceptors , 1979, Vision Research.

[69]  Hateren,et al.  Blowfly flight and optic flow. I. Thorax kinematics and flight dynamics , 1999, The Journal of experimental biology.

[70]  W. Reichardt,et al.  Autocorrelation, a principle for the evaluation of sensory information by the central nervous system , 1961 .

[71]  Alexander Borst,et al.  Neural Circuits for Motion Vision in the Fly. , 2014, Cold Spring Harbor symposia on quantitative biology.

[72]  M. Egelhaaf,et al.  Insect-Inspired Self-Motion Estimation with Dense Flow Fields—An Adaptive Matched Filter Approach , 2015, PloS one.

[73]  Martin Egelhaaf,et al.  A Bio-Inspired Model for Visual Collision Avoidance on a Hexapod Walking Robot , 2016, Living Machines.

[74]  Martin Egelhaaf,et al.  Identifying Prototypical Components in Behaviour Using Clustering Algorithms , 2010, PloS one.

[75]  J. P. Lindemann,et al.  Pattern-Dependent Response Modulations in Motion-Sensitive Visual Interneurons—A Model Study , 2011, PloS one.

[76]  A. Borst,et al.  Asymmetry of Drosophila ON and OFF motion detectors enhances real-world velocity estimation , 2016, Nature Neuroscience.

[77]  B. E. Eckbo,et al.  Appendix , 1826, Epilepsy Research.

[78]  A S French,et al.  Nonlinear models of the first synapse in the light-adapted fly retina. , 1995, Journal of neurophysiology.

[79]  V. Hateren,et al.  Processing of natural time series of intensities by the visual system of the blowfly , 1997, Vision Research.

[80]  Alexander Borst,et al.  Principles of visual motion detection , 1989, Trends in Neurosciences.

[81]  David Lentink,et al.  How Lovebirds Maneuver Rapidly Using Super-Fast Head Saccades and Image Feature Stabilization , 2015, PloS one.

[82]  A. Straw,et al.  Contrast sensitivity of insect motion detectors to natural images. , 2008, Journal of vision.

[83]  J.,et al.  Optic Flow , 2014, Computer Vision, A Reference Guide.

[84]  Damon A. Clark,et al.  Defining the Computational Structure of the Motion Detector in Drosophila , 2011, Neuron.

[85]  Leo E. Lipetz,et al.  The Relation of Physiological and Psychological Aspects of Sensory Intensity , 1971 .

[86]  E. C. Sobel.  The locust's use of motion parallax to measure distance , 1990, Journal of Comparative Physiology A.

[87]  Thomas R Clandinin,et al.  Motion-detecting circuits in flies: coming into view. , 2014, Annual review of neuroscience.

[88]  C. W. G Clifford,et al.  Fundamental mechanisms of visual motion detection: models, cells and functions , 2002, Progress in Neurobiology.

[89]  F. A. Miles,et al.  Visual Motion and Its Role in the Stabilization of Gaze , 1992 .