A Model for the Detection of Moving Targets in Visual Clutter Inspired by Insect Physiology

We present a computational model for target discrimination based on intracellular recordings from neurons in the fly visual system. Determining how insects detect and track small moving features, often against cluttered moving backgrounds, is an intriguing challenge, both from a physiological and a computational perspective. Previous research has characterized higher-order neurons within the fly brain, known as ‘small target motion detectors’ (STMD), that respond robustly to moving features, even when the velocity of the target is matched to the background (i.e. with no relative motion cues). We recorded from intermediate-order neurons in the fly visual system that are well suited as a component along the target detection pathway. This full-wave rectifying, transient cell (RTC) reveals independent adaptation to luminance changes of opposite signs (suggesting separate ON and OFF channels) and fast adaptive temporal mechanisms, similar to other cell types previously described. From this physiological data we have created a numerical model for target discrimination. This model includes nonlinear filtering based on the fly optics, the photoreceptors, the 1st order interneurons (Large Monopolar Cells), and the newly derived parameters for the RTC. We show that our RTC-based target detection model is well matched to properties described for the STMDs, such as contrast sensitivity, height tuning and velocity tuning. The model output shows that the spatiotemporal profile of small targets is sufficiently rare within natural scene imagery to allow our highly nonlinear ‘matched filter’ to successfully detect most targets from the background. Importantly, this model can explain this type of feature discrimination without the need for relative motion cues.

[1]  D. Arnett Receptive Field Organization of Units in the First Optic Ganglion of Diptera , 1971, Science.

[2]  D. Osorio,et al.  The temporal properties of non-linear, transient cells in the locust medulla , 2004, Journal of Comparative Physiology A.

[3]  J. H. van Hateren,et al.  Fast temporal adaptation of on-off units in the first optic chiasm of the blowfly , 2004, Journal of Comparative Physiology A.

[4]  S. B. Laughlin,et al.  Fast and slow photoreceptors — a comparative study of the functional diversity of coding and conductances in the Diptera , 1993, Journal of Comparative Physiology A.

[5]  M. Srinivasan,et al.  Spectral properties of movement perception in the dronefly Eristalis , 2004, Journal of Comparative Physiology A.

[6]  N. Strausfeld,et al.  The functional organization of male-specific visual neurons in flies , 1991, Journal of Comparative Physiology A.

[7]  Patrick A. Shoemaker,et al.  Velocity constancy and models for wide-field visual motion detection in insects , 2005, Biological Cybernetics.

[8]  D. Tolhurst,et al.  Amplitude spectra of natural images. , 1992, Ophthalmic & physiological optics : the journal of the British College of Ophthalmic Opticians.

[9]  D. Osorio Mechanisms of early visual processing in the medulla of the locust optic lobe: How self-inhibition, spatial-pooling, and signal rectification contribute to the properties of transient cells , 1991, Visual Neuroscience.

[10]  D W Arnett,et al.  Spatial and temporal integration properties of units in first optic ganglion of dipterans. , 1972, Journal of neurophysiology.

[11]  H. Wagner Flight Performance and Visual Control of Flight of the Free-Flying Housefly (Musca Domestica L.) III. Interactions Between Angular Movement Induced by Wide- and Smallfield Stimuli , 1986 .

[12]  F. Zettler,et al.  Micro-localisation of lamina-located visual cell activities in the compound eye of the blowfly Calliphora , 1970, Zeitschrift für vergleichende Physiologie.

[13]  Martin Egelhaaf,et al.  On the neuronal basis of figure-ground discrimination by relative motion in the visual system of the fly , 1985, Biological Cybernetics.

[14]  J. H. van Hateren,et al.  On-off units in the first optic chiasm of the blowfly II. Spatial properties , 2004, Journal of Comparative Physiology A.

[15]  Andrew Charles James,et al.  White-noise studies in the fly lamina , 1990 .

[16]  T. Collett,et al.  Vision during flight , 1975 .

[17]  Karin Nordström,et al.  Small object detection neurons in female hoverflies , 2006, Proceedings of the Royal Society B: Biological Sciences.

[18]  N. Strausfeld,et al.  Anatomical organization of retinotopic motion‐sensitive pathways in the optic lobes of flies , 2003, Microscopy research and technique.

[19]  Daniel Osorio,et al.  Matched filtering in the visual system of the fly : large monopolar cells of the lamina are optimized to detect moving edges and blobs , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[20]  P. Bex,et al.  Spatial frequency, phase, and the contrast of natural images. , 2002, Journal of the Optical Society of America. A, Optics, image science, and vision.

[21]  P. Simmons,et al.  Orthopteran DCMD neuron: a reevaluation of responses to moving objects. I. Selective responses to approaching objects. , 1992, Journal of neurophysiology.

[22]  J. H. Hateren,et al.  Theoretical predictions of spatiotemporal receptive fields of fly LMCs, and experimental validation , 1992, Journal of Comparative Physiology A.

[23]  R. G. Guy,et al.  Are the large monopolar cells of the insect lamina on the optomotor pathway? , 2004, Journal of Comparative Physiology A.

[24]  A. Straw,et al.  A `bright zone' in male hoverfly (Eristalis tenax) eyes and associated faster motion detection and increased contrast sensitivity , 2006, Journal of Experimental Biology.

[25]  F. Rind,et al.  Neural network based on the input organization of an identified neuron signaling impending collision. , 1996, Journal of neurophysiology.

[26]  David C. O'Carroll,et al.  Retinotopic Organization of Small-Field-Target-Detecting Neurons in the Insect Visual System , 2007, Current Biology.

[27]  D. C. O'Carroll,et al.  Local feedback mediated via amacrine cells in the insect optic lobe , 2004, Journal of Comparative Physiology A.

[28]  M. Land Visual acuity in insects. , 1997, Annual review of entomology.

[29]  Charles M. Higgins,et al.  An elaborated model of fly small-target tracking , 2004, Biological Cybernetics.

[30]  Roger C. Hardie,et al.  Feedback Network Controls Photoreceptor Output at the Layer of First Visual Synapses in Drosophila , 2006, The Journal of general physiology.

[31]  David O'Carroll,et al.  Feature-detecting neurons in dragonflies , 1993, Nature.

[32]  J. H. Hateren,et al.  Information theoretical evaluation of parametric models of gain control in blowfly photoreceptor cells , 2001, Vision Research.

[33]  G. Horridge The Compound eye and vision of insects , 1975 .

[34]  M. Egelhaaf On the neuronal basis of figure-ground discrimination by relative motion in the visual system of the fly , 1985 .

[35]  S. Laughlin A Simple Coding Procedure Enhances a Neuron's Information Capacity , 1981, Zeitschrift fur Naturforschung. Section C, Biosciences.

[36]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[37]  D. Stavenga Angular and spectral sensitivity of fly photoreceptors. I. Integrated facet lens and rhabdomere optics , 2002, Journal of Comparative Physiology A.

[38]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[39]  R. O. Uusitalo,et al.  Transfer of graded potentials at the photoreceptor-interneuron synapse , 1995, The Journal of general physiology.

[40]  David C. O'Carroll,et al.  Bio-inspired pixel-wise adaptive imaging , 2006, SPIE Micro + Nano Materials, Devices, and Applications.

[41]  C. H. Fraser Rowell,et al.  The neuronal basis of a sensory analyser, the acridid movement detector system. IV. The preference for small field stimuli. , 1977, The Journal of experimental biology.

[42]  R.S.A. Brinkworth,et al.  Biomimetic Motion Detection , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[43]  Paul D. Barnett,et al.  Insect Detection of Small Targets Moving in Visual Clutter , 2006, PLoS biology.

[44]  C. Wehrhahn,et al.  Sex-specific differences in the chasing behaviour of houseflies (Musca) , 1979, Biological Cybernetics.