Photoreceptor processing improves salience facilitating small target detection in cluttered scenes.

Target detection amidst clutter is a challenging task for both natural and artificial vision, yet one solved at the level of neurons in the 3rd optic ganglion of insects. These neurons are capable of responding to the motion of small objects, even against complex moving backgrounds. While the basic physiology has been investigated, little is known about how these cells are able to reject background motion while robustly responding to such small stimuli. By recording intracellularly from fly photoreceptors stimulated with natural image sequences containing a target viewed against a complex moving background, we show that the process of target detection begins at the earliest stages of vision. The temporal processing by photoreceptors alone, in the absence of any spatial interactions, improved the discrimination of targets (essentially a spatial task) by around 70%. This enhancement of target salience can be explained by elaborate models of photoreceptor temporal non-linear dynamics. The application of the functional principals outlined in this work could be utilized in areas such as robotics and surveillance, medical imaging, or astronomy, anywhere it is necessary to detect a small item from a cluttered surround.

[1]  H. Wagner Flight performance and visual control of flight of the free-flying housefly (Musca domestica L.) II. Pursuit of targets , 1986 .

[2]  Allan W. Snyder,et al.  Spatial information capacity of compound eyes , 2004, Journal of comparative physiology.

[3]  H. P. Snippe,et al.  Phototransduction in primate cones and blowfly photoreceptors: different mechanisms, different algorithms, similar response , 2005, Journal of Comparative Physiology A.

[4]  R. O. Uusitalo,et al.  Transfer of graded potentials at the photoreceptor-interneuron synapse , 1995, The Journal of general physiology.

[5]  F. Attneave Some informational aspects of visual perception. , 1954, Psychological review.

[6]  J. H. Hateren,et al.  Information theoretical evaluation of parametric models of gain control in blowfly photoreceptor cells , 2001, Vision Research.

[7]  T. Collett,et al.  Chasing behaviour of houseflies (Fannia canicularis) , 1974, Journal of comparative physiology.

[8]  Eero P. Simoncelli,et al.  Natural image statistics and neural representation. , 2001, Annual review of neuroscience.

[9]  M. Egelhaaf,et al.  Chasing a dummy target: smooth pursuit and velocity control in male blowflies , 2003, Proceedings of the Royal Society of London. Series B: Biological Sciences.

[10]  Michael H Dickinson,et al.  Fly Flight A Model for the Neural Control of Complex Behavior , 2001, Neuron.

[11]  D. Stavenga Angular and spectral sensitivity of fly photoreceptors. I. Integrated facet lens and rhabdomere optics , 2002, Journal of Comparative Physiology A.

[12]  Hateren,et al.  Blowfly flight and optic flow. II. Head movements during flight , 1999, The Journal of experimental biology.

[13]  T. Collett,et al.  How hoverflies compute interception courses , 1978, Journal of comparative physiology.

[14]  J. H. van Hateren,et al.  Real and optimal neural images in early vision , 1992, Nature.

[15]  Cole Gilbert,et al.  Small‐field neurons associated with oculomotor and optomotor control in muscoid flies: Functional organization , 1992, The Journal of comparative neurology.

[16]  David C. O'Carroll,et al.  Retinotopic Organization of Small-Field-Target-Detecting Neurons in the Insect Visual System , 2007, Current Biology.

[17]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[18]  J. P. Lindemann,et al.  Function of a Fly Motion-Sensitive Neuron Matches Eye Movements during Free Flight , 2005, PLoS biology.

[19]  J. Howard,et al.  Response of an insect photoreceptor: a simple log-normal model , 1981, Nature.

[20]  Patrick A. Shoemaker,et al.  A Model for the Detection of Moving Targets in Visual Clutter Inspired by Insect Physiology , 2008, PloS one.

[21]  S. Laughlin,et al.  The rate of information transfer at graded-potential synapses , 1996, Nature.

[22]  D. G. Stavenga,et al.  Angular sensitivity of blowfly photoreceptors: broadening by artificial electrical coupling , 1987, Journal of Comparative Physiology A.

[23]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[24]  Paul D. Barnett,et al.  Sexual Dimorphism in the Hoverfly Motion Vision Pathway , 2008, Current Biology.

[25]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[26]  THOMAS COLLETT,et al.  Visual Neurones for Tracking Moving Targets , 1971, Nature.

[27]  Allan W. Snyder,et al.  Acuity of compound eyes: Physical limitations and design , 2004, Journal of comparative physiology.

[28]  S. Shaw Early visual processing in insects. , 1984, The Journal of experimental biology.

[29]  Roger C. Hardie,et al.  Feedback Network Controls Photoreceptor Output at the Layer of First Visual Synapses in Drosophila , 2006, The Journal of general physiology.

[30]  J. Lythgoe The Ecology of vision , 1979 .

[31]  David C. O'Carroll,et al.  Bio-inspired pixel-wise adaptive imaging , 2006, SPIE Micro + Nano Materials, Devices, and Applications.

[32]  V. Hateren,et al.  Processing of natural time series of intensities by the visual system of the blowfly , 1997, Vision Research.

[33]  Paul D. Barnett,et al.  Insect Detection of Small Targets Moving in Visual Clutter , 2006, PLoS biology.

[34]  M. Srinivasan,et al.  Spectral properties of movement perception in the dronefly Eristalis , 2004, Journal of Comparative Physiology A.

[35]  Simon B. Laughlin,et al.  The Role of Natural Image Statistics in Biological Motion Estimation , 2000, Biologically Motivated Computer Vision.

[36]  Martin Egelhaaf,et al.  On the neuronal basis of figure-ground discrimination by relative motion in the visual system of the fly , 1985, Biological Cybernetics.

[37]  David C. O'Carroll,et al.  Implementation of an elaborated neuromorphic model of a biological photoreceptor , 2008, Biological Cybernetics.

[38]  David O'Carroll,et al.  Feature-detecting neurons in dragonflies , 1993, Nature.

[39]  Terry Bossomaier,et al.  Vision: The theory of comparative eye design , 1991 .

[40]  M. F. LAND,et al.  Head Movement of Flies during Visually Guided Flight , 1973, Nature.

[41]  M. F. Land,et al.  Maps of the acute zones of fly eyes , 1985, Journal of Comparative Physiology A.

[42]  J. H. van Hateren,et al.  Pattern recognition in bees: orientation discrimination , 1990, Journal of Comparative Physiology A.

[43]  S. B. Laughlin,et al.  Angular sensitivity of the retinula cells of dark-adapted worker bee , 1971, Zeitschrift für vergleichende Physiologie.

[44]  Andrew Charles James,et al.  White-noise studies in the fly lamina , 1990 .

[45]  Rob R. de Ruyter van Steveninck,et al.  The metabolic cost of neural information , 1998, Nature Neuroscience.

[46]  Martin Egelhaaf On the neuronal basis of figure-ground discrimination by relative motion in the visual system of the fly. 2: Figure-dectection cells, a new class of visual interneurones , 1985 .

[47]  Simon B Laughlin,et al.  Neural images of pursuit targets in the photoreceptor arrays of male and female houseflies Musca domestica , 2003, Journal of Experimental Biology.

[48]  J. H. van Hateren,et al.  A theory of maximizing sensory information , 2004, Biological Cybernetics.

[49]  D.C. O'Carroll,et al.  Biologically Inspired Small Target Detection Mechanisms , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[50]  Michael J. Brownstein,et al.  Cloning and characterization of a vasopressin V2 receptor and possible link to nephrogenic diabetes insipidus , 1992, Nature.

[51]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH '08.

[52]  A. Hughes The Topography of Vision in Mammals of Contrasting Life Style: Comparative Optics and Retinal Organisation , 1977 .

[53]  T. Collett,et al.  Visual control of flight behaviour in the hoverflySyritta pipiens L. , 1975, Journal of comparative physiology.

[54]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[55]  A. Straw,et al.  A `bright zone' in male hoverfly (Eristalis tenax) eyes and associated faster motion detection and increased contrast sensitivity , 2006, Journal of Experimental Biology.

[56]  H. Wagner Flight Performance and Visual Control of Flight of the Free-Flying Housefly (Musca Domestica L.) III. Interactions Between Angular Movement Induced by Wide- and Smallfield Stimuli , 1986 .

[57]  S. Laughlin,et al.  Changes in the intensity-response function of an insect's photoreceptors due to light adaptation , 1981, Journal of comparative physiology.

[58]  David Yeates,et al.  The mating system of a bee fly (Diptera: Bombyliidae). I. Non-resource-based hilltop territoriality and a resource-based alternative , 1990, Journal of Insect Behavior.

[59]  Doekele G. Stavenga,et al.  Fly visual pigments difference in visual pigments of blowfly and dronefly peripheral retinula cells , 2004, Journal of comparative physiology.

[60]  Tomaso Poggio,et al.  Tracking and chasing in houseflies (Musca) , 1982, Biological Cybernetics.

[61]  S. Baccus Timing and computation in inner retinal circuitry. , 2007, Annual review of physiology.