Bio-inspired target detection in natural scenes: optimal thresholds and ego-motion

We have developed a numerical model of Small Target Motion Detector neurons, bio-inspired from electrophysiological experiments in the fly brain. These neurons respond selectively to small moving features within complex moving surrounds. Interestingly, these cells still respond robustly when the targets are embedded in the background, without relative motion cues. This model contains representations of neural elements along a proposed pathway to the target-detecting neuron and the resultant processing enhances target discrimination in moving scenes. The model encodes high dynamic range luminance values from natural images (via adaptive photoreceptor encoding) and then shapes the transient signals required for target discrimination (via adaptive spatiotemporal high-pass filtering). Following this, a model for Rectifying Transient Cells implements a nonlinear facilitation between rapidly adapting, and independent polarity contrast channels (an 'on' and an 'off' pathway) each with center-surround antagonism. The recombination of the channels results in increased discrimination of small targets, of approximately the size of a single pixel, without the need for relative motion cues. This method of feature discrimination contrasts with traditional target and background motion-field computations. We improve the target-detecting output with inhibition from correlation-type motion detectors, using a form of antagonism between our feature correlator and the more typical motion correlator. We also observe that a changing optimal threshold is highly correlated to the value of observer ego-motion. We present an elaborated target detection model that allows for implementation of a static optimal threshold, by scaling the target discrimination mechanism with a model-derived velocity estimation of ego-motion.

[1]  David C. O'Carroll,et al.  Retinotopic Organization of Small-Field-Target-Detecting Neurons in the Insect Visual System , 2007, Current Biology.

[2]  N. Strausfeld,et al.  Some Quantitative Aspects of the Fly’s Brain , 1976 .

[3]  M. Srinivasan,et al.  Spectral properties of movement perception in the dronefly Eristalis , 2004, Journal of Comparative Physiology A.

[4]  David C. O'Carroll,et al.  Bio-inspired pixel-wise adaptive imaging , 2006, SPIE Micro + Nano Materials, Devices, and Applications.

[5]  Charles M. Higgins,et al.  An elaborated model of fly small-target tracking , 2004, Biological Cybernetics.

[6]  Lambert E. Wixson,et al.  Detecting salient motion by accumulating directionally-consistent flow , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  S. Laughlin,et al.  Predictive coding: a fresh view of inhibition in the retina , 1982, Proceedings of the Royal Society of London. Series B. Biological Sciences.

[8]  J. H. van Hateren,et al.  Fast temporal adaptation of on-off units in the first optic chiasm of the blowfly , 2004, Journal of Comparative Physiology A.

[9]  Robert A. Harris,et al.  Adaptation and the temporal delay filter of fly motion detectors , 1999, Vision Research.

[10]  N. Strausfeld,et al.  Anatomical organization of retinotopic motion‐sensitive pathways in the optic lobes of flies , 2003, Microscopy research and technique.

[11]  Karin Nordström,et al.  Small object detection neurons in female hoverflies , 2006, Proceedings of the Royal Society B: Biological Sciences.

[12]  D.C. O'Carroll,et al.  Biologically Inspired Small Target Detection Mechanisms , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[13]  E H Adelson,et al.  Spatiotemporal energy models for the perception of motion. , 1985, Journal of the Optical Society of America. A, Optics and image science.

[14]  Tae-hun Kim,et al.  Salient Motion Information Detection Technique Using Weighted Subtraction Image and Motion Vector , 2006, 2006 International Conference on Hybrid Information Technology.

[15]  Alexander Borst,et al.  Mechanisms of dendritic integration underlying gain control in fly motion-sensitive interneurons , 1995, Journal of Computational Neuroscience.

[16]  A. Borst,et al.  A look into the cockpit of the fly: visual orientation, algorithms, and identified neurons , 1993, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[17]  Eng-Leng Mah,et al.  Bio-inspired analog circuitry model of insect photoreceptor cells , 2006, SPIE Micro + Nano Materials, Devices, and Applications.

[18]  R.S.A. Brinkworth,et al.  Biomimetic Motion Detection , 2007, 2007 3rd International Conference on Intelligent Sensors, Sensor Networks and Information.

[19]  C. Wehrhahn,et al.  Sex-specific differences in the chasing behaviour of houseflies (Musca) , 1979, Biological Cybernetics.

[20]  C. W. G Clifford,et al.  Fundamental mechanisms of visual motion detection: models, cells and functions , 2002, Progress in Neurobiology.

[21]  Paul D. Barnett,et al.  Insect Detection of Small Targets Moving in Visual Clutter , 2006, PLoS biology.

[22]  T. Collett,et al.  Visual control of flight behaviour in the hoverflySyritta pipiens L. , 1975, Journal of comparative physiology.

[23]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[24]  A. Straw,et al.  A `bright zone' in male hoverfly (Eristalis tenax) eyes and associated faster motion detection and increased contrast sensitivity , 2006, Journal of Experimental Biology.

[25]  Paul D. Barnett,et al.  Sexual Dimorphism in the Hoverfly Motion Vision Pathway , 2008, Current Biology.

[26]  Steven S. Beauchemin,et al.  The computation of optical flow , 1995, CSUR.

[27]  Simon B. Laughlin,et al.  The Role of Natural Image Statistics in Biological Motion Estimation , 2000, Biologically Motivated Computer Vision.

[28]  R. O. Uusitalo,et al.  Transfer of graded potentials at the photoreceptor-interneuron synapse , 1995, The Journal of general physiology.

[29]  M. Egelhaaf On the neuronal basis of figure-ground discrimination by relative motion in the visual system of the fly , 1985 .

[30]  Accepted June,et al.  Are the large monopolar cells of the insect lamina on the optomotor pathway , 1989 .

[31]  A Borst,et al.  Fly motion vision is based on Reichardt detectors regardless of the signal-to-noise ratio. , 2004, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Patrick A. Shoemaker,et al.  A Model for the Detection of Moving Targets in Visual Clutter Inspired by Insect Physiology , 2008, PloS one.

[33]  J. Hanley,et al.  The meaning and use of the area under a receiver operating characteristic (ROC) curve. , 1982, Radiology.

[34]  K Hausen,et al.  Decoding of retinal image flow in insects. , 1993, Reviews of oculomotor research.

[35]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[36]  J. H. Hateren,et al.  Information theoretical evaluation of parametric models of gain control in blowfly photoreceptor cells , 2001, Vision Research.

[37]  Eng-Leng Mah,et al.  Photoreceptor processing improves salience facilitating small target detection in cluttered scenes. , 2008, Journal of vision.

[38]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[39]  Patrick A. Shoemaker,et al.  Velocity constancy and models for wide-field visual motion detection in insects , 2005, Biological Cybernetics.

[40]  Peng Tang,et al.  Salient Moving Object Detection Using Stochastic Approach Filtering , 2007, Fourth International Conference on Image and Graphics (ICIG 2007).

[41]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[42]  M. Ibbotson,et al.  An adaptive Reichardt detector model of motion adaptation in insects and mammals , 1997, Visual Neuroscience.

[43]  M. Egelhaaf On the neuronal basis of figure-ground discrimination by relative motion in the visual system of the fly , 1985 .

[44]  D. Stavenga Angular and spectral sensitivity of fly photoreceptors. I. Integrated facet lens and rhabdomere optics , 2002, Journal of Comparative Physiology A.

[45]  M. Srinivasan,et al.  Visual figure–ground discrimination in the honeybee: the role of motion parallax at boundaries , 1990, Proceedings of the Royal Society of London. B. Biological Sciences.

[46]  A. Borst,et al.  Neural circuit tuning fly visual interneurons to motion of small objects. I. Dissection of the circuit by pharmacological and photoinactivation techniques. , 1993, Journal of neurophysiology.