Properties of neuronal facilitation that improve target tracking in natural pursuit simulations

Although flying insects have limited visual acuity (approx. 1°) and relatively small brains, many species pursue tiny targets against cluttered backgrounds with high success. Our previous computational model, inspired by electrophysiological recordings from insect ‘small target motion detector’ (STMD) neurons, did not account for several key properties described from the biological system. These include the recent observations of response ‘facilitation’ (a slow build-up of response to targets that move on long, continuous trajectories) and ‘selective attention’, a competitive mechanism that selects one target from alternatives. Here, we present an elaborated STMD-inspired model, implemented in a closed loop target-tracking system that uses an active saccadic gaze fixation strategy inspired by insect pursuit. We test this system against heavily cluttered natural scenes. Inclusion of facilitation not only substantially improves success for even short-duration pursuits, but it also enhances the ability to ‘attend’ to one target in the presence of distracters. Our model predicts optimal facilitation parameters that are static in space and dynamic in time, changing with respect to the amount of background clutter and the intended purpose of the pursuit. Our results provide insights into insect neurophysiology and show the potential of this algorithm for implementation in artificial visual systems and robotic applications.

[1]  Magnús Snorrason,et al.  An Image Metric-Based ATR Performance Prediction Testbed , 2006, AIPR.

[2]  David O'Carroll,et al.  Feature-detecting neurons in dragonflies , 1993, Nature.

[3]  M. Land Motion and vision: why animals move their eyes , 1999, Journal of Comparative Physiology A.

[4]  D. Stavenga Angular and spectral sensitivity of fly photoreceptors. I. Integrated facet lens and rhabdomere optics , 2002, Journal of Comparative Physiology A.

[5]  Patrick A. Shoemaker,et al.  A Model for the Detection of Moving Targets in Visual Clutter Inspired by Insect Physiology , 2008, PloS one.

[6]  David C O'Carroll,et al.  Discrimination of Features in Natural Scenes by a Dragonfly Neuron , 2011, The Journal of Neuroscience.

[7]  R. Olberg,et al.  Prey pursuit and interception in dragonflies , 2000, Journal of Comparative Physiology A.

[8]  P. Simmons,et al.  Orthopteran DCMD neuron: a reevaluation of responses to moving objects. I. Selective responses to approaching objects. , 1992, Journal of neurophysiology.

[9]  David C O'Carroll,et al.  Correlation between OFF and ON Channels Underlies Dark Target Selectivity in an Insect Visual System , 2013, The Journal of Neuroscience.

[10]  D. Osorio Mechanisms of early visual processing in the medulla of the locust optic lobe: How self-inhibition, spatial-pooling, and signal rectification contribute to the properties of transient cells , 1991, Visual Neuroscience.

[11]  Naresh K. Sinha,et al.  Modern Control Systems , 1981, IEEE Transactions on Systems, Man, and Cybernetics.

[12]  David C. O'Carroll,et al.  Discrete implementation of biologically inspired image processing for target detection , 2011, 2011 Seventh International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[13]  J. H. van Hateren,et al.  Fast temporal adaptation of on-off units in the first optic chiasm of the blowfly , 2004, Journal of Comparative Physiology A.

[14]  T. Collett,et al.  Chasing behaviour of houseflies (Fannia canicularis) , 1974, Journal of comparative physiology.

[15]  Anthony Leonardo,et al.  Internal models direct dragonfly interception steering , 2014, Nature.

[16]  Steven D. Wiederman,et al.  Selective Attention in an Insect Visual Neuron , 2013, Current Biology.

[17]  Anna C. Nobre,et al.  Synergistic Effect of Combined Temporal and Spatial Expectations on Visual Attention , 2005, The Journal of Neuroscience.

[18]  Andrew Charles James,et al.  White-noise studies in the fly lamina , 1990 .

[19]  Michael I. Jordan,et al.  An internal model for sensorimotor integration. , 1995, Science.

[20]  Katsuhiko Ogata,et al.  Modern Control Engineering , 1970 .

[21]  Liza Gross Charting the Spread of Salmonella Infection , 2006, PLoS biology.

[22]  Daniel Schmitt,et al.  Whole Body Mechanics of Stealthy Walking in Cats , 2008, PloS one.

[23]  Bart R. H. Geurten,et al.  Neural mechanisms underlying target detection in a dragonfly centrifugal neuron , 2007, Journal of Experimental Biology.

[24]  P. Corbet Dragonflies: Behavior and Ecology of Odonata , 1999 .

[25]  David C. O'Carroll,et al.  Retinotopic Organization of Small-Field-Target-Detecting Neurons in the Insect Visual System , 2007, Current Biology.

[26]  Tomaso Poggio,et al.  Tracking and chasing in houseflies (Musca) , 1982, Biological Cybernetics.

[27]  G. Woodward Dragonflies: Behaviour and Ecology of Odonata , 2001 .

[28]  Hateren,et al.  Blowfly flight and optic flow. I. Thorax kinematics and flight dynamics , 1999, The Journal of experimental biology.

[29]  Patrick A. Shoemaker,et al.  Facilitation of dragonfly target-detecting neurons by slow moving features on continuous paths , 2012, Front. Neural Circuits.

[30]  Karin Nordström,et al.  Feature detection and the hypercomplex property in insects , 2009, Trends in Neurosciences.

[31]  D J Field,et al.  Relations between the statistics of natural images and the response properties of cortical cells. , 1987, Journal of the Optical Society of America. A, Optics and image science.

[32]  Steven D. Wiederman,et al.  Biomimetic target detection: Modeling 2nd order correlation of OFF and ON channels , 2013, 2013 IEEE Symposium on Computational Intelligence for Multimedia, Signal and Vision Processing (CIMSIVP).

[33]  A. Straw,et al.  A `bright zone' in male hoverfly (Eristalis tenax) eyes and associated faster motion detection and increased contrast sensitivity , 2006, Journal of Experimental Biology.

[34]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[35]  Paul D. Barnett,et al.  Insect Detection of Small Targets Moving in Visual Clutter , 2006, PLoS biology.

[36]  David C. O'Carroll,et al.  Contrast sensitivity and the detection of moving patterns and features , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[37]  David C. O'Carroll,et al.  Robust Models for Optic Flow Coding in Natural Scenes Inspired by Insect Biology , 2009, PLoS Comput. Biol..

[38]  S. Luck,et al.  A Common Neural Mechanism for Preventing and Terminating the Allocation of Attention , 2012, The Journal of Neuroscience.

[39]  R O Dror,et al.  Accuracy of velocity estimation by Reichardt correlators. , 2001, Journal of the Optical Society of America. A, Optics, image science, and vision.

[40]  M. Goldberg,et al.  Activity in the Lateral Intraparietal Area Predicts the Goal and Latency of Saccades in a Free-Viewing Visual Search Task , 2006, The Journal of Neuroscience.

[41]  M. Srinivasan,et al.  Spectral properties of movement perception in the dronefly Eristalis , 2004, Journal of Comparative Physiology A.

[42]  PoggioTomaso,et al.  Tracking and chasing in houseflies (Musca) , 1982 .

[43]  Karin Nordström,et al.  Small object detection neurons in female hoverflies , 2006, Proceedings of the Royal Society B: Biological Sciences.

[44]  David C. O'Carroll,et al.  Spatial facilitation by a high-performance dragonfly target-detecting neuron , 2011, Biology Letters.

[45]  Patrick A. Shoemaker,et al.  Modelling the temporal response properties of an insect small target motion detector , 2011, 2011 Seventh International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[46]  F. Rind,et al.  Neural network based on the input organization of an identified neuron signaling impending collision. , 1996, Journal of neurophysiology.