Robustness and Real-Time Performance of an Insect Inspired Target Tracking Algorithm Under Natural Conditions

Many computer vision tasks require the implementation of robust and efficient target tracking algorithms. Furthermore, in robotic applications these algorithms must perform whilst on a moving platform (ego motion). Despite the increase in computational processing power, many engineering algorithms are still challenged by real-time applications. In contrast, lightweight and low-power flying insects, such as dragonflies, can readily chase prey and mates within cluttered natural environments, deftly selecting their target amidst distractors (swarms). In our laboratory, we record from 'target-detecting' neurons in the dragonfly brain that underlie this pursuit behavior. We recently developed a closed-loop target detection and tracking algorithm based on key properties of these neurons. Here we test our insect-inspired tracking model in open-loop against a set of naturalistic sequences and compare its efficacy and efficiency with other state-of-the-art engineering models. In terms of tracking robustness, our model performs similarly to many of these trackers, yet is at least 3 times more efficient in terms of processing speed.

[1]  R. Brinkworth,et al.  Bio-inspired small target discrimination in high dynamic range natural scenes , 2008, 2008 3rd International Conference on Bio-Inspired Computing: Theories and Applications.

[2]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Li Bai,et al.  Minimum error bounded efficient ℓ1 tracker with occlusion detection , 2011, CVPR 2011.

[4]  Rui Caseiro,et al.  Exploiting the Circulant Structure of Tracking-by-Detection with Kernels , 2012, ECCV.

[5]  Patrick A. Shoemaker,et al.  A Model for the Detection of Moving Targets in Visual Clutter Inspired by Insect Physiology , 2008, PloS one.

[6]  Steven Grainger,et al.  Properties of neuronal facilitation that improve target tracking in natural pursuit simulations , 2015, Journal of The Royal Society Interface.

[7]  Ming-Hsuan Yang,et al.  Incremental Learning for Robust Visual Tracking , 2008, International Journal of Computer Vision.

[8]  A. Straw,et al.  A `bright zone' in male hoverfly (Eristalis tenax) eyes and associated faster motion detection and increased contrast sensitivity , 2006, Journal of Experimental Biology.

[9]  M. Srinivasan,et al.  Spectral properties of movement perception in the dronefly Eristalis , 2004, Journal of Comparative Physiology A.

[10]  J. H. van Hateren,et al.  Fast temporal adaptation of on-off units in the first optic chiasm of the blowfly , 2004, Journal of Comparative Physiology A.

[11]  P ? ? ? ? ? ? ? % ? ? ? ? , 1991 .

[12]  Yi Wu,et al.  Online Object Tracking: A Benchmark , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  G. Woodward Dragonflies: Behaviour and Ecology of Odonata , 2001 .

[14]  Steven D. Wiederman,et al.  Selective Attention in an Insect Visual Neuron , 2013, Current Biology.

[15]  Patrick A. Shoemaker,et al.  Facilitation of dragonfly target-detecting neurons by slow moving features on continuous paths , 2012, Front. Neural Circuits.

[16]  Dima Damen,et al.  Recognizing linked events: Searching the space of feasible explanations , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  David C. O'Carroll,et al.  Performance assessment of an insect-inspired target tracking model in background clutter , 2014, 2014 13th International Conference on Control Automation Robotics & Vision (ICARCV).

[18]  P. Corbet Dragonflies: Behavior and Ecology of Odonata , 1999 .

[19]  Karin Nordström,et al.  Feature detection and the hypercomplex property in insects , 2009, Trends in Neurosciences.

[20]  D. Stavenga Angular and spectral sensitivity of fly photoreceptors. I. Integrated facet lens and rhabdomere optics , 2002, Journal of Comparative Physiology A.

[21]  David O'Carroll,et al.  Feature-detecting neurons in dragonflies , 1993, Nature.

[22]  David C. O'Carroll,et al.  Discrete implementation of biologically inspired image processing for target detection , 2011, 2011 Seventh International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[23]  Paul D. Barnett,et al.  Insect Detection of Small Targets Moving in Visual Clutter , 2006, PLoS biology.

[24]  David C. O'Carroll,et al.  Contrast sensitivity and the detection of moving patterns and features , 2014, Philosophical Transactions of the Royal Society B: Biological Sciences.

[25]  David C O'Carroll,et al.  Correlation between OFF and ON Channels Underlies Dark Target Selectivity in an Insect Visual System , 2013, The Journal of Neuroscience.

[26]  D. Osorio Mechanisms of early visual processing in the medulla of the locust optic lobe: How self-inhibition, spatial-pooling, and signal rectification contribute to the properties of transient cells , 1991, Visual Neuroscience.

[27]  Lei Zhang,et al.  Real-Time Compressive Tracking , 2012, ECCV.

[28]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[30]  Ming-Hsuan Yang,et al.  Robust Object Tracking with Online Multiple Instance Learning , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  David C. O'Carroll,et al.  Bio-inspired feature extraction and enhancement of targets moving against visual clutter during closed loop pursuit , 2013, 2013 IEEE International Conference on Image Processing.

[32]  David C. O'Carroll,et al.  A Biologically Inspired Facilitation Mechanism Enhances the Detection and Pursuit of Targets of Varying Contrast , 2014, 2014 International Conference on Digital Image Computing: Techniques and Applications (DICTA).

[33]  Patrick A. Shoemaker,et al.  Modelling the temporal response properties of an insect small target motion detector , 2011, 2011 Seventh International Conference on Intelligent Sensors, Sensor Networks and Information Processing.

[34]  Shai Avidan,et al.  Locally Orderless Tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[35]  Huchuan Lu,et al.  Superpixel tracking , 2011, 2011 International Conference on Computer Vision.