A Nonlinear Observability Analysis of Ambient Wind Estimation with Uncalibrated Sensors, Inspired by Insect Neural Encoding

Estimating the direction of ambient fluid flow is key for many flying or swimming animals and robots, but can only be accomplished through indirect measurements and active control. Recent work with tethered flying insects indicates that their sensory representation of orientation, apparent flow, direction of movement, and control is represented by a 2-dimensional angular encoding in the central brain. This representation simplifies sensory integration by projecting the direction (but not scale) of measurements with different units onto a universal polar coordinate frame. To align these angular measurements with one another and the motor system does, however, require a calibration of angular gain and offset for each sensor. This calibration could change with time due to changes in the environment or physical structure. The circumstances under which small robots and animals with angular sensors and changing calibrations could self-calibrate and estimate the direction of ambient fluid flow while moving remains an open question. Here, a methodical nonlinear observability analysis is presented to address this. The analysis shows that it is mathematically feasible to continuously estimate flow direction and perform regular self-calibrations by adopting frequent changes in course (or active prevention thereof) and orientation, and requires fusion and temporal differentiation of three sensory measurements: apparent flow, orientation (or its derivative), and direction of motion (or its derivative). These conclusions are consistent with the zigzagging trajectories exhibited by many plume tracking organisms, suggesting that perhaps flow estimation is a secondary driver of their trajectory structure.

[1]  A. French,et al.  The effects of temperature on mechanotransduction in the cockroach tactile spine , 1982, Journal of comparative physiology.

[2]  Rudolph van der Merwe,et al.  The square-root unscented Kalman filter for state and parameter-estimation , 2001, 2001 IEEE International Conference on Acoustics, Speech, and Signal Processing. Proceedings (Cat. No.01CH37221).

[3]  Michael Dickinson,et al.  Algorithms for Olfactory Search across Species , 2018, The Journal of Neuroscience.

[4]  Roger D. Quinn,et al.  Egomotion estimation with optic flow and air velocity sensors , 2011, Biological Cybernetics.

[5]  Johannes D. Seelig,et al.  Neural dynamics for landmark orientation and angular path integration , 2015, Nature.

[6]  Nicolas H. Franceschini,et al.  Small Brains, Smart Machines: From Fly Vision to Robot Vision and Back Again , 2014, Proceedings of the IEEE.

[7]  Michael H Dickinson,et al.  The visual control of landing and obstacle avoidance in the fruit fly Drosophila melanogaster , 2012, Journal of Experimental Biology.

[8]  H. Krapp,et al.  Visuomotor Transformation in the Fly Gaze Stabilization System , 2008, PLoS biology.

[9]  M. Dickinson,et al.  Visual Control of Altitude in Flying Drosophila , 2010, Current Biology.

[10]  Dave Zachariah,et al.  Self-motion and wind velocity estimation for small-scale UAVs , 2011, 2011 IEEE International Conference on Robotics and Automation.

[11]  Dario Floreano,et al.  Vision-based control of near-obstacle flight , 2009, Auton. Robots.

[12]  Michael H Dickinson,et al.  Visual stimulation of saccades in magnetically tethered Drosophila , 2006, Journal of Experimental Biology.

[13]  Sanjay P Sane,et al.  Airflow and optic flow mediate antennal positioning in flying honeybees , 2016, eLife.

[14]  Andrew M. M. Matheson,et al.  Encoding and control of orientation to airflow by a set of Drosophila fan-shaped body neurons , 2020, eLife.

[15]  Sertac Karaman,et al.  FastDepth: Fast Monocular Depth Estimation on Embedded Systems , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[16]  Marie P. Suver,et al.  Encoding of Wind Direction by Central Neurons in Drosophila , 2018, Neuron.

[17]  S. Laughlin,et al.  Insect motion detectors matched to visual ecology , 1996, Nature.

[18]  Peter T Weir,et al.  Central complex neurons exhibit behaviorally gated responses to visual motion in Drosophila. , 2014, Journal of neurophysiology.

[19]  J. Pringle The gyroscopic mechanism of the halteres of Diptera , 1948, Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences.

[20]  Arjan van der Schaft,et al.  Non-linear dynamical control systems , 1990 .

[21]  L. Abbott,et al.  A neuronal circuit for vector computation builds an allocentric traveling-direction signal in the Drosophila fan-shaped body , 2020, bioRxiv.

[22]  R. Strauss,et al.  Drosophila Acquires a Long-Lasting Body-Size Memory from Visual Feedback , 2019, Current Biology.

[23]  Sawyer Buckminster Fuller,et al.  A bio-hybrid odor-guided autonomous palm-sized air vehicle , 2020, Bioinspiration & biomimetics.

[24]  J. Kennedy The Visual Responses of Flying Mosquitoes. , 2009 .

[25]  Thomas R Clandinin,et al.  Elementary Motion Detection in Drosophila: Algorithms and Mechanisms. , 2018, Annual review of vision science.

[26]  Kristi Morgansen,et al.  Monocular distance estimation from optic flow during active landing maneuvers , 2014, Bioinspiration & biomimetics.

[27]  Hector D. Escobar-Alvarez,et al.  Autonomous Bio-Inspired Small-Object Detection and Avoidance , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[28]  Michael H. Dickinson,et al.  Flies Regulate Wing Motion via Active Control of a Dual-Function Gyroscope , 2019, Current Biology.

[29]  Sawyer B. Fuller,et al.  A Device for Rapid, Automated Trimming of Insect-Sized Flying Robots , 2020, IEEE Robotics and Automation Letters.

[30]  A. Krener,et al.  Nonlinear controllability and observability , 1977 .

[31]  Mark A. Frye,et al.  Drosophila Spatiotemporally Integrates Visual Signals to Control Saccades , 2017, Current Biology.

[32]  Michael H. Dickinson,et al.  Sun Navigation Requires Compass Neurons in Drosophila , 2018, Current Biology.

[33]  Mark A. Willis,et al.  Odor tracking flight of male Manduca sexta moths along plumes of different cross-sectional area , 2013, Journal of Comparative Physiology A.

[34]  P. Reinhall,et al.  Coriolis and centrifugal forces drive haltere deformations and influence spike timing , 2019, Journal of the Royal Society Interface.

[35]  R. Cartar,et al.  What causes wing wear in foraging bumble bees? , 2011, Journal of Experimental Biology.

[36]  Rachel I. Wilson,et al.  A Neural Network for Wind-Guided Compass Navigation , 2020, Neuron.

[37]  Ralf Dresner,et al.  Spatial Orientation The Spatial Control Of Behavior In Animals And Man , 2016 .

[38]  M. Dickinson,et al.  Active flight increases the gain of visual motion processing in Drosophila , 2010, Nature Neuroscience.

[39]  F. V. Breugel,et al.  Upwind Detection of Ambient Wind Using Biomimetic Antenna Sensors for Aerial Vehicles through Active Sensing , 2020, AIAA AVIATION 2020 FORUM.

[40]  Andy R. Terrel,et al.  SymPy: Symbolic computing in Python , 2017, PeerJ Prepr..

[41]  R. Cardé,et al.  Navigational Strategies Used by Insects to Find Distant, Wind-Borne Sources of Odor , 2008, Journal of Chemical Ecology.

[42]  S. Laughlin,et al.  Temperature and the temporal resolving power of fly photoreceptors , 2000, Journal of Comparative Physiology A.

[43]  S. Sane,et al.  Antennal Mechanosensors Mediate Flight Control in Moths , 2007, Science.

[44]  Michael H. Dickinson,et al.  Plume-Tracking Behavior of Flying Drosophila Emerges from a Set of Distinct Sensory-Motor Reflexes , 2014, Current Biology.

[45]  Gaby Maimon,et al.  A neural circuit architecture for angular integration in Drosophila , 2017, Nature.