Resource-efficient bio-inspired visual processing on the hexapod walking robot HECTOR

Emulating the highly resource-efficient processing of visual motion information in the brain of flying insects, a bio-inspired controller for collision avoidance and navigation was implemented on a novel, integrated System-on-Chip-based hardware module. The hardware module is used to control visually-guided navigation behavior of the stick insect-like hexapod robot HECTOR. By leveraging highly parallelized bio-inspired algorithms to extract nearness information from visual motion in dynamically reconfigurable logic, HECTOR is able to navigate to predefined goal positions without colliding with obstacles. The system drastically outperforms CPU- and graphics card-based implementations in terms of speed and resource efficiency, making it suitable to be also placed on fast moving robots, such as flying drones.

[1]  K. Hausen.  The Lobula-Complex of the Fly: Structure, Function and Significance in Visual Behaviour , 1984 .

[2]  Malte Schilling,et al.  Obstacle crossing of a real, compliant robot based on local evasion movements and averaging of stance heights using singular value decomposition , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[3]  M. Srinivasan,et al.  Spectral properties of movement perception in the dronefly Eristalis , 2004, Journal of Comparative Physiology A.

[4]  Brad L. Hutchings,et al.  Implementing high-performance, low-power FPGA-based optical flow accelerators in C , 2013, 2013 IEEE 24th International Conference on Application-Specific Systems, Architectures and Processors.

[5]  Martin Egelhaaf,et al.  Impact of stride-coupled gaze shifts of walking blowflies on the neuronal representation of visual targets , 2014, Front. Behav. Neurosci..

[6]  Ulrich Rückert,et al.  Resource-efficient Reconfigurable Computer-on-Module for Embedded Vision Applications , 2018, 2018 IEEE 29th International Conference on Application-specific Systems, Architectures and Processors (ASAP).

[7]  Roger C. Hardie,et al.  Common strategies for light adaptation in the peripheral visual systems of fly and dragonfly , 1978, Journal of comparative physiology.

[8]  Chelsea Sabo,et al.  A lightweight, inexpensive robotic system for insect vision. , 2017, Arthropod structure & development.

[9]  S. Laughlin.  Matching coding, circuits, cells, and molecules to signals: General principles of retinal design in the fly's eye , 1994, Progress in Retinal and Eye Research.

[10]  Roland Siegwart,et al.  A Toolbox for Easily Calibrating Omnidirectional Cameras , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  B. Hassenstein,et al.  Systemtheoretische Analyse der Zeit-, Reihenfolgen- und Vorzeichenauswertung bei der Bewegungsperzeption des Rüsselkäfers Chlorophanus , 1956 .

[12]  Martin Egelhaaf,et al.  Spatial vision in insects is facilitated by shaping the dynamics of visual input through behavioral action , 2012, Front. Neural Circuits.

[13]  Stéphane Viollet,et al.  AntBot: A six-legged walking robot able to home like desert ants in outdoor environments , 2019, Science Robotics.

[14]  Luis Montano,et al.  Real-time robot navigation in unstructured environments using a 3D laser rangefinder , 1997, Proceedings of the 1997 IEEE/RSJ International Conference on Intelligent Robot and Systems. Innovative Robotics for Real-World Applications. IROS '97.

[15]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[16]  A. Duchon,et al.  A Visual Equalization Strategy for Locomotor Control: Of Honeybees, Robots, and Humans , 2002, Psychological science.

[17]  James A. R. Marshall,et al.  A Model for an Angular Velocity-Tuned Motion Detector Accounting for Deviations in the Corridor-Centering Response of the Bee , 2016, PLoS Comput. Biol..

[18]  David E. James,et al.  Corrigendum: 14-3-3ζ regulates the mitochondrial respiratory reserve linked to platelet phosphatidylserine exposure and procoagulant function , 2017, Nature Communications.

[19]  Alexander Borst,et al.  Computational Neuroscience: a Comprehensive Approach , 2022 .

[20]  Peter Meyer,et al.  Sense and Antisense Transcripts of Convergent Gene Pairs in Arabidopsis thaliana Can Share a Common Polyadenylation Region , 2011, PloS one.

[21]  A. Borst.  Fly visual course control: behaviour, algorithms and circuits , 2014, Nature Reviews Neuroscience.

[22]  Nikil D. Dutt,et al.  A GPU-accelerated cortical neural network model for visually guided robot navigation , 2015, Neural Networks.

[23]  Martin Egelhaaf,et al.  Depth information in natural environments derived from optic flow by insect motion detection system: a model analysis , 2014, Front. Comput. Neurosci..

[24]  Holk Cruse,et al.  Grounding an internal body model of a hexapod walker control of curve walking in a biologically inspired robot , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Dario Floreano,et al.  Spatial Encoding of Translational Optic Flow in Planar Scenes by Elementary Motion Detector Arrays , 2018, Scientific Reports.

[26]  Martin Egelhaaf,et al.  A Bio-Inspired Model for Visual Collision Avoidance on a Hexapod Walking Robot , 2016, Living Machines.

[27]  J. P. Lindemann,et al.  Pattern-Dependent Response Modulations in Motion-Sensitive Visual Interneurons—A Model Study , 2011, PloS one.

[28]  Mandyam V Srinivasan,et al.  Honeybees as a model for the study of visually guided flight, navigation, and biologically inspired robotics. , 2011, Physiological reviews.

[29]  Kenro Miyamoto,et al.  Fish Eye Lens , 1964 .

[30]  M Egelhaaf,et al.  On the Computations Analyzing Natural Optic Flow: Quantitative Model Analysis of the Blowfly Motion Vision Pathway , 2005, The Journal of Neuroscience.

[31]  Mandyam V. Srinivasan,et al.  Comparison of Visually Guided Flight in Insects and Birds , 2018, Front. Neurosci..

[32]  Jinglin Li,et al.  Peripheral Processing Facilitates Optic Flow-Based Depth Perception , 2016, Front. Comput. Neurosci..

[33]  Roger D. Quinn,et al.  Binocular Vision Using Synthetic Nervous Systems , 2017, Living Machines.

[34]  Matt Bunting,et al.  Rapid Prototyping of Dmitri , a Hexapod Robot , 2014 .

[35]  Martin Egelhaaf,et al.  Motion as a source of environmental information: a fresh view on biological motion computation by insect brains , 2014, Front. Neural Circuits.

[36]  F. Ruffier,et al.  Optic flow-based collision-free strategies: From insects to robots. , 2017, Arthropod structure & development.

[37]  Martin Egelhaaf,et al.  A Bio-inspired Collision Avoidance Model Based on Spatial Information Derived from Motion Detectors Leads to Common Routes , 2015, PLoS Comput. Biol..

[38]  R. O. Uusitalo,et al.  Transfer of graded potentials at the photoreceptor-interneuron synapse , 1995, The Journal of general physiology.

[39]  Thierry Hoinville,et al.  Integrative Biomimetics of Autonomous Hexapedal Locomotion , 2019, Front. Neurorobot..

[40]  Ulrich Rückert,et al.  FPGA-based Generic Architecture for Rapid Prototyping of Video Hardware Accelerators using NoC AXI4-Stream Interconnect and GigE Vision Camera Interfaces , 2014 .

[41]  Jianfeng Feng,et al.  Computational neuroscience , 1986, Behavioral and Brain Sciences.

[42]  Svetha Venkatesh,et al.  From Insects to Robots , 1999, ISER.

[43]  Thierry Hoinville,et al.  Walknet, a bio-inspired controller for hexapod walking , 2013, Biological Cybernetics.

[44]  J. H. van Hateren,et al.  Modelling the Power Spectra of Natural Images: Statistics and Information , 1996, Vision Research.

[45]  Dario Floreano,et al.  Climbing favours the tripod gait over alternative faster insect gaits , 2017, Nature Communications.

[46]  Ulrich Rückert,et al.  Multi-Robot System Validation: From Simulation to Prototyping with Mini Robots in the Teleworkbench , 2012 .

[47]  Mario Porrmann,et al.  A Scalable Server Architecture for Next-Generation Heterogeneous Compute Clusters , 2014, 2014 12th IEEE International Conference on Embedded and Ubiquitous Computing.

[48]  Alexander Borst,et al.  Principles of visual motion detection , 1989, Trends in Neurosciences.

[49]  Thomas Kindermann,et al.  Walknet--a biologically inspired network to control six-legged walking , 1998, Neural Networks.