Multi-scopic neuro-cognitive adaptation for legged locomotion robots

Dynamic locomotion is realized through a simultaneous integration of adaptability and optimality. This article proposes a neuro-cognitive model for multi-legged locomotion robot that can seamlessly integrate multi-modal sensing, ecological perception, and cognition through the coordination of interoceptive and exteroceptive sensory information. Importantly, cognitive models can be discussed as micro-, meso-, and macro-scopic; these concepts correspond to sensing, perception, and cognition; and short-, medium-, and long-term adaptation (in terms of ecological psychology). The proposed neuro-cognitive model integrates these intelligent functions from a multi-scopic point of view. Macroscopic-level presents an attention mechanism with short-term adaptive locomotion control conducted by lower-level sensorimotor coordination-based model. Macrosopic-level serves environmental cognitive map featuring higher-level behavior planning. Mesoscopic level shows integration between the microscopic and macroscopic approaches, enabling the model to reconstruct a map and conduct localization using bottom-up facial environmental information and top-down map information, generating intention towards the ultimate goal at the macroscopic level. The experiments demonstrated that adaptability and optimality of multi-legged locomotion could be achieved using the proposed multi-scale neuro-cognitive model, from short to long-term adaptation, with efficient computational usage. Future research directions can be implemented not only in robotics contexts but also in the context of interdisciplinary studies incorporating cognitive science and ecological psychology.

[1]  Bernd Fritzke,et al.  Unsupervised clustering with growing cell structures , 1991, IJCNN-91-Seattle International Joint Conference on Neural Networks.

[2]  Stefan Leutenegger,et al.  Efficient Octree-Based Volumetric SLAM Supporting Signed-Distance and Occupancy Mapping , 2018, IEEE Robotics and Automation Letters.

[3]  Radu Bogdan Rusu,et al.  Semantic 3D Object Maps for Everyday Manipulation in Human Living Environments , 2010, KI - Künstliche Intelligenz.

[4]  Joachim Hertzberg,et al.  6D SLAM—3D mapping outdoor environments , 2007, J. Field Robotics.

[5]  J. M. Smith,et al.  Optimality theory in evolutionary biology , 1990, Nature.

[6]  Naoyuki Kubota,et al.  Neuro-Activity-Based Dynamic Path Planner for 3-D Rough Terrain , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[7]  Boris Jutzi,et al.  Feature relevance assessment for the semantic interpretation of 3D point cloud data , 2013 .

[8]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[9]  Naoyuki Kubota,et al.  Real-time 3D point cloud segmentation using Growing Neural Gas with Utility , 2016, 2016 9th International Conference on Human System Interactions (HSI).

[10]  Florentin Wörgötter,et al.  Neuromechanical control for hexapedal robot walking on challenging surfaces and surface classification , 2014, Robotics Auton. Syst..

[11]  James J. Gibson,et al.  The Ecological Approach to Visual Perception: Classic Edition , 2014 .

[12]  Bernd Fritzke,et al.  A Growing Neural Gas Network Learns Topologies , 1994, NIPS.

[13]  Paul Newman,et al.  Using laser range data for 3D SLAM in outdoor environments , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[14]  Kazunori Ohno,et al.  Real-Time Robot Trajectory Estimation and 3D Map Construction using 3D Camera , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Darwin G. Caldwell,et al.  Fast and Continuous Foothold Adaptation for Dynamic Locomotion Through CNNs , 2018, IEEE Robotics and Automation Letters.

[16]  Maren Bennewitz,et al.  Prediction Maps for Real-Time 3D Footstep Planning in Dynamic Environments , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[17]  Stefan Leutenegger,et al.  Learning Meshes for Dense Visual SLAM , 2019, 2019 IEEE/CVF International Conference on Computer Vision (ICCV).

[18]  Ioannis Havoutis,et al.  Contact Planning for the ANYmal Quadruped Robot using an Acyclic Reachability-Based Planner , 2019, TAROS.

[19]  Jean-Emmanuel Deschaud,et al.  IMLS-SLAM: Scan-to-Model Matching Based on 3D Data , 2018, 2018 IEEE International Conference on Robotics and Automation (ICRA).

[20]  Joaquim Salvi,et al.  The SLAM problem: a survey , 2008, CCIA.

[21]  Scott Kuindersma,et al.  An Architecture for Online Affordance‐based Perception and Whole‐body Planning , 2015, J. Field Robotics.

[22]  Josef Schmitz,et al.  HECTOR, a New Hexapod Robot Platform with Increased Mobility - Control Approach, Design and Communication , 2012 .

[23]  Minoru Asada,et al.  Adaptive Visual Servoing for Various Kinds of Robot Systems , 1997, ISER.

[24]  Qiang Huang,et al.  Gait Planning of Omnidirectional Walk on Inclined Ground for Biped Robots , 2016, IEEE Transactions on Systems, Man, and Cybernetics: Systems.

[25]  Piotr Skrzypczynski,et al.  On-Board Perception and Motion Planning for Legged Locomotion over Rough Terrain , 2011, ECMR.

[26]  Adam Schmidt,et al.  The Visual SLAM System for a Hexapod Robot , 2010, ICCVG.

[27]  Florentin Wörgötter,et al.  Synaptic plasticity in a recurrent neural network for versatile and adaptive behaviors of a walking robot , 2015, Front. Neurorobot..

[28]  J. J. Gibson The theory of affordances , 1977 .

[29]  Brett R. Fajen,et al.  Behavioral dynamics of steering, obstacle avoidance, and route selection. , 2003 .

[30]  A. Giuliani,et al.  Co-emergence and Collapse: The Mesoscopic Approach for Conceptualizing and Investigating the Functional Integration of Organisms , 2019, Front. Physiol..

[31]  M. Turvey Affordances and Prospective Control: An Outline of the Ontology , 1992 .

[32]  Pere Ridao,et al.  Inspection of an underwater structure using point‐cloud SLAM with an AUV and a laser scanner , 2019, J. Field Robotics.

[33]  Naoyuki Kubota,et al.  Centered learning model in omni-directional controller of neural oscillator based biped locomotion , 2017, 2017 IEEE Symposium Series on Computational Intelligence (SSCI).

[34]  Marco Hutter,et al.  Perceptive Locomotion in Rough Terrain – Online Foothold Optimization , 2020, IEEE Robotics and Automation Letters.

[35]  Ming Zeng,et al.  Octree-based fusion for realtime 3D reconstruction , 2013, Graph. Model..

[36]  Scott Kuindersma,et al.  Optimization-based locomotion planning, estimation, and control design for the atlas humanoid robot , 2015, Autonomous Robots.

[37]  Michael T. Turvey,et al.  Ecological Psychology: Six Principles for an Embodied–Embedded Approach to Behavior , 2008 .

[38]  Wolfram Burgard,et al.  OctoMap: an efficient probabilistic 3D mapping framework based on octrees , 2013, Autonomous Robots.

[39]  Joonho Lee,et al.  DeepGait: Planning and Control of Quadrupedal Gaits Using Deep Reinforcement Learning , 2020, IEEE Robotics and Automation Letters.

[40]  Thierry Hoinville,et al.  Walknet, a bio-inspired controller for hexapod walking , 2013, Biological Cybernetics.

[41]  Bernard Girau,et al.  Perception-driven adaptive CPG-based locomotion for hexapod robots , 2015, Neurocomputing.

[42]  John Guckenheimer,et al.  The Dynamics of Legged Locomotion: Models, Analyses, and Challenges , 2006, SIAM Rev..