Bootstrapped Neuro-Simulation for complex robots

Abstract Robotic simulators are often used to speed up the Evolutionary Robotics (ER) process. Most simulation approaches are based on physics modelling. However, physics-based simulators can become complex to develop and require prior knowledge of the robotic system. Robotics simulators can be constructed using Machine Learning techniques, such as Artificial Neural Networks (ANNs). ANN-based simulator development usually requires a lengthy behavioural data collection period before the simulator can be trained and used to evaluate controllers during the ER process. The Bootstrapped Neuro-Simulation (BNS) approach can be used to simultaneously collect behavioural data, train an ANN-based simulator and evolve controllers for a particular robotic problem. This paper investigates proposed improvements to the BNS approach and demonstrates the viability of the approach by optimising gait controllers for a Hexapod and Snake robot platform.

[1]  Mathys C. du Plessis,et al.  Robotic snake simulation using ensembles of artificial neural networks in evolutionary robotics , 2018, GECCO.

[2]  Javier Ruiz-del-Solar,et al.  Combining Simulation and Reality in Evolutionary Robotics , 2007, J. Intell. Robotic Syst..

[3]  Satoshi Murata,et al.  Self-reconfigurable robots , 2007, IEEE Robotics & Automation Magazine.

[4]  Josephine Griffith,et al.  Identifying the Reality Gap Between Abstract and Realistic Models Using Evolved Agents and Simulated Kilobots , 2018, 2018 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[5]  Kamilo Melo,et al.  Indoor and outdoor parametrized gait execution with modular snake robots , 2012, 2012 IEEE International Conference on Robotics and Automation.

[6]  Monica Hernandez,et al.  Parameterized space conditions for the definition of locomotion modes in modular snake robots , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[7]  Mathys C. du Plessis,et al.  Complex Morphology Neural Network Simulation in Evolutionary Robotics , 2020, Robotica.

[8]  Mathys C. du Plessis,et al.  Neuroevolution of Inverted Pendulum Control: A Comparative Study of Simulation Techniques , 2017, J. Intell. Robotic Syst..

[9]  Mathys C. du Plessis,et al.  A comparison of neural networks and physics models as motion simulators for simple robotic evolution , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[10]  Antoine Cully,et al.  Robots that can adapt like animals , 2014, Nature.

[11]  Mathys C. du Plessis,et al.  Evolutionary Robotics Applied to Hexapod Locomotion: a Comparative Study of Simulation Techniques , 2019, J. Intell. Robotic Syst..

[12]  Stefano Nolfi,et al.  Evolving Mobile Robots in Simulated and Real Environments , 1995, Artificial Life.

[13]  Hitoshi Iba,et al.  Evolutionary construction of a simulator for real robots , 2004, Proceedings of the 2004 Congress on Evolutionary Computation (IEEE Cat. No.04TH8753).

[14]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[15]  Francesco Mondada,et al.  Automatic creation of an autonomous agent: genetic evolution of a neural-network driven robot , 1994 .

[16]  ChiKit Au,et al.  Investigation of serpentine gait of a snake robot with a wireless camera , 2016, 2016 12th IEEE/ASME International Conference on Mechatronic and Embedded Systems and Applications (MESA).

[17]  Jean-Baptiste Mouret,et al.  20 years of reality gap: a few thoughts about simulators in evolutionary robotics , 2017, GECCO.

[18]  Stefano Nolfi,et al.  Evolutionary Robotics: The Biology, Intelligence, and Technology of Self-Organizing Machines , 2000 .

[19]  Antoine Cully,et al.  Abstract of: "Fast Damage Recovery in Robotics with the T-Resilience Algorithm" , 2018, ALIFE.

[20]  Mathys C. du Plessis,et al.  Concurrent controller and Simulator Neural Network development for a differentially-steered robot in Evolutionary Robotics , 2016, Robotics Auton. Syst..

[21]  Charmain Cilliers,et al.  Simulating Robots Without Conventional Physics: A Neural Network Approach , 2013, J. Intell. Robotic Syst..

[22]  Mathys C. du Plessis,et al.  Bootstrapped Neuro-Simulation as a method of concurrent neuro-evolution and damage recovery , 2020, Robotics Auton. Syst..

[23]  Mathys C. du Plessis,et al.  Concurrent controller and Simulator Neural Network development for a snake-like robot in Evolutionary Robotics , 2017, Robotics Auton. Syst..

[24]  Stéphane Doncieux,et al.  The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics , 2013, IEEE Transactions on Evolutionary Computation.

[25]  Inman Harvey,et al.  Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics , 1995, ECAL.

[26]  Alireza Akbarzadeh,et al.  Development of a new spinning gait for a planar snake robot using central pattern generators , 2013, Intelligent Service Robotics.

[27]  Piotr Skrzypczynski,et al.  A biologically inspired approach to feasible gait learning for a hexapod robot , 2010, Int. J. Appl. Math. Comput. Sci..

[28]  Owen Holland,et al.  Coevolutionary Modelling of a Miniature Rotorcraft. , 2008 .

[29]  Gary B. Parker,et al.  Punctuated anytime learning for hexapod gait generation , 2002, IEEE/RSJ International Conference on Intelligent Robots and Systems.