Concurrent controller and Simulator Neural Network development for a differentially-steered robot in Evolutionary Robotics

Evolutionary Robotics (ER) strives for the automatic creation of robotic controllers and morphologies. The ER process is normally performed in simulation in order to reduce the time required and robot wear. Simulator development is a time consuming process which requires expert knowledge and must traditionally be completed before the ER process can commence. Traditional simulators have limited accuracy, can be computationally expensive and typically do not account for minor operational differences between physical robots.This research proposes the automatic creation of simulators concurrently with the normal ER process. The simulator is derived from an Artificial Neural Network (ANN) to remove the need for formulating an analytical model for the robot. The ANN simulator is improved concurrently with the ER process through real-world controller evaluations which continuously generate behavioural data. Simultaneously, the ER process is informed by the improving simulator to evolve better controllers which are periodically evaluated in the real-world. Hence, the concurrent processes provide further targeted behavioural data for simulator improvement.The concurrent and real-time creation of both controllers and ANN-based simulators is successfully demonstrated for a differentially-steered mobile robot. Various parameter settings in the proposed algorithm are investigated to determine factors pertinent to the success of the proposed approach. Controllers are developed for trajectory planning using Evolutionary Robotics and a differentially-steered mobile robot.A novel approach is proposed for the concurrent development of controllers and a simulator.Robot behaviours are simulated using Artificial Neural Networks.An extensive parameter comparison study of the proposed approach is conducted.

[1]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[2]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[3]  Javier Ruiz-del-Solar,et al.  UCHILSIM: A Dynamically and Visually Realistic Simulator for the RoboCup Four Legged League , 2004, RoboCup.

[4]  Andrés Faiña,et al.  An evolution friendly modular architecture to produce feasible robots , 2015, Robotics Auton. Syst..

[5]  Charmain Cilliers,et al.  Simulating Robots Without Conventional Physics: A Neural Network Approach , 2013, J. Intell. Robotic Syst..

[6]  Gary B. Parker,et al.  Co-evolving model parameters for anytime learning in evolutionary robotics , 2000, Robotics Auton. Syst..

[7]  Francesco Mondada,et al.  Automatic creation of an autonomous agent: genetic evolution of a neural-network driven robot , 1994 .

[8]  Christiaan Johannes Pretorius Artificial neural networks as simulators for behavioural evolution in evolutionary robotics , 2010 .

[9]  Dave Cliff,et al.  Challenges in evolving controllers for physical robots , 1996, Robotics Auton. Syst..

[10]  Mathys C. du Plessis,et al.  A comparison of neural networks and physics models as motion simulators for simple robotic evolution , 2014, 2014 IEEE Congress on Evolutionary Computation (CEC).

[11]  Stefano Nolfi,et al.  Evolving mobile robots in simulated and real environments , 1995 .

[12]  Javier Ruiz-del-Solar,et al.  Combining Simulation and Reality in Evolutionary Robotics , 2007, J. Intell. Robotic Syst..

[13]  Ling Wang,et al.  A hybrid genetic algorithm-neural network strategy for simulation optimization , 2005, Appl. Math. Comput..

[14]  W. Oechel,et al.  Automatic design and manufacture of robotic lifeforms , 2022 .

[15]  Charmain Cilliers,et al.  Towards an artificial neural network-based simulator for behavioural evolution in evolutionary robotics , 2009, SAICSIT '09.

[16]  Jordan B. Pollack,et al.  Evolutionary Techniques in Physical Robotics , 2000, ICES.

[17]  Martin A. Riedmiller,et al.  A direct adaptive method for faster backpropagation learning: the RPROP algorithm , 1993, IEEE International Conference on Neural Networks.

[18]  Josh C. Bongard,et al.  Evolutionary robotics , 2013, CACM.

[19]  Stefano Nolfi,et al.  Evolutionary robotics , 1998, Lecture Notes in Computer Science.

[20]  Inman Harvey,et al.  Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics , 1995, ECAL.

[21]  Johnny Chung Lee,et al.  Hacking the Nintendo Wii Remote , 2008, IEEE Pervasive Computing.

[22]  Inman Harvey,et al.  Issues in evolutionary robotics , 1993 .

[23]  Stéphane Doncieux,et al.  The Transferability Approach: Crossing the Reality Gap in Evolutionary Robotics , 2013, IEEE Transactions on Evolutionary Computation.

[24]  Owen Holland,et al.  Coevolutionary Modelling of a Miniature Rotorcraft. , 2008 .

[25]  Shuji Hashimoto,et al.  A Hybrid Learning Strategy for Real Hardware of Swing-Up Pendulum , 2007, J. Adv. Comput. Intell. Intell. Informatics.

[26]  John Hallam,et al.  A hybrid GP/GA approach for co-evolving controllers and robot bodies to achieve fitness-specified tasks , 1996, Proceedings of IEEE International Conference on Evolutionary Computation.

[27]  R. Siezen,et al.  others , 1999, Microbial Biotechnology.

[28]  Charles E. Taylor,et al.  Selection for Wandering Behavior in a Small Robot , 1994, Artificial Life.