On the challenges of jointly optimising robot morphology and control using a hierarchical optimisation scheme

We investigate a hierarchical scheme for the joint optimisation of robot bodies and controllers in a complex morphological space. An evolutionary algorithm optimises body-plans while a separate learning algorithm is applied to each body generated to learn a controller. We investigate the interaction of these processes using a weak and then strong learning method. Results show that the weak learner leads to more body-plan diversity but that both learners cause premature convergence of body-plans to local optima. We conclude with suggestions as the framework might be adapted to address these issues in future.

[1]  Risto Miikkulainen,et al.  Evolving Neural Networks through Augmenting Topologies , 2002, Evolutionary Computation.

[2]  A. E. Eiben,et al.  Evolving-Controllers Versus Learning-Controllers for Morphologically Evolvable Robots , 2020, EvoApplications.

[3]  Hod Lipson,et al.  On the Difficulty of Co-Optimizing Morphology and Control in Evolved Virtual Creatures , 2016, ALIFE.

[4]  A. E. Eiben,et al.  Bootstrapping Artificial Evolution to Design Robots for Autonomous Fabrication , 2020, Robotics.

[5]  Josh Bongard,et al.  A scalable pipeline for designing reconfigurable organisms , 2020, Proceedings of the National Academy of Sciences.

[6]  Wojciech Matusik,et al.  RoboGrammar , 2020, ACM Trans. Graph..

[7]  A. E. Eiben,et al.  Sample and time efficient policy learning with CMA-ES and Bayesian Optimisation , 2020 .

[8]  Jeffrey L. Elman,et al.  Finding Structure in Time , 1990, Cogn. Sci..

[9]  Surya Ganguli,et al.  Embodied intelligence via learning and evolution , 2021, Nature Communications.

[10]  Sylvain Calinon,et al.  A Survey on Policy Search Algorithms for Learning Robot Controllers in a Handful of Trials , 2018, IEEE Transactions on Robotics.

[11]  Emma Hart,et al.  Morpho Evolution With Learning Using a Controller Archive as an Inheritance Mechanism , 2021, IEEE Transactions on Cognitive and Developmental Systems.

[12]  Sergey Levine,et al.  Data-efficient Learning of Morphology and Controller for a Microrobot , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[13]  Richard J. Beckman,et al.  A Comparison of Three Methods for Selecting Values of Input Variables in the Analysis of Output From a Computer Code , 2000, Technometrics.

[14]  Jordan B. Pollack,et al.  TITLE : Generative Representations for the Automated Design of Modular Physical Robots , 2003 .