Real-world embodied AI through a morphologically adaptive quadruped robot

Robots are traditionally bound by a fixed morphology during their operational lifetime, which is limited to adapting only their control strategies. Here we present the first quadrupedal robot that can morphologically adapt to different environmental conditions in outdoor, unstructured environments. Our solution is rooted in embodied AI and comprises two components: (1) a robot that permits in situ morphological adaptation and (2) an adaptation algorithm that transitions between the most energy-efficient morphologies on the basis of the currently sensed terrain. We first build a model that describes how the robot morphology affects performance on selected terrains. We then test continuous adaptation on realistic outdoor terrain while allowing the robot to constantly update its model. We show that the robot exploits its training to effectively transition between different morphological configurations, exhibiting substantial performance improvements over a non-adaptive approach. The demonstrated benefits of real-world morphological adaptation demonstrate the potential for a new embodied way of incorporating adaptation into future robotic designs. The morphology of a robot determines how efficiently it can traverse different terrain. Nygaard and colleagues present here a robot that can adapt it’s morphology when it is detecting different terrain and learn which configuration is most effective.

[1]  Bernhard Thomaszewski,et al.  Skaterbots: optimization-based design and motion synthesis for robotic creatures with legs and wheels , 2018, ACM Trans. Graph..

[2]  Jordan B. Pollack,et al.  Automatic design and manufacture of robotic lifeforms , 2000, Nature.

[3]  Andrés Faiña,et al.  Automated Reconfiguration of Modular Robots Using Robot Manipulators , 2018, 2018 IEEE Symposium Series on Computational Intelligence (SSCI).

[4]  Yi Sun,et al.  Modules Design of a Reconfigurable Multi-Legged Walking Robot , 2006, 2006 IEEE International Conference on Robotics and Biomimetics.

[5]  John Jan. Long,et al.  Darwin's Devices: What Evolving Robots Can Teach Us About the History of Life and the Future of Technology , 2012 .

[6]  Hod Lipson,et al.  Unshackling evolution: evolving soft robots with multiple materials and a powerful generative encoding , 2013, GECCO '13.

[7]  Sven Behnke,et al.  Combining Simulations and Real-robot Experiments for Bayesian Optimization of Bipedal Gait Stabilization , 2018, RoboCup.

[8]  J. Fonseca,et al.  Decrease of CD68 Synovial Macrophages in Celastrol Treated Arthritic Rats , 2015, PloS one.

[9]  Navinda Kottege,et al.  A testbed that evolves hexapod controllers in hardware , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Yevgeniy Yesilevskiy,et al.  Selecting gaits for economical locomotion of legged robots , 2016, Int. J. Robotics Res..

[11]  Jean-Baptiste Mouret,et al.  Fast Online Adaptation in Robotics through Meta-Learning Embeddings of Simulated Priors , 2020, 2020 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[12]  Claudio Semini,et al.  STANCE: Locomotion Adaptation Over Soft Terrain , 2019, IEEE Transactions on Robotics.

[13]  Joonho Lee,et al.  Learning agile and dynamic motor skills for legged robots , 2019, Science Robotics.

[14]  Helmut Hauser,et al.  Morphologically induced stability on an underwater legged robot with a deformable body , 2019 .

[15]  F. Iida,et al.  Morphological Evolution of Physical Robots through Model-Free Phenotype Development , 2015, PloS one.

[16]  Robert J. Wood,et al.  Robotic Origamis: Self-morphing Modular Robot , 2012 .

[17]  Lorenz Wellhausen,et al.  Learning quadrupedal locomotion over challenging terrain , 2020, Science Robotics.

[18]  Dario Floreano,et al.  RoboGen: Robot Generation through Artificial Evolution , 2014, ALIFE.

[19]  Inman Harvey,et al.  Noise and the Reality Gap: The Use of Simulation in Evolutionary Robotics , 1995, ECAL.

[20]  Shinji Kawatsuma,et al.  Emergency response by robots to Fukushima-Daiichi accident: summary and lessons learned , 2012, Ind. Robot.

[21]  A. E. Eiben,et al.  Real-World Evolution of Robot Morphologies: A Proof of Concept , 2017, Artificial Life.

[22]  Josh Bongard,et al.  Scalable sim-to-real transfer of soft robot designs , 2019, 2020 3rd IEEE International Conference on Soft Robotics (RoboSoft).

[23]  Mark W. Mueller,et al.  Design and Control of a Passively Morphing Quadcopter , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[24]  Jean-Baptiste Mouret,et al.  20 years of reality gap: a few thoughts about simulators in evolutionary robotics , 2017, GECCO.

[25]  Kyrre Glette,et al.  Environmental Adaptation of Robot Morphology and Control through Real-world Evolution , 2020, ArXiv.

[26]  Xianmin Zhang,et al.  Development of novel robots with modular methodology , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[27]  Veronique Kiermer,et al.  How can we ensure visibility and diversity in research contributions? How the Contributor Role Taxonomy (CRediT) is helping the shift from authorship to contributorship , 2019, Learn. Publ..

[28]  Serge Kernbach,et al.  Embodied artificial evolution , 2012, Evolutionary Intelligence.

[29]  Jan Peters,et al.  Bayesian optimization for learning gaits under uncertainty , 2015, Annals of Mathematics and Artificial Intelligence.

[30]  Olivier Ly,et al.  Optimizing Morphology and Locomotion on a Corpus of Parametric Legged Robots , 2016, Living Machines.

[31]  Sehoon Ha,et al.  Joint Optimization of Robot Design and Motion Parameters using the Implicit Function Theorem , 2017, Robotics: Science and Systems.

[32]  Rolf Pfeifer,et al.  How the body shapes the way we think - a new view on intelligence , 2006 .

[33]  Homayoun Seraji,et al.  Vision-based terrain characterization and traversability assessment , 2001, J. Field Robotics.

[34]  Simon E. Freeman,et al.  Variable stiffness morphing limb for amphibious legged robots inspired by chelonian environmental adaptations , 2020, Bioinspiration & biomimetics.

[35]  Stefan Schaal,et al.  Learning, planning, and control for quadruped locomotion over challenging terrain , 2011, Int. J. Robotics Res..

[36]  David Zarrouk,et al.  Flying STAR, a Hybrid Crawling and Flying Sprawl Tuned Robot , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[37]  Jan Peters,et al.  Reinforcement learning in robotics: A survey , 2013, Int. J. Robotics Res..

[38]  Valentin Riviere,et al.  Agile Robotic Fliers: A Morphing-Based Approach , 2018, Soft robotics.

[39]  Yuval Tassa,et al.  Simulation tools for model-based robotics: Comparison of Bullet, Havok, MuJoCo, ODE and PhysX , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[40]  Fumiya Iida,et al.  Evolutionary Developmental Robotics: Improving Morphology and Control of Physical Robots , 2017, Artificial Life.

[41]  Josh Bongard,et al.  A scalable pipeline for designing reconfigurable organisms , 2020, Proceedings of the National Academy of Sciences.

[42]  Lorenz Wellhausen,et al.  Walking Posture Adaptation for Legged Robot Navigation in Confined Spaces , 2019, IEEE Robotics and Automation Letters.

[43]  A.J. Ijspeert,et al.  Online optimization of modular robot locomotion , 2005, IEEE International Conference Mechatronics and Automation, 2005.

[44]  Kyrre Glette,et al.  Self-Modifying Morphology Experiments with DyRET: Dynamic Robot for Embodied Testing , 2019, 2019 International Conference on Robotics and Automation (ICRA).

[45]  Wojciech Matusik,et al.  Learning-In-The-Loop Optimization: End-To-End Control And Co-Design Of Soft Robots Through Learned Deep Latent Representations , 2019, NeurIPS.

[46]  Jordan B. Pollack,et al.  TITLE : Generative Representations for the Automated Design of Modular Physical Robots , 2003 .

[47]  Jamie Paik,et al.  Design Methodology for Constructing Multimaterial Origami Robots and Machines , 2018, IEEE Transactions on Robotics.

[48]  Jeffrey H. Lang,et al.  Design Principles for Energy-Efficient Legged Locomotion and Implementation on the MIT Cheetah Robot , 2015, IEEE/ASME Transactions on Mechatronics.

[49]  Kyrre Glette,et al.  Experiences from Real-World Evolution with DyRET: Dynamic Robot for Embodied Testing , 2019 .

[50]  Frédéric Maire,et al.  Towards the targeted environment-specific evolution of robot components , 2018, GECCO.

[51]  Kyrre Glette,et al.  Real-world evolution adapts robot morphology and control to hardware limitations , 2018, GECCO.

[52]  Andrew D. Wilson,et al.  Embodied Cognition is Not What you Think it is , 2013, Front. Psychology.

[53]  Wenjun Zhang,et al.  Resilient Robots: Concept, Review, and Future Directions , 2017, Robotics.

[54]  Jie Yan,et al.  A Review of Gait Optimization Based on Evolutionary Computation , 2010, Appl. Comput. Intell. Soft Comput..