Automated shapeshifting for function recovery in damaged robots

A robot's mechanical parts routinely wear out from normal functioning and can be lost to injury. For autonomous robots operating in isolated or hostile environments, repair from a human operator is often not possible. Thus, much work has sought to automate damage recovery in robots. However, every case reported in the literature to date has accepted the damaged mechanical structure as fixed, and focused on learning new ways to control it. Here we show for the first time a robot that automatically recovers from unexpected damage by deforming its resting mechanical structure without changing its control policy. We found that, especially in the case of "deep insult", such as removal of all four of the robot's legs, the damaged machine evolves shape changes that not only recover the original level of function (locomotion) as before, but can in fact surpass the original level of performance (speed). This suggests that shape change, instead of control readaptation, may be a better method to recover function after damage in some cases.

[1]  Hod Lipson,et al.  Resilient Machines Through Continuous Self-Modeling , 2006, Science.

[2]  Andrew J. Davison,et al.  Sim-to-Real Reinforcement Learning for Deformable Object Manipulation , 2018, CoRL.

[3]  Peter Eggenberger,et al.  Evolving Morphologies of Simulated 3d Organisms Based on Differential Gene Expression , 1997 .

[4]  G. Pezzulo,et al.  Re-membering the body: applications of computational neuroscience to the top-down control of regeneration of limbs and other complex organs. , 2015, Integrative biology : quantitative biosciences from nano to macro.

[5]  Giovanni Pezzulo,et al.  Top-down models in biology: explanation and control of complex living systems above the molecular level , 2016, Journal of The Royal Society Interface.

[6]  Michael Levin,et al.  Normalized shape and location of perturbed craniofacial structures in the Xenopus tadpole reveal an innate ability to achieve correct morphology , 2012, Developmental dynamics : an official publication of the American Association of Anatomists.

[7]  Jean-Baptiste Mouret,et al.  Reset-free Trial-and-Error Learning for Robot Damage Recovery , 2016, Robotics Auton. Syst..

[8]  Hod Lipson,et al.  Three Dimensional Stochastic Reconfiguration of Modular Robots , 2005, Robotics: Science and Systems.

[9]  C. Illingworth,et al.  Trapped fingers and amputated finger tips in children. , 1974, Journal of pediatric surgery.

[10]  Douglas Blackiston,et al.  Retention of Memory through Metamorphosis: Can a Moth Remember What It Learned As a Caterpillar? , 2008, PloS one.

[11]  M. Goulding Circuits controlling vertebrate locomotion: moving in a new direction , 2009, Nature Reviews Neuroscience.

[12]  Peter J. Bentley,et al.  An Evolutionary Approach to Damage Recovery of robot Motion with Muscles , 2003, ECAL.

[13]  Michael Levin,et al.  An automated training paradigm reveals long-term memory in planarians and its persistence through head regeneration , 2013, Journal of Experimental Biology.

[14]  Kenneth O. Stanley,et al.  Compositional Pattern Producing Networks : A Novel Abstraction of Development , 2007 .

[15]  Hod Lipson,et al.  Unshackling evolution: evolving soft robots with multiple materials and a powerful generative encoding , 2013, GECCO '13.

[16]  Yoshua Bengio,et al.  A Data-Efficient Framework for Training and Sim-to-Real Transfer of Navigation Policies , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[17]  Stephen A. Morin,et al.  Elastomeric Tiles for the Fabrication of Inflatable Structures , 2014 .

[18]  Peter Eggenberger-Hotz Evolving Morphologies of Simulated 3d Organisms Based on Differential Gene Expression , 2007 .

[19]  Joonho Lee,et al.  Learning agile and dynamic motor skills for legged robots , 2019, Science Robotics.

[20]  David M. Gardiner,et al.  The Axolotl Model for Regeneration and Aging Research: A Mini-Review , 2011, Gerontology.

[21]  LipsonHod,et al.  Dynamic Simulation of Soft Multimaterial 3D-Printed Objects , 2014 .

[22]  Hod Lipson,et al.  Age-fitness pareto optimization , 2010, GECCO '10.

[23]  Michael Levin,et al.  The stability of memories during brain remodeling: A perspective , 2015, Communicative & integrative biology.

[24]  Rebecca Kramer-Bottiglio,et al.  An addressable pneumatic regulator for distributed control of soft robots , 2018, 2018 IEEE International Conference on Soft Robotics (RoboSoft).

[25]  Shuichi Takayama,et al.  Perspective: The promise of multi-cellular engineered living systems , 2018, APL bioengineering.

[26]  Josh C. Bongard,et al.  Interoceptive robustness through environment-mediated morphological development , 2018, GECCO.

[27]  R. Shepherd,et al.  Scalable manufacturing of high force wearable soft actuators , 2015 .

[28]  Atil Iscen,et al.  Sim-to-Real: Learning Agile Locomotion For Quadruped Robots , 2018, Robotics: Science and Systems.

[29]  Josh Bongard,et al.  Morphological change in machines accelerates the evolution of robust behavior , 2011, Proceedings of the National Academy of Sciences.

[30]  Akio Ishiguro,et al.  A brittle star-like robot capable of immediately adapting to unexpected physical damage , 2017, Royal Society Open Science.

[31]  M. West-Eberhard,et al.  Developmental plasticity and the origin of species differences , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[32]  Josh C. Bongard,et al.  How morphological development can guide evolution , 2017, Scientific Reports.

[33]  Antoine Cully,et al.  Robots that can adapt like animals , 2014, Nature.

[34]  R. McNeill Alexander,et al.  Principles of Animal Locomotion , 2002 .

[35]  Florentin Wörgötter,et al.  Multiple chaotic central pattern generators with learning for legged locomotion and malfunction compensation , 2014, Inf. Sci..

[36]  Michael Levin,et al.  Modeling Planarian Regeneration: A Primer for Reverse-Engineering the Worm , 2012, PLoS Comput. Biol..

[37]  Julian Francis Miller,et al.  Evolving a Self-Repairing, Self-Regulating, French Flag Organism , 2004, GECCO.

[38]  Hod Lipson,et al.  Robotics: Self-reproducing machines , 2005, Nature.

[39]  J. Brockes,et al.  Amphibian Limb Regeneration: Rebuilding a Complex Structure , 1997, Science.

[40]  Rebecca K. Kramer,et al.  Low‐Cost, Facile, and Scalable Manufacturing of Capacitive Sensors for Soft Systems , 2017 .

[41]  W. C. Corning,et al.  Regeneration and Retention of Acquired Information , 1967 .

[42]  Heinrich M. Jaeger,et al.  Universal robotic gripper based on the jamming of granular material , 2010, Proceedings of the National Academy of Sciences.

[43]  L. Penrose,et al.  Self-Reproducing Machines , 1959 .

[44]  J. Montgomery,et al.  On the minimal size of a planarian capable of regeneration. , 1974, Transactions of the American Microscopical Society.

[45]  M. Levin,et al.  Physiological inputs regulate species-specific anatomy during embryogenesis and regeneration , 2016, Communicative & integrative biology.

[46]  Josh C. Bongard,et al.  A minimal developmental model can increase evolvability in soft robots , 2017, GECCO.