Model-Free Design Optimization of a Hopping Robot and Its Comparison With a Human Designer

When developing a robot, design iterations in the physical world are necessary, even though they are often costly and not systematic. Here, we present an automated iterative design process without using modeling or simulation, which we refer to as “model-free design optimization” based on Bayesian optimization. This letter particularly focuses on the cooptimization of morphology and controller, by using a mechanism to balance parameter specific costs (i.e., morphology samplings are more expensive than control ones) for effective and efficient design optimization processes. A hopping robot was employed for a feasibility analysis of the proposed optimization method, in which minimalistic two-dimensional and four-dimensional design optimization experiments were performed in real life. The results show that the proposed approach is capable of improving both of the robot design problems within a defined time limit. The method is also compared to optimization performances of a human designer under the same conditions. The automated method has advantage in finding the best solution more quickly in the four-dimensional search space, while the human optimization performs better in the two-dimensional case.

[1]  Nando de Freitas,et al.  A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning , 2010, ArXiv.

[2]  Fumiya Iida,et al.  Discrete Foot Shape Changes Improve Dynamics of a Hopping Robot , 2016, ISER.

[3]  Roland Siegwart,et al.  A MATLAB framework for efficient gait creation , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[4]  Karl Sims,et al.  Evolving virtual creatures , 1994, SIGGRAPH.

[5]  Christine Chevallereau,et al.  Design and actuation optimization of a 4-axes biped robot for walking and running , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[6]  Jasper Snoek,et al.  Practical Bayesian Optimization of Machine Learning Algorithms , 2012, NIPS.

[7]  Fumiya Iida,et al.  Self-stable one-legged hopping using a curved foot , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[8]  Randall D. Beer,et al.  Application of evolved locomotion controllers to a hexapod robot , 1996, Robotics Auton. Syst..

[9]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[10]  Fumiya Iida,et al.  Evolutionary Developmental Robotics: Improving Morphology and Control of Physical Robots , 2017, Artificial Life.

[11]  F. Iida,et al.  Morphological Evolution of Physical Robots through Model-Free Phenotype Development , 2015, PloS one.

[12]  Chandana Paul,et al.  The road less travelled: morphology in the optimization of biped robot locomotion , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[13]  Jan Peters,et al.  Bayesian optimization for learning gaits under uncertainty , 2015, Annals of Mathematics and Artificial Intelligence.

[14]  Jordan B. Pollack,et al.  Automatic design and manufacture of robotic lifeforms , 2000, Nature.

[15]  F. Iida,et al.  Iterative Product Engineering : Evolutionary Robot Design , 2002 .

[16]  Nikolaos G. Tsagarakis,et al.  Design Optimisation and Control of Compliant Actuation Arrangements in Articulated Robots for Improved Energy Efficiency , 2016, IEEE Robotics and Automation Letters.

[17]  Fumiya Iida,et al.  Improving Efficiency for an Open-Loop-Controlled Locomotion With a Pulsed Actuation , 2016, IEEE/ASME Transactions on Mechatronics.

[18]  H. Sebastian Seung,et al.  Stochastic policy gradient reinforcement learning on a simple 3D biped , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[19]  Fumiya Iida,et al.  The trade-off between morphology and control in the co-optimized design of robots , 2017, PloS one.

[20]  Howie Choset,et al.  A review on locomotion robophysics: the study of movement at the intersection of robotics, soft matter and dynamical systems , 2016, Reports on progress in physics. Physical Society.