International Journal of Robotics Research

The development of optimized motions of humanoid robots that guarantee fast and also stable walking is an important task, especially in the context of autonomous soccer-playing robots in RoboCup. We present a walking motion optimization approach for the humanoid robot prototype HR18 which is equipped with a low-dimensional parameterized walking trajectory generator, joint motor controller and an internal stabilization. The robot is included as hardware-in-the-loop to define a low-dimensional black-box optimization problem. In contrast to previously performed walking optimization approaches, we apply a sequential surrogate optimization approach using stochastic approximation of the underlying objective function and sequential quadratic programming to search for a fast and stable walking motion. This is done under the conditions that only a small number of physical walking experiments should have to be carried out during the online optimization process. For the identified walking motion for the considered 55 cm tall humanoid robot, we measured a forward walking speed of more than 30 cm s -1 . With a modified version of the robot, even more than 40 cm s -1 could be achieved in permanent operation.

[1]  Thomas Röfer,et al.  Evolutionary Gait-Optimization Using a Fitness Function Based on Proprioception , 2004, RoboCup.

[2]  O. SIAMJ.,et al.  ON THE CONVERGENCE OF PATTERN SEARCH ALGORITHMS , 1997 .

[3]  Daniel E. Koditschek,et al.  Automated gait adaptation for legged robots , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[4]  T. Simpson,et al.  A Study on the Use of Kriging Models to Approximate Deterministic Computer Models , 2003, DAC 2003.

[5]  Jerome Sacks,et al.  Designs for Computer Experiments , 1989 .

[6]  Michael A. Saunders,et al.  USER’S GUIDE FOR SNOPT 5.3: A FORTRAN PACKAGE FOR LARGE-SCALE NONLINEAR PROGRAMMING , 2002 .

[7]  Martin Buss,et al.  Towards an autonomous, humanoid, and dynamically walking robot: modeling, optimal trajectory planning, hardware architecture, and experiments , 2003 .

[8]  G. Matheron Principles of geostatistics , 1963 .

[9]  Dirk Thomas,et al.  REUSABLE ARCHITECTURE AND TOOLS FOR TEAMS OF LIGHTWEIGHT HETEROGENEOUS ROBOTS , 2006 .

[10]  Oskar von Stryk,et al.  Dynamic modeling in the simulation, optimization and control of legged robots , 2003 .

[11]  Fumiya Iida,et al.  Towards Bipedal Jogging as a Natural Result of Optimizing Walking Speed for Passively Compliant Three-Segmented Legs , 2009, Int. J. Robotics Res..

[12]  Michael James Sasena,et al.  Flexibility and efficiency enhancements for constrained global design optimization with kriging approximations. , 2002 .

[13]  Owen J. Eslinger,et al.  IFFCO: implicit filtering for constrained optimization, version 2 , 1999 .

[14]  R. Lewis,et al.  An Overview of First-Order Model Management for Engineering Optimization , 2001 .

[15]  C. T. Kelley,et al.  Users' Guide for imfil Version 1.0 , 2011 .

[16]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..

[17]  Johann Dréo,et al.  Metaheuristics for Hard Optimization: Methods and Case Studies , 2005 .

[18]  O. von Stryk,et al.  Dynamic modeling in the simulation, optimization, and control of bipedal and quadrupedal robots , 2003 .

[19]  Timothy W. Simpson,et al.  On the Use of Kriging Models to Approximate Deterministic Computer Models , 2004, DAC 2004.

[20]  J. Denk,et al.  Synthesis of a Walking Primitive Database for a Humanoid Robot using Optimal Control Techniques , 2001 .

[21]  Art B. Owen,et al.  9 Computer experiments , 1996, Design and analysis of experiments.

[22]  V. Torczon,et al.  Direct search methods: then and now , 2000 .

[23]  O. V. Stryk,et al.  DERIVATIVE-FREE OPTIMIZATION METHODS FOR HANDLING FIXED COSTS IN OPTIMAL GROUNDWATER REMEDIATION DESIGN , 2006 .

[24]  Dirk Thomas,et al.  Versatile, High-Quality Motions and Behavior Control of a Humanoid Soccer Robot , 2008, Int. J. Humanoid Robotics.

[25]  John A. Nelder,et al.  A Simplex Method for Function Minimization , 1965, Comput. J..

[26]  Tamara G. Kolda,et al.  Asynchronous Parallel Generating Set Search for Linearly Constrained Optimization , 2008, SIAM J. Sci. Comput..

[27]  Cass T. Miller,et al.  Solution of a Well-Field Design Problem with Implicit Filtering , 2004 .

[28]  Peter Stone,et al.  Policy gradient reinforcement learning for fast quadrupedal locomotion , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[29]  Virginia Torczon,et al.  On the Convergence of Pattern Search Algorithms , 1997, SIAM J. Optim..

[30]  Donald R. Jones,et al.  Efficient Global Optimization of Expensive Black-Box Functions , 1998, J. Glob. Optim..

[31]  Herbert De Gersem,et al.  Mixed-integer simulation-based optimization for a superconductive magnet design , 2006 .

[32]  Oskar von Stryk,et al.  Efficient dynamic modeling, numerical optimal control and experimental results for various gaits of a quadruped robot , 2003 .

[33]  Matthias Jüngel,et al.  XABSL - A Pragmatic Approach to Behavior Engineering , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[34]  Søren Nymand Lophaven,et al.  DACE - A Matlab Kriging Toolbox , 2002 .