Standing balance control using a trajectory library

This paper presents a standing balance controller that explicitly handles pushes. We employ a library of optimal trajectories and the neighboring optimal control method to generate local approximations to the optimal control. We take advantage of a parametric nonlinear optimization method, SNOPT, to generate initial trajectories and then use Differential Dynamic Programming (DDP) to further refine them and get their neighboring optimal control. A library generation method is proposed, which keeps the trajectory library to a reasonable size. We compare the proposed controller with an optimal controller and an LQR based gain scheduling controller using the same optimization criterion. Simulation results demonstrate the performance of the proposed method.

[1]  Arthur E. Bryson,et al.  Applied Optimal Control , 1969 .

[2]  M. Ciletti,et al.  The computation and theory of optimal control , 1972 .

[3]  David Q. Mayne,et al.  Differential dynamic programming , 1972, The Mathematical Gazette.

[4]  George M. Siouris,et al.  Applied Optimal Control: Optimization, Estimation, and Control , 1979, IEEE Transactions on Systems, Man, and Cybernetics.

[5]  A.D. Kuo,et al.  An optimal control model for analyzing human postural balance , 1995, IEEE Transactions on Biomedical Engineering.

[6]  Kenneth Kreutz-Delgado,et al.  Multibody dynamical algorithms, numerical optimal control, with detailed studies in the control of jet engine compressors and biped walking , 1999 .

[7]  F E Zajac,et al.  Ankle and hip postural strategies defined by joint torques. , 1999, Gait & posture.

[8]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2002, SIAM J. Optim..

[9]  F. Horak,et al.  Postural feedback responses scale with biomechanical constraints in human standing , 2004, Experimental Brain Research.

[10]  F. Orderud,et al.  Comparison of Kalman Filter Estimation Approaches for State Space Models with Nonlinear Measurements , 2005 .

[11]  Ambarish Goswami,et al.  A Biomechanically Motivated Two-Phase Strategy for Biped Upright Balance Control , 2005, Proceedings of the 2005 IEEE International Conference on Robotics and Automation.

[12]  Michael A. Saunders,et al.  SNOPT: An SQP Algorithm for Large-Scale Constrained Optimization , 2005, SIAM Rev..

[13]  Sergey V. Drakunov,et al.  Capture Point: A Step toward Humanoid Push Recovery , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[14]  Benjamin J. Stephens.  Integral control of humanoid balance , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Christopher G. Atkeson,et al.  Multiple balance strategies from one optimization criterion , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[16]  Benjamin J. Stephens,et al.  Humanoid push recovery , 2007, 2007 7th IEEE-RAS International Conference on Humanoid Robots.

[17]  Christopher G. Atkeson,et al.  Random Sampling of States in Dynamic Programming , 2007, IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics).

[18]  Jerry E. Pratt,et al.  Learning Capture Points for Bipedal Push Recovery , 2008, 2008 IEEE International Conference on Robotics and Automation.