Prioritized optimal control: A hierarchical differential dynamic programming approach

This paper deals with the generation of motion for complex dynamical systems (such as humanoid robots) to achieve several concurrent objectives. Hierarchy of tasks and optimal control are two frameworks commonly used to this aim. The first one specifies control objectives as a number of quadratic functions to be minimized under strict priorities. The second one minimizes an arbitrary user-defined function of the future state of the system, thus considering its evolution in time. Our recent work on prioritized optimal control merges the advantages of both these methods. This paper reformulates the original prioritized optimal control algorithm with the precise goal of improving its computational speed. We extend the dynamic programming method to work with a hierarchy of tasks. We compared our approach in simulation with both our previous algorithm and classical optimal control. The measured computational improvement represents another step towards the application of prioritized optimal control for online model predictive control of humanoid robots. We believe that this could be the key to unlock the (so far unexploited) dynamic capabilities of these mechanical systems.

[1]  Jean-Jacques E. Slotine,et al.  A general framework for managing multiple tasks in highly redundant robotic systems , 1991, Fifth International Conference on Advanced Robotics 'Robots in Unstructured Environments.

[2]  D. Mayne.  A Second-order Gradient Method for Determining Optimal Trajectories of Non-linear Discrete-time Systems , 1966 .

[3]  T. Yoshikawa,et al.  Task-Priority Based Redundancy Control of Robot Manipulators , 1987 .

[4]  Ludovic Righetti,et al.  Operational Space Control of Constrained and Underactuated Systems , 2011, Robotics: Science and Systems.

[5]  Donald E. Kirk,et al.  Optimal control theory : an introduction , 1970 .

[6]  Anthony A. Maciejewski,et al.  Dealing with the ill-conditioned equations of motion for articulated figures , 1990, IEEE Computer Graphics and Applications.

[7]  Oussama Khatib,et al.  A unified approach for motion and force control of robot manipulators: The operational space formulation , 1987, IEEE J. Robotics Autom..

[8]  A. A. Maciejewsk.  Dealing with the Ill-Conditioned Epuations of Motion for Articulated Figures , 1990 .

[9]  E. Todorov,et al.  A generalized iterative LQG method for locally-optimal feedback control of constrained nonlinear stochastic systems , 2005, Proceedings of the 2005, American Control Conference, 2005..

[10]  P. B. Coaker,et al.  Applied Dynamic Programming , 1964 .

[11]  Yuval Tassa,et al.  Synthesis and stabilization of complex behaviors through online trajectory optimization , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[12]  Oussama Khatib,et al.  Synthesis and control of whole-body behaviors in humanoid systems , 2007 .

[13]  Pierre-Brice Wieber,et al.  Kinematic Control of Redundant Manipulators: Generalizing the Task-Priority Framework to Inequality Task , 2011, IEEE Transactions on Robotics.

[14]  Giulio Sandini,et al.  Prioritized optimal control , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[15]  Yuval Tassa,et al.  MuJoCo: A physics engine for model-based control , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[16]  Nikolaos G. Tsagarakis,et al.  Development of a dynamic simulator for a compliant humanoid robot based on a symbolic multibody approach , 2013, 2013 IEEE International Conference on Mechatronics (ICM).

[17]  Stefan Schaal,et al.  Inverse dynamics control of floating-base robots with external constraints: A unified view , 2011, 2011 IEEE International Conference on Robotics and Automation.

[18]  Pierre-Brice Wieber,et al.  Hierarchical quadratic programming: Fast online humanoid-robot motion generation , 2014, Int. J. Robotics Res..

[19]  Martin de Lasa,et al.  Feature-based locomotion controllers , 2010, ACM Trans. Graph..

[20]  François Keith,et al.  Generation of dynamic motion for anthropomorphic systems under prioritized equality and inequality constraints , 2011, 2011 IEEE International Conference on Robotics and Automation.