Control design along trajectories with sums of squares programming

Motivated by the need for formal guarantees on the stability and safety of controllers for challenging robot control tasks, we present a control design procedure that explicitly seeks to maximize the size of an invariant “funnel” that leads to a predefined goal set. Our certificates of invariance are given in terms of sums of squares proofs of a set of appropriately defined Lyapunov inequalities. These certificates, together with our proposed polynomial controllers, can be efficiently obtained via semidefinite optimization. Our approach can handle time-varying dynamics resulting from tracking a given trajectory, input saturations (e.g. torque limits), and can be extended to deal with uncertainty in the dynamics and state. The resulting controllers can be used by space-filling feedback motion planning algorithms to fill up the space with significantly fewer trajectories. We demonstrate our approach on a severely torque limited underactuated double pendulum (Acrobot) and provide extensive simulation and hardware validation.

[1]  Russ Tedrake,et al.  Robust Online Motion Planning with Regions of Finite Time Invariance , 2012, WAFR.

[2]  Lennart Ljung,et al.  System identification toolbox for use with MATLAB , 1988 .

[3]  Huibert Kwakernaak,et al.  Linear Optimal Control Systems , 1972 .

[4]  Jos F. Sturm,et al.  A Matlab toolbox for optimization over symmetric cones , 1999 .

[5]  David Q. Mayne,et al.  Model predictive control: Recent developments and future promise , 2014, Autom..

[6]  Mark W. Spong,et al.  Partial feedback linearization of underactuated mechanical systems , 1994, Proceedings of IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS'94).

[7]  Andrew Packard,et al.  Control Applications of Sum of Squares Programming , 2005 .

[8]  Marko Bacic,et al.  Model predictive control , 2003 .

[9]  P. Parrilo Structured semidefinite programs and semialgebraic geometry methods in robustness and optimization , 2000 .

[10]  D. Luenberger An introduction to observers , 1971 .

[11]  Johan Löfberg,et al.  Pre- and Post-Processing Sum-of-Squares Programs in Practice , 2009, IEEE Transactions on Automatic Control.

[12]  Ryan Feeley,et al.  Some controls applications of sum of squares programming , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[13]  Amir Ali Ahmadi Algebraic relaxations and hardness results in polynomial optimization and Lyapunov analysis , 2012, ArXiv.

[14]  Emilio Frazzoli,et al.  Sampling-based algorithms for optimal motion planning , 2011, Int. J. Robotics Res..

[15]  Mark W. Spong,et al.  The swing up control problem for the Acrobot , 1995 .

[16]  Vijay Kumar,et al.  An RRT-Based Algorithm for Testing and Validating Multi-Robot Controllers , 2005, Robotics: Science and Systems.

[17]  Amir Ali Ahmadi Non-monotonic Lyapunov functions for stability of nonlinear and switched systems : theory and computation , 2008 .

[18]  Mark M. Tobenkin,et al.  Invariant Funnels around Trajectories using Sum-of-Squares Programming , 2010, 1010.3013.

[19]  Anil V. Rao,et al.  Practical Methods for Optimal Control Using Nonlinear Programming , 1987 .

[20]  Steven M. LaValle,et al.  RRT-connect: An efficient approach to single-query path planning , 2000, Proceedings 2000 ICRA. Millennium Conference. IEEE International Conference on Robotics and Automation. Symposia Proceedings (Cat. No.00CH37065).

[21]  Jeff G. Schneider,et al.  Policy Search by Dynamic Programming , 2003, NIPS.

[22]  Daniel E. Koditschek,et al.  Sequential Composition of Dynamically Dexterous Robot Behaviors , 1999, Int. J. Robotics Res..

[23]  D. Henrion,et al.  Guest Editorial: Special Issue on Positive Polynomials in Control , 2009 .

[24]  Ian R. Manchester,et al.  LQR-trees: Feedback Motion Planning via Sums-of-Squares Verification , 2010, Int. J. Robotics Res..

[25]  David Q. Mayne,et al.  Differential dynamic programming , 1972, The Mathematical Gazette.

[26]  A. Megretski Positivity of trigonometric polynomials , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).