An Uncertainty-Based Control Lyapunov Approach for Control-Affine Systems Modeled by Gaussian Process

Data-driven approaches in control allow for identification of highly complex dynamical systems with minimal prior knowledge. However, properly incorporating model uncertainty in the design of a stabilizing control law remains challenging. Therefore, this letter proposes a control Lyapunov function framework which semiglobally asymptotically stabilizes a partially unknown fully actuated control affine system with high probability. We propose an uncertainty-based control Lyapunov function which utilizes the model fidelity estimate of a Gaussian process model to drive the system in areas near training data with low uncertainty. We show that this behavior maximizes the probability that the system is stabilized in the presence of power constraints using equivalence to dynamic programming. A simulation on a nonlinear system is provided.

[1]  R. Newcomb.  VISCOSITY SOLUTIONS OF HAMILTON-JACOBI EQUATIONS , 2010 .

[2]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[3]  Sham M. Kakade,et al.  Information Consistency of Nonparametric Gaussian Process Methods , 2008, IEEE Transactions on Information Theory.

[4]  Jonathan P. How,et al.  Bayesian Nonparametric Adaptive Control Using Gaussian Processes , 2015, IEEE Transactions on Neural Networks and Learning Systems.

[5]  Juš Kocijan,et al.  Modelling and Control of Dynamic Systems Using Gaussian Process Models , 2015 .

[6]  Carl E. Rasmussen,et al.  Gaussian Processes for Data-Efficient Learning in Robotics and Control , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[7]  J. Kocijan,et al.  Gaussian process model based predictive control , 2004, Proceedings of the 2004 American Control Conference.

[8]  Sandra Hirche,et al.  Feedback linearization using Gaussian processes , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[9]  Duy Nguyen-Tuong,et al.  Learning Robot Dynamics for Computed Torque Control Using Local Gaussian Processes Regression , 2008, 2008 ECSIS Symposium on Learning and Adaptive Behaviors for Robotic Systems (LAB-RS).

[10]  J. A. Sethian,et al.  Fast Marching Methods , 1999, SIAM Rev..

[11]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[12]  J. Slotine,et al.  Robust input-output feedback linearization , 1993 .

[13]  Sandra Hirche,et al.  Stable Model-based Control with Gaussian Process Regression for Robot Manipulators , 2018, ArXiv.

[14]  Alessandro Chiuso,et al.  Online semi-parametric learning for inverse dynamics modeling , 2016, 2016 IEEE 55th Conference on Decision and Control (CDC).

[15]  Sandra Hirche,et al.  Correction to "An Uncertainty-Based Control Lyapunov Approach for Control-Affine Systems Modeled by Gaussian Process" , 2019, IEEE Control. Syst. Lett..

[16]  Dana Kulic,et al.  Stable Gaussian process based tracking control of Lagrangian systems , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[17]  Agathe Girard,et al.  Adaptive, Cautious, Predictive control with Gaussian Process Priors , 2003 .

[18]  Ian M. Mitchell,et al.  Continuous path planning with multiple constraints , 2003, 42nd IEEE International Conference on Decision and Control (IEEE Cat. No.03CH37475).

[19]  Lennart Ljung,et al.  Kernel methods in system identification, machine learning and function estimation: A survey , 2014, Autom..

[20]  Andreas Krause,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2009, IEEE Transactions on Information Theory.

[21]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Vol. II , 1976 .