Constrained Bayesian Optimization with Particle Swarms for Safe Adaptive Controller Tuning

Abstract Tuning controller parameters is a recurring and time-consuming problem in control. This is especially true in the field of adaptive control, where good performance is typically only achieved after significant tuning. Recently, it has been shown that constrained Bayesian optimization is a promising approach to automate the tuning process without risking system failures during the optimization process. However, this approach is computationally too expensive for tuning more than a couple of parameters. In this paper, we provide a heuristic in order to efficiently perform constrained Bayesian optimization in high-dimensional parameter spaces by using an adaptive discretization based on particle swarms. We apply the method to the tuning problem of an L 1 adaptive controller on a quadrotor vehicle and show that we can reliably and automatically tune parameters in experiments.

[1]  Michael N. Vrahatis,et al.  Unified Particle Swarm Optimization for Solving Constrained Engineering Optimization Problems , 2005, ICNC.

[2]  Stefan Schaal,et al.  Policy Gradient Methods for Robotics , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[3]  Moncef Gabbouj,et al.  Multidimensional Particle Swarm Optimization for Machine Learning and Pattern Recognition , 2013, Adaptation, learning, and optimization.

[4]  Andries P. Engelbrecht,et al.  Computational Intelligence: An Introduction , 2002 .

[5]  C. Cao L 1 Adaptive Control Theory : Guaranteed Robustness with Fast Adaptation ( Advances in Design and Control ) , 2016 .

[6]  J. Mockus Bayesian Approach to Global Optimization: Theory and Applications , 1989 .

[7]  Angela P. Schoellig,et al.  High-Precision Trajectory Tracking in Changing Environments Through $\mathcal{L}_1$ Adaptive Feedback and Iterative Learning , 2017, ArXiv.

[8]  Jonathan P. How,et al.  L 1 Adaptive Control for Indoor Autonomous Vehicles: Design Process and Flight Testing , 2009 .

[9]  Jan Peters,et al.  Bayesian Gait Optimization for Bipedal Locomotion , 2014, LION.

[10]  Duy Nguyen-Tuong,et al.  Safe Exploration for Active Learning with Gaussian Processes , 2015, ECML/PKDD.

[11]  C. D. Perttunen,et al.  Lipschitzian optimization without the Lipschitz constant , 1993 .

[12]  Angela P. Schoellig,et al.  High-precision trajectory tracking in changing environments through L1 adaptive feedback and iterative learning , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[13]  Andreas Krause,et al.  Bayesian optimization with safety constraints: safe and automatic parameter tuning in robotics , 2016, Machine Learning.

[14]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[15]  Abdollah Homaifar,et al.  Constrained Optimization Via Genetic Algorithms , 1994, Simul..

[16]  Stefan Schaal,et al.  Automatic LQR tuning based on Gaussian process global optimization , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[17]  Russell C. Eberhart,et al.  Solving Constrained Nonlinear Optimization Problems with Particle Swarm Optimization , 2002 .

[18]  Andreas Krause,et al.  Information-Theoretic Regret Bounds for Gaussian Process Optimization in the Bandit Setting , 2009, IEEE Transactions on Information Theory.

[19]  Alkis Gotovos,et al.  Safe Exploration for Optimization with Gaussian Processes , 2015, ICML.

[20]  Andreas Krause,et al.  Bayesian optimization for maximum power point tracking in photovoltaic power plants , 2016, 2016 European Control Conference (ECC).

[21]  Michael N. Vrahatis,et al.  Particle Swarm Optimization Method for Constrained Optimization Problems , 2002 .

[22]  Serkan Kiranyaz,et al.  Multi-dimensional Particle Swarm Optimization , 2014 .