Extremum Seeking-based Indirect Adaptive Control and Feedback Gains Auto-Tuning for Nonlinear Systems

We present in this chapter some recent results on learning-based adaptive control for nonlinear systems. We first study the problem of adaptive trajectory tracking for nonlinear systems, and show that for the class of nonlinear systems with parametric uncertainties which can be rendered integral Input-to-State stable w.r.t. the parameter estimation error, that it is possible to merge together the integral Input-to-State stabilizing feedback controller and a model-free extremum seeking (ES) algorithm to realize a learning-based adaptive controller. We investigate the performance of this approach in term of tracking errors upper-bounds, for two different ES algorithms. Next, we propose a learning-based approach to auto-tune the feedback gains for nonlinear stabilizing controllers. Book chapter in: Control Theory: Perspectives, Applications and Developments This work may not be copied or reproduced in whole or in part for any commercial purpose. Permission to copy in whole or in part without payment of fee is granted for nonprofit educational and research purposes provided that all such whole or partial copies include the following: a notice that such copying is by permission of Mitsubishi Electric Research Laboratories, Inc.; an acknowledgment of the authors and individual contributions to the work; and all applicable portions of the copyright notice. Copying, reproduction, or republishing for any other purpose shall require a license with payment of fee to Mitsubishi Electric Research Laboratories, Inc. All rights reserved. Copyright c © Mitsubishi Electric Research Laboratories, Inc., 2015 201 Broadway, Cambridge, Massachusetts 02139 EXTREMUM SEEKING-BASED INDIRECT ADAPTIVE CONTROL AND FEEDBACK GAINS AUTO-TUNING FOR NONLINEAR SYSTEMS Mouhacine Benosman∗ Mitsubishi Electric Research Laboratories Cambridge, USA To appear in Control Theory: Perspectives, Applications and Developments, 2015 Abstract We present in this chapter some recent results on learning-based adaptive control for nonlinear systems. We first study the problem of adaptive trajectory tracking for nonlinear systems. We focus on the class of nonlinear systems with parametric uncertainties, which can be rendered integral Input-to-State Stable (iISS) w.r.t. the parameter estimation error. We argue, for this particular class of systems, that it is possible to merge together the integral Input-to-State stabilizing feedback controller and a model-free extremum seeking (ES) algorithm, to realize a learning-based adaptive controller. We investigate the performance of this approach in term of tracking error upper-bounds, for two different ES algorithms. Next, we consider the class of nonlinear systems affine in the control, and propose a learning-based approach to iteratively auto-tune the feedback gains for nonlinear stabilizing controllers.We present in this chapter some recent results on learning-based adaptive control for nonlinear systems. We first study the problem of adaptive trajectory tracking for nonlinear systems. We focus on the class of nonlinear systems with parametric uncertainties, which can be rendered integral Input-to-State Stable (iISS) w.r.t. the parameter estimation error. We argue, for this particular class of systems, that it is possible to merge together the integral Input-to-State stabilizing feedback controller and a model-free extremum seeking (ES) algorithm, to realize a learning-based adaptive controller. We investigate the performance of this approach in term of tracking error upper-bounds, for two different ES algorithms. Next, we consider the class of nonlinear systems affine in the control, and propose a learning-based approach to iteratively auto-tune the feedback gains for nonlinear stabilizing controllers.

[1]  Hakan Elmali,et al.  Robust output tracking control of nonlinear MIMO systems via sliding mode technique , 1992, Autom..

[2]  Mario A. Rotea,et al.  Analysis of multivariable extremum seeking algorithms , 2000, Proceedings of the 2000 American Control Conference. ACC (IEEE Cat. No.00CH36334).

[3]  David Angeli,et al.  A characterization of integral input-to-state stability , 2000, IEEE Trans. Autom. Control..

[4]  Håkan Hjalmarsson,et al.  Iterative feedback tuning—an overview , 2002 .

[5]  M. Krstić,et al.  Real-Time Optimization by Extremum-Seeking Control , 2003 .

[6]  Magnus Mossberg,et al.  Iterative feedback tuning of PID parameters: comparison with classical tuning rules , 2003 .

[7]  Denis Dochain,et al.  Adaptive extremum seeking control of continuous stirred-tank bioreactors , 2003 .

[8]  Miroslav Krstic,et al.  PID Tuning Using Extremum Seeking , 2005 .

[9]  Richard S. Sutton,et al.  Reinforcement Learning: An Introduction , 1998, IEEE Trans. Neural Networks.

[10]  Leszek Koszalka,et al.  An Idea of Using Reinforcement Learning in Adaptive Control Systems , 2006, International Conference on Networking, International Conference on Systems and International Conference on Mobile Communications and Learning Technologies (ICNICONSMCL'06).

[11]  Wassim M. Haddad,et al.  Impulsive and Hybrid Dynamical Systems: Stability, Dissipativity, and Control , 2006 .

[12]  Ying Tan,et al.  On non-local stability properties of extremum seeking control , 2006, Autom..

[13]  Xuping Xu,et al.  Impulsive and Hybrid Dynamical Systems: Stability, Dissipativity, and Control - s[Book review; W. M. Haddad; V. S. Chellaboina, and S. G. Nersesov] , 2007, IEEE Transactions on Automatic Control.

[14]  Martin Guay,et al.  Parameter convergence in adaptive extremum-seeking control , 2007, Autom..

[15]  Denis Dochain,et al.  Adaptive extremum-seeking control of convection-reaction distributed reactor with limited actuation , 2008, Comput. Chem. Eng..

[16]  Nahum Shimkin,et al.  Nonlinear Control Systems , 2008 .

[17]  Zhong-Ping Jiang,et al.  Necessary and Sufficient Small Gain Conditions for Integral Input-to-State Stable Systems: A Lyapunov Perspective , 2009, IEEE Transactions on Automatic Control.

[18]  Dragan Nešić,et al.  Extremum seeking control: Convergence analysis , 2009, 2009 European Control Conference (ECC).

[19]  Extremum Seeking for Model Reference Adaptive Control , 2009 .

[20]  David J. Hill,et al.  Deterministic Learning Theory , 2009 .

[21]  Kai-Yew Lum,et al.  Passive Actuators' Fault-Tolerant Control for Affine Nonlinear Systems , 2010, IEEE Transactions on Control Systems Technology.

[22]  Poorya Haghi,et al.  On the extremum seeking of model reference adaptive control in higher-dimensional systems , 2011, Proceedings of the 2011 American Control Conference.

[23]  Ying Tan,et al.  Non-local stability of a multi-variable extremum-seeking scheme , 2011, 2011 Australian Control Conference.

[24]  Rogelio Lozano,et al.  Adaptive Control: Algorithms, Analysis and Applications , 2011 .

[25]  Ying Tan,et al.  A non-gradient approach to global extremum seeking: An adaptation of the Shubert algorithm , 2013, Autom..

[26]  Denis Dochain,et al.  A time-varying extremum-seeking control approach , 2013, ACC.

[27]  Gökhan M. Atinç,et al.  Nonlinear learning-based adaptive control for electromagnetic actuators , 2013, 2013 European Control Conference (ECC).

[28]  Gökhan M. Atinç,et al.  Multi-parametric extremum seeking-based learning control for electromagnetic actuators , 2013, 2013 American Control Conference.

[29]  Alexander Scheinker,et al.  Simultaneous stabilization and optimization of unknown, time-varying systems , 2013, 2013 American Control Conference.

[30]  P. Olver Nonlinear Systems , 2013 .

[31]  Mouhacine Benosman,et al.  Learning-based adaptive control for nonlinear systems , 2014, 2014 European Control Conference (ECC).

[32]  Mouhacine Benosman,et al.  Multi-parametric extremum seeking-based auto-tuning for robust Input-Output linearization control , 2014, 53rd IEEE Conference on Decision and Control.

[33]  Gökhan M. Atinç,et al.  Extremum seeking-based adaptive control for electromagnetic actuators , 2015, Int. J. Control.

[34]  Meng Xia,et al.  Extremum Seeking-based Indirect Adaptive Control for Nonlinear Systems with State and Time-Dependent Uncertainties , 2015, ArXiv.

[35]  Gökhan M. Atinç,et al.  Non-linear adaptive control for electromagnetic actuators , 2015 .

[36]  Peter Kuster,et al.  Nonlinear And Adaptive Control Design , 2016 .

[37]  M. Benosman Extremum Seeking-Based Indirect Adaptive Control , 2017 .

[38]  Tsuyoshi Murata,et al.  {m , 1934, ACML.

[39]  Miroslav Krstic,et al.  Multivariable Extremum Seeking Feedback : Analysis and Design 1 , .