Data-Driven Model Predictive Control using Interpolated Koopman Generators

In recent years, the success of the Koopman operator in dynamical systems analysis has also fueled the development of Koopman operator-based control frameworks. In order to preserve the relatively low data requirements for an approximation via Dynamic Mode Decomposition, a quantization approach was recently proposed in [Peitz \& Klus, Automatica 106, 2019]. This way, control of nonlinear dynamical systems can be realized by means of switched systems techniques, using only a finite set of autonomous Koopman operator-based reduced models. These individual systems can be approximated very efficiently from data. The main idea is to transform a control system into a set of autonomous systems for which the optimal switching sequence has to be computed. In this article, we extend these results to continuous control inputs using relaxation. This way, we combine the advantages of the data efficiency of approximating a finite set of autonomous systems with continuous controls. We show that when using the Koopman generator, this relaxation --- realized by linear interpolation between two operators --- does not introduce any error for control affine systems. This allows us to control high-dimensional nonlinear systems using bilinear, low-dimensional surrogate models. The efficiency of the proposed approach is demonstrated using several examples with increasing complexity, from the Duffing oscillator to the chaotic fluidic pinball.

[1]  Steven L. Brunton,et al.  Machine Learning Control – Taming Nonlinear Dynamics and Turbulence , 2016, Fluid Mechanics and Its Applications.

[2]  Aleksandar Jemcov,et al.  OpenFOAM: A C++ Library for Complex Physics Simulations , 2007 .

[3]  Sophie Papst,et al.  Computational Methods For Fluid Dynamics , 2016 .

[4]  Steven L. Brunton,et al.  Koopman Invariant Subspaces and Finite Linear Representations of Nonlinear Dynamical Systems for Control , 2015, PloS one.

[5]  B. R. Noack,et al.  Closed-Loop Turbulence Control: Progress and Challenges , 2015 .

[6]  Igor Mezic,et al.  Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control , 2016, Autom..

[7]  Stefan Klus,et al.  Koopman operator-based model reduction for switched-system control of PDEs , 2017, Autom..

[8]  Stefan Klus,et al.  Tensor-based dynamic mode decomposition , 2016, Nonlinearity.

[9]  G. Martin,et al.  Nonlinear model predictive control , 1999, Proceedings of the 1999 American Control Conference (Cat. No. 99CH36251).

[10]  K. Kunisch,et al.  Control of the Burgers Equation by a Reduced-Order Approach Using Proper Orthogonal Decomposition , 1999 .

[11]  Steven L. Brunton,et al.  Data-driven discovery of Koopman eigenfunctions for control , 2017, Mach. Learn. Sci. Technol..

[12]  Clarence W. Rowley,et al.  Linearly-Recurrent Autoencoder Networks for Learning Dynamics , 2017, SIAM J. Appl. Dyn. Syst..

[13]  Stefan Klus,et al.  On the numerical approximation of the Perron-Frobenius and Koopman operator , 2015, 1512.05997.

[14]  L. Sirovich.  TURBULENCE AND THE DYNAMICS OF COHERENT STRUCTURES PART I : COHERENT STRUCTURES , 2016 .

[15]  George Isac,et al.  Newton-Like Methods , 2002 .

[16]  S. Sager.  Reformulations and algorithms for the optimization of switching decisions in nonlinear optimal control , 2009 .

[17]  P. Schmid,et al.  Dynamic mode decomposition of numerical and experimental data , 2008, Journal of Fluid Mechanics.

[18]  Steven L. Brunton,et al.  Generalizing Koopman Theory to Allow for Inputs and Control , 2016, SIAM J. Appl. Dyn. Syst..

[19]  I. Mezić,et al.  Spectral analysis of nonlinear flows , 2009, Journal of Fluid Mechanics.

[20]  Ioannis G Kevrekidis,et al.  Extended dynamic mode decomposition with dictionary learning: A data-driven adaptive spectral decomposition of the Koopman operator. , 2017, Chaos.

[21]  L. Sirovich.  Turbulence and the dynamics of coherent structures. I. Coherent structures , 1987 .

[22]  Steven L. Brunton,et al.  Deep model predictive flow control with limited sensor data and online learning , 2020, Theoretical and Computational Fluid Dynamics.

[23]  Karen Willcox,et al.  A Survey of Projection-Based Model Reduction Methods for Parametric Dynamical Systems , 2015, SIAM Rev..

[24]  Derek A. Paley,et al.  Global bilinearization and controllability of control-affine nonlinear systems: A Koopman spectral approach , 2017, 2017 IEEE 56th Annual Conference on Decision and Control (CDC).

[25]  J. Marsden,et al.  Discrete mechanics and optimal control , 2005 .

[26]  Clarence W. Rowley,et al.  Extending Data-Driven Koopman Analysis to Actuated Systems , 2016 .

[27]  Clarence W. Rowley,et al.  Model Reduction for fluids, Using Balanced Proper Orthogonal Decomposition , 2005, Int. J. Bifurc. Chaos.

[28]  M. Dellnitz,et al.  Set-Oriented Multiobjective Optimal Control of PDEs using Proper Orthogonal Decomposition , 2018 .

[29]  Steven L. Brunton,et al.  Dynamic Mode Decomposition with Control , 2014, SIAM J. Appl. Dyn. Syst..

[30]  I. Mezić,et al.  Applied Koopmanism. , 2012, Chaos.

[31]  T. Liggett.  Continuous Time Markov Processes: An Introduction , 2010 .

[32]  M. Mackey,et al.  Chaos, Fractals, and Noise: Stochastic Aspects of Dynamics , 1998 .

[33]  Steven L. Brunton,et al.  Chaos as an intermittently forced linear system , 2016, Nature Communications.

[34]  Igor Mezic,et al.  On Convergence of Extended Dynamic Mode Decomposition to the Koopman Operator , 2017, J. Nonlinear Sci..

[35]  Stefan Klus,et al.  Feedback Control of Nonlinear PDEs Using Data-Efficient Reduced Order Models Based on the Koopman Operator , 2018, 1806.09898.

[36]  B. O. Koopman,et al.  Hamiltonian Systems and Transformation in Hilbert Space. , 1931, Proceedings of the National Academy of Sciences of the United States of America.

[37]  Steven L. Brunton,et al.  On dynamic mode decomposition: Theory and applications , 2013, 1312.0041.

[38]  B. R. Noack,et al.  Route to Chaos in the Fluidic Pinball , 2018, Volume 1: Flow Manipulation and Active Control; Bio-Inspired Fluid Mechanics; Boundary Layer and High-Speed Flows; Fluids Engineering Education; Transport Phenomena in Energy Conversion and Mixing; Turbulent Flows; Vortex Dynamics; DNS/LES and Hybrid RANS.

[39]  Bernard Haasdonk,et al.  THE LOCALIZED REDUCED BASIS MULTISCALE METHOD , 2015 .

[40]  Stefan Klus,et al.  Data-driven approximation of the Koopman generator: Model reduction, system identification, and control , 2019 .

[41]  A. Kolmogoroff.  Über die analytischen Methoden in der Wahrscheinlichkeitsrechnung , 1931 .

[42]  R. Handel.  Probability in High Dimension , 2014 .

[43]  Gerhard Reinelt,et al.  Direct methods with maximal lower bound for mixed-integer optimal control problems , 2009, Math. Program..

[44]  M. Hinze,et al.  Proper Orthogonal Decomposition Surrogate Models for Nonlinear Dynamical Systems: Error Estimates and Suboptimal Control , 2005 .

[45]  J. Rogers.  Chaos , 1876 .

[46]  Gianluigi Rozza,et al.  Model Order Reduction in Fluid Dynamics: Challenges and Perspectives , 2014 .

[47]  Clarence W. Rowley,et al.  A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition , 2014, Journal of Nonlinear Science.

[48]  I. Mezić.  Spectral Properties of Dynamical Systems, Model Reduction and Decompositions , 2005 .