On Analytical Construction of Observable Functions in Extended Dynamic Mode Decomposition for Nonlinear Estimation and Prediction

We propose an analytical construction of observable functions in the extended dynamic mode decomposition (EDMD) algorithm. EDMD is a numerical method for approximating the spectral properties of the Koopman operator. The choice of observable functions is fundamental for the application of EDMD to nonlinear problems arising in systems and control. Existing methods either start from a set of dictionary functions and look for the subset that best fits, in a certain sense, the underlying nonlinear dynamics; or they rely on machine learning algorithms, e.g., neural networks, to "learn" observable functions that are not explicitly available. Conversely, we start from the dynamical system model and lift it through the Lie derivatives, rendering it into a polynomial form. This transformation into a polynomial form is exact, although not unique, and it provides an adequate set of observable functions. The strength of the proposed approach is its applicability to a broader class of nonlinear dynamical systems, particularly those with nonpolynomial functions and compositions thereof. Moreover, it retains the physical interpretability of the underlying dynamical system and can be readily integrated into existing numerical libraries. The proposed approach is illustrated with an application to electric power systems. The modeled system consists of a single generator connected to an infinite bus, in which case nonlinear terms include sine and cosine functions. The results demonstrate the effectiveness of the proposed procedure in off-attractor nonlinear dynamics for estimation and prediction; the observable functions obtained from the proposed construction outperformed existing methods that use dictionary functions comprising monomials or radial basis functions.

[1]  A. Banaszuk,et al.  Linear observer synthesis for nonlinear systems using Koopman Operator framework , 2016 .

[2]  Enoch Yeung,et al.  A Class of Logistic Functions for Approximating State-Inclusive Koopman Operators , 2017, 2018 Annual American Control Conference (ACC).

[3]  Chenjie Gu,et al.  QLMOR: A Projection-Based Nonlinear Model Order Reduction Approach Using Quadratic-Linear Representation of Nonlinear Systems , 2011, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems.

[4]  Steven L. Brunton,et al.  Koopman Invariant Subspaces and Finite Linear Representations of Nonlinear Dynamical Systems for Control , 2015, PloS one.

[5]  D. Sigg,et al.  Modeling ion channels: Past, present, and future , 2014, The Journal of general physiology.

[6]  I. Mezic,et al.  Nonlinear Koopman Modes and Coherency Identification of Coupled Swing Dynamics , 2011, IEEE Transactions on Power Systems.

[7]  I. Mezić,et al.  Applied Koopmanism. , 2012, Chaos.

[8]  Igor Mezic,et al.  On Convergence of Extended Dynamic Mode Decomposition to the Koopman Operator , 2017, J. Nonlinear Sci..

[9]  W. Steeb,et al.  Nonlinear dynamical systems and Carleman linearization , 1991 .

[10]  Clarence W. Rowley,et al.  Linearly-Recurrent Autoencoder Networks for Learning Dynamics , 2017, SIAM J. Appl. Dyn. Syst..

[11]  Todd Murphey,et al.  Local Koopman Operators for Data-Driven Control of Robotic Systems , 2019, Robotics: Science and Systems.

[12]  Lamine Mili,et al.  Data-Driven Participation Factors for Nonlinear Systems Based on Koopman Mode Decomposition , 2018, IEEE Control Systems Letters.

[13]  Steven L. Brunton,et al.  Dynamic mode decomposition - data-driven modeling of complex systems , 2016 .

[14]  Steven L. Brunton,et al.  Deep learning for universal linear embeddings of nonlinear dynamics , 2017, Nature Communications.

[15]  Clarence W. Rowley,et al.  A Data–Driven Approximation of the Koopman Operator: Extending Dynamic Mode Decomposition , 2014, Journal of Nonlinear Science.

[16]  Jorge Goncalves,et al.  Koopman-Based Lifting Techniques for Nonlinear Systems Identification , 2017, IEEE Transactions on Automatic Control.

[17]  Lamine Mili,et al.  A Robust Data-Driven Koopman Kalman Filter for Power Systems Dynamic State Estimation , 2018, IEEE Transactions on Power Systems.

[18]  Benjamin Peherstorfer,et al.  Lift & Learn: Physics-informed machine learning for large-scale nonlinear dynamical systems , 2019, Physica D: Nonlinear Phenomena.

[19]  I. Mezić,et al.  Spectral analysis of nonlinear flows , 2009, Journal of Fluid Mechanics.

[20]  Igor Mezic,et al.  Linearization in the large of nonlinear systems and Koopman operator spectrum , 2013 .

[21]  Soumya Kundu,et al.  Learning Deep Neural Network Representations for Koopman Operators of Nonlinear Dynamical Systems , 2017, 2019 American Control Conference (ACC).

[22]  Lamine Mili,et al.  Robust Koopman Operator-based Kalman Filter for Power Systems Dynamic State Estimation , 2018, 2018 IEEE Power & Energy Society General Meeting (PESGM).

[23]  S. Selberherr,et al.  A review of hydrodynamic and energy-transport models for semiconductor device simulation , 2003, Proc. IEEE.

[24]  Igor Mezic,et al.  Global Stability Analysis Using the Eigenfunctions of the Koopman Operator , 2014, IEEE Transactions on Automatic Control.

[25]  P.L. Dandeno Current Usage & Suggested Practices in Power System Stability Simulations for Synchronous Machines , 1986, IEEE Transactions on Energy Conversion.

[26]  B. O. Koopman,et al.  Hamiltonian Systems and Transformation in Hilbert Space. , 1931, Proceedings of the National Academy of Sciences of the United States of America.

[27]  S. Brunton,et al.  Discovering governing equations from data by sparse identification of nonlinear dynamical systems , 2015, Proceedings of the National Academy of Sciences.

[28]  Ioannis G Kevrekidis,et al.  Extended dynamic mode decomposition with dictionary learning: A data-driven adaptive spectral decomposition of the Koopman operator. , 2017, Chaos.

[29]  P. Kundur,et al.  Definition and classification of power system stability IEEE/CIGRE joint task force on stability terms and definitions , 2004, IEEE Transactions on Power Systems.

[30]  Takashi Hikihara,et al.  Applied Koopman Operator Theory for Power Systems Technology , 2016, ArXiv.

[31]  Todd D. Murphey,et al.  Feedback synthesis for underactuated systems using sequential second-order needle variations , 2018, Int. J. Robotics Res..

[32]  Milan Korda,et al.  Optimal Construction of Koopman Eigenfunctions for Prediction and Control , 2018, IEEE Transactions on Automatic Control.

[33]  Igor Mezic,et al.  Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive control , 2016, Autom..