Learning Dynamical Systems with Side Information (short version)

We present a mathematical formalism and a computational framework for the problem of learning a dynamical system from noisy observations of a few trajectories and subject to side information (e.g., physical laws or contextual knowledge). We identify six classes of side information which can be imposed by semidefinite programming and that arise naturally in many applications. We demonstrate their value on two examples from epidemiology and physics. Some density results on polynomial dynamical systems that either exactly or approximately satisfy side information are also presented.

[1]  Han-Pang Huang,et al.  Learn the Lagrangian: A Vector-Valued RKHS Approach to Identifying Lagrangian Systems , 2016, IEEE Transactions on Cybernetics.

[2]  Marco Pavone,et al.  Learning Stabilizable Dynamical Systems via Control Contraction Metrics , 2018, WAFR.

[3]  Pablo A. Parrilo,et al.  Semidefinite programming relaxations for semialgebraic problems , 2003, Math. Program..

[4]  J. William Helton,et al.  Semidefinite representation of convex sets , 2007, Math. Program..

[5]  Vikas Sindhwani,et al.  Learning Contracting Vector Fields For Stable Imitation Learning , 2018, ArXiv.

[6]  Learning Dynamical Systems with Side Information (Proofs) , 2020 .

[7]  P. Parrilo Structured semidefinite programs and semialgebraic geometry methods in robustness and optimization , 2000 .

[8]  F. Lukács Verschärfung des ersten Mittelwertsatzes der Integralrechnung für rationale Polynome , 1918 .

[9]  Georgina Hall,et al.  Optimization over Nonnegative and Convex Polynomials With and Without Semidefinite Programming , 2018, ArXiv.

[10]  Linan Zhang,et al.  Extracting structured dynamical systems using sparse optimization with very few samples , 2018, Multiscale Model. Simul..

[11]  Sicun Gao,et al.  Neural Lyapunov Control , 2020, NeurIPS.

[12]  Ufuk Topcu,et al.  Control-Oriented Learning of Lagrangian and Hamiltonian Systems , 2018, 2018 Annual American Control Conference (ACC).

[13]  P. Olver Nonlinear Systems , 2013 .

[14]  P. Kaye Infectious diseases of humans: Dynamics and control , 1993 .

[15]  Jean B. Lasserre,et al.  Convexity in SemiAlgebraic Geometry and Polynomial Optimization , 2008, SIAM J. Optim..

[16]  Jean B. Lasserre,et al.  Global Optimization with Polynomials and the Problem of Moments , 2000, SIAM J. Optim..

[17]  Jason Yosinski,et al.  Hamiltonian Neural Networks , 2019, NeurIPS.