Symplectic Gaussian process regression of maps in Hamiltonian systems.

We present an approach to construct structure-preserving emulators for Hamiltonian flow maps and Poincaré maps based directly on orbit data. Intended applications are in moderate-dimensional systems, in particular, long-term tracing of fast charged particles in accelerators and magnetic plasma confinement configurations. The method is based on multi-output Gaussian process (GP) regression on scattered training data. To obtain long-term stability, the symplectic property is enforced via the choice of the matrix-valued covariance function. Based on earlier work on spline interpolation, we observe derivatives of the generating function of a canonical transformation. A product kernel produces an accurate implicit method, whereas a sum kernel results in a fast explicit method from this approach. Both are related to symplectic Euler methods in terms of numerical integration but fulfill a complementary purpose. The developed methods are first tested on the pendulum and the Hénon-Heiles system and results compared to spectral regression of the flow map with orthogonal polynomials. Chaotic behavior is studied on the standard map. Finally, the application to magnetic field line tracing in a perturbed tokamak configuration is demonstrated. As an additional feature, in the limit of small mapping times, the Hamiltonian function can be identified with a part of the generating function and thereby learned from observed time-series data of the system's evolution. For implicit GP methods, we demonstrate regression performance comparable to spectral bases and artificial neural networks for symplectic flow maps, applicability to Poincaré maps, and correct representation of chaotic diffusion as well as a substantial increase in performance for learning the Hamiltonian function compared to existing approaches.

[1]  E. Hairer,et al.  Geometric Numerical Integration: Structure Preserving Algorithms for Ordinary Differential Equations , 2004 .

[2]  B. Chirikov A universal instability of many-dimensional oscillator systems , 1979 .

[3]  M. Hénon,et al.  The applicability of the third integral of motion: Some numerical experiments , 1964 .

[4]  Ioannis G. Kevrekidis,et al.  On learning Hamiltonian systems from data. , 2019, Chaos.

[5]  Katharina Rath,et al.  Gaussian Process Regression for Data Fulfilling Linear Differential Equations with Localized Sources † , 2020, Entropy.

[6]  S. Kasilov,et al.  Solution of the drift kinetic equation in the regime of weak collisions by stochastic mapping techniques , 1997 .

[7]  J. V. José,et al.  Classical Dynamics: A Contemporary Approach , 1998 .

[8]  R. Maulik,et al.  Fast neural Poincaré maps for toroidal magnetic fields , 2020, Plasma Physics and Controlled Fusion.

[9]  Andrew Jaegle,et al.  Hamiltonian Generative Networks , 2020, ICLR.

[10]  A. Boozer TIME DEPENDENT DRIFT HAMILTONIAN , 1982 .

[11]  Jorge Nocedal,et al.  Algorithm 778: L-BFGS-B: Fortran subroutines for large-scale bound-constrained optimization , 1997, TOMS.

[12]  Fernando Casas,et al.  A Concise Introduction to Geometric Numerical Integration , 2016 .

[13]  Michael B. Miller Linear Regression Analysis , 2013 .

[14]  Paris Perdikaris,et al.  Inferring solutions of differential equations using noisy multi-fidelity data , 2016, J. Comput. Phys..

[15]  G. Zaslavsky,et al.  Self-similarity, renormalization, and phase space nonuniformity of Hamiltonian chaotic dynamics. , 1997, Chaos.

[16]  Harald Niederreiter,et al.  Random number generation and Quasi-Monte Carlo methods , 1992, CBMS-NSF regional conference series in applied mathematics.

[17]  S. Fishman,et al.  Diffusion in the standard map , 1985 .

[18]  Carsten Franke,et al.  Solving partial differential equations by collocation using radial basis functions , 1998, Appl. Math. Comput..

[20]  E. Zotos An overview of the escape dynamics in the Hénon–Heiles Hamiltonian system , 2017, 1709.04360.

[21]  Y. Ichikawa,et al.  Stochastic diffusion in the standard map , 1986 .

[22]  J. Marsden,et al.  Introduction to mechanics and symmetry , 1994 .

[23]  Construction of Large Period Symplectic Maps by Interpolative Methods , 2009 .

[24]  Meng Li,et al.  Canonical straight field line magnetic flux coordinates for tokamaks , 2016, Journal of Computational Physics.

[25]  Forest,et al.  Construction of symplectic maps for nonlinear motion of particles in accelerators. , 1994, Physical review. E, Statistical physics, plasmas, fluids, and related interdisciplinary topics.

[26]  G. Quispel,et al.  A new class of energy-preserving numerical integration methods , 2008 .

[27]  Neil D. Lawrence,et al.  Kernels for Vector-Valued Functions: a Review , 2011, Found. Trends Mach. Learn..

[28]  J. Burby,et al.  Toroidal regularization of the guiding center Lagrangian , 2017, 1709.02867.

[29]  Houman Owhadi,et al.  Bayesian Numerical Homogenization , 2014, Multiscale Model. Simul..

[30]  K. Berenhaut,et al.  Applied Mathematical Sciences , 2012 .

[31]  Jason Yosinski,et al.  Hamiltonian Neural Networks , 2019, NeurIPS.

[32]  Jianyu Zhang,et al.  Symplectic Recurrent Neural Networks , 2020, ICLR.

[33]  Carl E. Rasmussen,et al.  Gaussian processes for machine learning , 2005, Adaptive computation and machine learning.

[34]  Radford M. Neal MCMC Using Hamiltonian Dynamics , 2011, 1206.1901.

[35]  Christopher G. Albert,et al.  Symplectic integration with non-canonical quadrature for guiding-center orbits in magnetic confinement devices , 2019, J. Comput. Phys..

[36]  Carl E. Rasmussen,et al.  Derivative Observations in Gaussian Process Models of Dynamic Systems , 2002, NIPS.

[37]  Roscoe White,et al.  The Theory of Toroidally Confined Plasmas: Revised Second Edition , 2006 .

[38]  V. Nemov,et al.  Mapping technique for stellarators , 2002 .

[39]  E. Kansa MULTIQUADRICS--A SCATTERED DATA APPROXIMATION SCHEME WITH APPLICATIONS TO COMPUTATIONAL FLUID-DYNAMICS-- II SOLUTIONS TO PARABOLIC, HYPERBOLIC AND ELLIPTIC PARTIAL DIFFERENTIAL EQUATIONS , 1990 .

[40]  J. Cary,et al.  Noncanonical Hamiltonian mechanics and its application to magnetic field line flow , 1983 .

[41]  Andrew Gordon Wilson,et al.  Scaling Gaussian Process Regression with Derivatives , 2018, NeurIPS.

[42]  P. Morrison,et al.  Structure and structure-preserving algorithms for plasma physics , 2016, 1612.06734.

[43]  Jooyoung Park,et al.  Universal Approximation Using Radial-Basis-Function Networks , 1991, Neural Computation.