Dissipative Hamiltonian Neural Networks: Learning Dissipative and Conservative Dynamics Separately

Understanding natural symmetries is key to making sense of our complex and ever-changing world. Recent work has shown that neural networks can learn such symmetries directly from data using Hamiltonian Neural Networks (HNNs). But HNNs struggle when trained on datasets where energy is not conserved. In this paper, we ask whether it is possible to identify and decompose conservative and dissipative dynamics simultaneously. We propose Dissipative Hamiltonian Neural Networks (D-HNNs), which parameterize both a Hamiltonian and a Rayleigh dissipation function. Taken together, they represent an implicit Helmholtz decomposition which can separate dissipative effects such as friction from symmetries such as conservation of energy. We train our model to decompose a damped massspring system into its friction and inertial terms and then show that this decomposition can be used to predict dynamics for unseen friction coefficients. Then we apply our model to real world data including a large, noisy ocean current dataset where decomposing the velocity field yields useful scientific insights.

[1]  Chongke Bi,et al.  Helmholtz–Hodge decomposition-based 2D and 3D ocean surface current visualization for mesoscale eddy detection , 2019, J. Vis..

[2]  E. Minguzzi,et al.  Rayleigh’s dissipation function at work , 2014, 1409.4041.

[3]  Kurt Hornik,et al.  Multilayer feedforward networks are universal approximators , 1989, Neural Networks.

[4]  Hod Lipson,et al.  Distilling Free-Form Natural Laws from Experimental Data , 2009, Science.

[5]  PascucciValerio,et al.  The Helmholtz-Hodge Decomposition—A Survey , 2013 .

[6]  Kyle Cranmer,et al.  Hamiltonian Graph Networks with ODE Integrators , 2019, ArXiv.

[7]  Maik Moeller,et al.  Introduction to Electrodynamics , 2017 .

[8]  Rui Xu,et al.  Discovering Symbolic Models from Deep Learning with Inductive Biases , 2020, NeurIPS.

[9]  Jan Peters,et al.  Deep Lagrangian Networks: Using Physics as Model Prior for Deep Learning , 2019, ICLR.

[10]  Amit Chakraborty,et al.  Dissipative SymODEN: Encoding Hamiltonian Dynamics with Dissipation and Control into Deep Learning , 2020, ArXiv.

[11]  David Von Dollen,et al.  TensorFlow Quantum: A Software Framework for Quantum Machine Learning , 2020, ArXiv.

[12]  C. Boone,et al.  Integration of HF Radar Observations for an Enhanced Coastal Mean Dynamic Topography , 2020, Frontiers in Marine Science.

[13]  Andrew Jaegle,et al.  Hamiltonian Generative Networks , 2020, ICLR.

[14]  R. Ferrari,et al.  Wave–vortex decomposition of one-dimensional ship-track data , 2014, Journal of Fluid Mechanics.

[15]  H. Helmholtz Über Integrale der hydrodynamischen Gleichungen, welche den Wirbelbewegungen entsprechen. , 1858 .

[16]  Volker Michel,et al.  Regularisation of the Helmholtz decomposition and its application to geomagnetic field modelling , 2010 .

[17]  B. Hamann,et al.  A three‐dimensional eddy census of a high‐resolution global ocean simulation , 2013 .

[18]  J. Stam Real-Time Fluid Dynamics for Games , 2003 .

[19]  Phillip Colella,et al.  An efficient second-order projection method for viscous incompressible flow , 1991 .

[20]  David Duvenaud,et al.  Neural Ordinary Differential Equations , 2018, NeurIPS.

[21]  Duc Quang Nguyen,et al.  Physically based modeling and animation of fire , 2002, ACM Trans. Graph..

[22]  Akshunna S. Dogra,et al.  Hamiltonian Neural Networks for solving differential equations , 2020, ArXiv.

[23]  Jianyu Zhang,et al.  Symplectic Recurrent Neural Networks , 2020, ICLR.

[24]  Emmy Noether,et al.  Invariant Variation Problems , 2005, physics/0503066.

[25]  Amit Chakraborty,et al.  Symplectic ODE-Net: Learning Hamiltonian Dynamics with Control , 2020, ICLR.

[26]  D. Chelton,et al.  Global observations of nonlinear mesoscale eddies , 2011 .

[27]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[28]  Anup Basu,et al.  Applications of the Discrete Hodge Helmholtz Decomposition to Image and Video Processing , 2005, PReMI.