In this article we address the question whether it is possible to learn the differential equations describing the physical properties of a dynamical system, subject to non-conservative forces, from observations of its realspace trajectory(ies) only. We introduce a network that incorporates a difference approximation for the second order derivative in terms of residual connections between convolutional blocks, whose shared weights represent the coefficients of a second order ordinary differential equation. We further combine this solver-like architecture with a convolutional network, capable of learning the relation between trajectories of coupled oscillators and therefore allows us to make a stable forecast even if the system is only partially observed. We optimize this map together with the solver network, while sharing their weights, to form a powerful framework capable of learning the complex physical properties of a dissipative dynamical system.
[1]
Jason Yosinski,et al.
Hamiltonian Neural Networks
,
2019,
NeurIPS.
[2]
Bin Dong,et al.
PDE-Net: Learning PDEs from Data
,
2017,
ICML.
[3]
E Weinan,et al.
A Proposal on Machine Learning via Dynamical Systems
,
2017,
Communications in Mathematics and Statistics.
[4]
Yee Whye Teh,et al.
Augmented Neural ODEs
,
2019,
NeurIPS.
[5]
Jian Sun,et al.
Deep Residual Learning for Image Recognition
,
2015,
2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).
[6]
David Duvenaud,et al.
Neural Ordinary Differential Equations
,
2018,
NeurIPS.
[7]
Bin Dong,et al.
Beyond Finite Layer Neural Networks: Bridging Deep Architectures and Numerical Differential Equations
,
2017,
ICML.