Interpretable Conservation Law Estimation by Deriving the Symmetries of Dynamics from Trained Deep Neural Networks

Understanding complex systems with their reduced model is one of the central roles in scientific activities. Although physics has greatly been developed with the physical insights of physicists, it is sometimes challenging to build a reduced model of such complex systems on the basis of insights alone. We propose a novel framework that can infer the hidden conservation laws of a complex system from deep neural networks (DNNs) that have been trained with physical data of the system. The purpose of the proposed framework is not to analyze physical data with deep learning, but to extract interpretable physical information from trained DNNs. With Noether's theorem and by an efficient sampling method, the proposed framework infers conservation laws by extracting symmetries of dynamics from trained DNNs. The proposed framework is developed by deriving the relationship between a manifold structure of time-series dataset and the necessary conditions for Noether's theorem. The feasibility of the proposed framework has been verified in some primitive cases for which the conservation law is well known. We also apply the proposed framework to conservation law estimation for a more practical case that is a large-scale collective motion system in the metastable state, and we obtain a result consistent with that of a previous study.

[1]  Steven L. Brunton,et al.  Deep learning for universal linear embeddings of nonlinear dynamics , 2017, Nature Communications.

[2]  Geoffrey E. Hinton,et al.  Reducing the Dimensionality of Data with Neural Networks , 2006, Science.

[3]  Sumio Watanabe,et al.  Asymptotic behavior of exchange ratio in exchange Monte Carlo method , 2008, Neural Networks.

[4]  I. Couzin,et al.  Collective memory and spatial sorting in animal groups. , 2002, Journal of theoretical biology.

[5]  K. Hukushima,et al.  Exchange Monte Carlo Method and Application to Spin Glass Simulations , 1995, cond-mat/9512035.

[6]  Steven L. Brunton,et al.  Deep learning of dynamics and signal-noise decomposition with time-stepping constraints , 2018, J. Comput. Phys..

[7]  D. Pines A Collective Description of Electron Interactions: II. Collective vs Individual Particle Aspects of the Interactions , 1952 .

[8]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[9]  J. Struckmeier,et al.  Canonical transformations and exact invariants for time‐dependent Hamiltonian systems , 2001, Annalen der Physik.

[10]  Taku Komura,et al.  Topology matching for fully automatic similarity estimation of 3D shapes , 2001, SIGGRAPH.

[11]  Wayne A. Fuller,et al.  Statistical analysis of measurement error models and applications : proceedings of the AMS-IMS-SIAM Joint Summer Research conference held June 10-16, 1989, with support from the National Science Foundation and the U.S. Army Research Office , 1990 .

[12]  電子情報通信学会 The Transactions of the Institute of Electronics, Information and Communication Engineers , 1987 .

[13]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[14]  Saito Hiroki,et al.  Machine Learning Technique to Find Quantum Many-Body Ground States of Bosons on a Lattice , 2018 .

[15]  S. Huber,et al.  Learning phase transitions by confusion , 2016, Nature Physics.

[16]  A. Tanaka,et al.  Detection of phase transition via convolutional neural network , 2016, 1609.09087.

[17]  B. M. Fulk MATH , 1992 .

[18]  David S. Touretzky,et al.  Advances in neural information processing systems 2 , 1989 .

[19]  Pengfei Zhang,et al.  Machine Learning Topological Invariants with Neural Networks , 2017, Physical review letters.

[20]  Hod Lipson,et al.  Distilling Free-Form Natural Laws from Experimental Data , 2009, Science.

[21]  W. K. Hastings,et al.  Monte Carlo Sampling Methods Using Markov Chains and Their Applications , 1970 .

[22]  Remarks on Bloch's Method of Sound Waves applied to Many-Fermion Problems , 1950 .

[23]  H. H. Rogers Symmetry transformations of the classical Kepler problem. , 1973 .

[24]  Tanaka Akinori,et al.  Detection of Phase Transition via Convolutional Neural Networks , 2016, 1609.09087.

[25]  Roger G. Melko,et al.  Machine learning phases of matter , 2016, Nature Physics.

[26]  Victor Solo,et al.  Dimension Estimation in Noisy PCA With SURE and Random Matrix Theory , 2008, IEEE Transactions on Signal Processing.

[27]  Hiroki Saito,et al.  Machine Learning Technique to Find Quantum Many-Body Ground States of Bosons on a Lattice , 2017, 1709.05468.

[28]  T. Ohtsuki,et al.  Deep Learning the Quantum Phase Transitions in Random Electron Systems: Applications to Three Dimensions , 2016, 1612.04909.

[29]  Juan Carrasquilla,et al.  Machine learning quantum phases of matter beyond the fermion sign problem , 2016, Scientific Reports.

[30]  G. Schwarz Estimating the Dimension of a Model , 1978 .

[31]  A. Czirók,et al.  Collective Motion , 1999, physics/9902023.

[32]  Michael J. Watts,et al.  IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS Publication Information , 2020, IEEE Transactions on Neural Networks and Learning Systems.

[33]  Tomi Ohtsuki,et al.  Deep Learning the Quantum Phase Transitions in Random Two-Dimensional Electron Systems , 2016, 1610.00462.

[34]  Dapeng Oliver Wu,et al.  Why Deep Learning Works: A Manifold Disentanglement Perspective , 2016, IEEE Transactions on Neural Networks and Learning Systems.

[35]  小谷 正雄 日本物理学会誌及びJournal of the Physical Society of Japanの月刊について , 1955 .

[36]  Mizuki Oka,et al.  Life as an emergent phenomenon: studies from a large-scale boid simulation and web data , 2017, Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences.

[37]  R. Melko,et al.  Machine Learning Phases of Strongly Correlated Fermions , 2016, Physical Review X.

[38]  David Pines,et al.  A Collective Description of Electron Interactions. I. Magnetic Interactions , 1951 .