Graph dynamical networks for unsupervised learning of atomic scale dynamics in materials

Understanding the dynamical processes that govern the performance of functional materials is essential for the design of next generation materials to tackle global energy and environmental challenges. Many of these processes involve the dynamics of individual atoms or small molecules in condensed phases, e.g. lithium ions in electrolytes, water molecules in membranes, molten atoms at interfaces, etc., which are difficult to understand due to the complexity of local environments. In this work, we develop graph dynamical networks, an unsupervised learning approach for understanding atomic scale dynamics in arbitrary phases and environments from molecular dynamics simulations. We show that important dynamical information, which would be difficult to obtain otherwise, can be learned for various multi-component amorphous material systems. With the large amounts of molecular dynamics data generated every day in nearly every aspect of materials design, this approach provides a broadly applicable, automated tool to understand atomic scale dynamics in material systems.Understanding local dynamical processes in materials is challenging due to the complexity of the local atomic environments. Here the authors propose a graph dynamical networks approach that is shown to learn the atomic scale dynamics in arbitrary phases and environments from molecular dynamics simulations.

[1]  W. Meyer,et al.  Polymer electrolytes for lithium-ion batteries. , 1998, Advanced materials.

[2]  B. O. Koopman,et al.  Hamiltonian Systems and Transformation in Hilbert Space. , 1931, Proceedings of the National Academy of Sciences of the United States of America.

[3]  David L. Price,et al.  Relaxation in polymer electrolytes on the nanosecond timescale , 2000, Nature.

[4]  Hao Wu,et al.  Variational Approach for Learning Markov Processes from Time Series Data , 2017, Journal of Nonlinear Science.

[5]  Pietro Liò,et al.  Graph Attention Networks , 2017, ICLR.

[6]  Hao Wu,et al.  Deep Generative Markov State Models , 2018, NeurIPS.

[7]  K. Funke,et al.  Jump relaxation in solid electrolytes , 1993 .

[8]  K-R Müller,et al.  SchNet - A deep learning architecture for molecules and materials. , 2017, The Journal of chemical physics.

[9]  Sheng Dai,et al.  Water desalination using nanoporous single-layer graphene. , 2015, Nature nanotechnology.

[10]  Francisco Caleyo,et al.  Markov Chain Models for the Stochastic Modeling of Pitting Corrosion , 2013 .

[11]  Vijay S. Pande,et al.  Transfer Learning from Markov Models Leads to Efficient Sampling of Related Systems. , 2017, The journal of physical chemistry. B.

[12]  Alexandre Tkatchenko,et al.  Quantum-chemical insights from deep tensor neural networks , 2016, Nature Communications.

[13]  Doron Aurbach,et al.  Challenges in the development of advanced Li-ion batteries: a review , 2011 .

[14]  Vijay S. Pande,et al.  Molecular graph convolutions: moving beyond fingerprints , 2016, Journal of Computer-Aided Molecular Design.

[15]  V. Pande,et al.  Markov State Models: From an Art to a Science. , 2018, Journal of the American Chemical Society.

[16]  Hao Wu,et al.  VAMPnets for deep learning of molecular kinetics , 2017, Nature Communications.

[17]  Alain Guyot,et al.  Polymer electrolytes , 1985, Polymer Bulletin.

[18]  Ioannis G Kevrekidis,et al.  Extended dynamic mode decomposition with dictionary learning: A data-driven adaptive spectral decomposition of the Koopman operator. , 2017, Chaos.

[19]  Georges Belfort,et al.  Membrane Desalination: Where Are We, and What Can We Learn from Fundamentals? , 2016, Annual review of chemical and biomolecular engineering.

[20]  Rachel B. Getman,et al.  Review and analysis of molecular simulations of methane, hydrogen, and acetylene storage in metal-organic frameworks. , 2012, Chemical reviews.

[21]  Shou-Cheng Zhang,et al.  Learning atoms for materials discovery , 2018, Proceedings of the National Academy of Sciences.

[22]  Yuan Yu,et al.  TensorFlow: A system for large-scale machine learning , 2016, OSDI.

[23]  Jeffrey C Grossman,et al.  Correlations from Ion Pairing and the Nernst-Einstein Equation. , 2018, Physical review letters.

[24]  Frank Noé,et al.  Time-lagged autoencoders: Deep learning of slow collective variables for molecular kinetics , 2017, The Journal of chemical physics.

[25]  E Weinan,et al.  Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics , 2017, Physical review letters.

[26]  Feng Deng,et al.  Acidic Properties and Structure-Activity Correlations of Solid Acid Catalysts Revealed by Solid-State NMR Spectroscopy. , 2016, Accounts of chemical research.

[27]  C. Read From Art to Science , 2014 .

[28]  F. Noé,et al.  Collective hydrogen-bond rearrangement dynamics in liquid water. , 2018, The Journal of chemical physics.

[29]  Steven L. Brunton,et al.  Deep learning for universal linear embeddings of nonlinear dynamics , 2017, Nature Communications.

[30]  S. Nguyen,et al.  De novo synthesis of a metal-organic framework material featuring ultrahigh surface area and gas storage capacities. , 2010, Nature chemistry.

[31]  Pratyush Tiwary,et al.  Reweighted autoencoded variational Bayes for enhanced sampling (RAVE). , 2018, The Journal of chemical physics.

[32]  S. Rowshanzamir,et al.  Review of the proton exchange membranes for fuel cell applications , 2010 .

[33]  G. Hummer,et al.  Coarse master equations for peptide folding dynamics. , 2008, The journal of physical chemistry. B.

[34]  S. Ong,et al.  Design principles for solid-state lithium superionic conductors. , 2015, Nature materials.

[35]  R. Kondor,et al.  On representing chemical environments , 2012, 1209.3140.

[36]  Leonidas J. Guibas,et al.  Building Markov state models with solvent dynamics , 2013, BMC Bioinformatics.

[37]  C. Angell Insights into Phases of Liquid Water from Study of Its Unusual Glass-Forming Properties , 2008, Science.

[38]  Vijay S. Pande,et al.  Everything you wanted to know about Markov State Models but were afraid to ask. , 2010, Methods.

[39]  Peter Lamp,et al.  Inorganic Solid-State Electrolytes for Lithium Batteries: Mechanisms and Properties Governing Ion Conduction , 2015 .

[40]  Marnix Wagemaker,et al.  Unravelling Li-Ion Transport from Picoseconds to Seconds: Bulk versus Interfaces in an Argyrodite Li6PS5Cl-Li2S All-Solid-State Li-Ion Battery. , 2016, Journal of the American Chemical Society.

[41]  Frank Noé,et al.  Markov state models of biomolecular conformational dynamics. , 2014, Current opinion in structural biology.

[42]  Peter Lamp,et al.  Inorganic Solid-State Electrolytes for Lithium Batteries: Mechanisms and Properties Governing Ion Conduction. , 2015, Chemical reviews.

[43]  B. Scrosati,et al.  Nanocomposite polymer electrolytes for lithium batteries , 1998, Nature.

[44]  Ben Corry,et al.  Designing carbon nanotube membranes for efficient water desalination. , 2008, The journal of physical chemistry. B.

[45]  Regina Barzilay,et al.  Junction Tree Variational Autoencoder for Molecular Graph Generation , 2018, ICML.

[46]  I. Kevrekidis,et al.  Coarse master equation from Bayesian analysis of replica molecular dynamics simulations. , 2005, The journal of physical chemistry. B.

[47]  Jeffrey C Grossman,et al.  Crystal Graph Convolutional Neural Networks for an Accurate and Interpretable Prediction of Material Properties. , 2017, Physical review letters.

[48]  Robert C. Wolpert,et al.  A Review of the , 1985 .

[49]  J. Grossman,et al.  Water desalination across nanoporous graphene. , 2012, Nano letters.

[50]  I. Mezić,et al.  Analysis of Fluid Flows via Spectral Properties of the Koopman Operator , 2013 .

[51]  Oleg Borodin,et al.  Mechanism of Ion Transport in Amorphous Poly(ethylene oxide)/LiTFSI from Molecular Dynamics Simulations , 2006 .

[52]  Mischa Bonn,et al.  Vibrational Spectroscopy and Dynamics of Water. , 2016, Chemical reviews.

[53]  Bo Sun,et al.  Inference of hidden structures in complex physical systems by multi-scale clustering , 2015, ArXiv.

[54]  Thomas F. Miller,et al.  Designing Polymer Electrolytes for Safe and High Capacity Rechargeable Lithium Batteries. , 2017, Accounts of chemical research.

[55]  Srikanth Sastry,et al.  Liquid–liquid phase transition in supercooled silicon , 2003, Nature materials.

[56]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[57]  Boris Kozinsky,et al.  Unsupervised landmark analysis for jump detection in molecular dynamics simulations , 2019, Physical Review Materials.

[58]  Seunghwa Ryu,et al.  A gold–silicon potential fitted to the binary phase diagram , 2010, Journal of physics. Condensed matter : an Institute of Physics journal.

[59]  Nikos Komodakis,et al.  GraphVAE: Towards Generation of Small Graphs Using Variational Autoencoders , 2018, ICANN.

[60]  Fabio Pietrucci,et al.  Graph theory meets ab initio molecular dynamics: atomic structures and transformations at the nanoscale. , 2011, Physical review letters.

[61]  Hong-Cai Zhou,et al.  Selective gas adsorption and separation in metal-organic frameworks. , 2009, Chemical Society reviews.

[62]  Omar M Yaghi,et al.  Gas Adsorption Sites in a Large-Pore Metal-Organic Framework , 2005, Science.

[63]  George Georgiev,et al.  Markov chain model of electrochemical alloy deposition , 2005 .

[64]  Andreas Heuer,et al.  Understanding the Lithium Transport within a Rouse-Based Model for a PEO/LiTFSI Polymer Electrolyte , 2010 .

[65]  Steve Plimpton,et al.  Fast parallel algorithms for short-range molecular dynamics , 1993 .

[66]  James A. Miller,et al.  Master equation methods in gas phase chemical kinetics. , 2006, The journal of physical chemistry. A.

[67]  Andrea J. Liu,et al.  Structural Properties of Defects in Glassy Liquids. , 2016, The journal of physical chemistry. B.

[68]  Kang Xu,et al.  Nonaqueous liquid electrolytes for lithium-based rechargeable batteries. , 2004, Chemical reviews.

[69]  Xiao-Guang Sun,et al.  Li+ transport in poly(ethylene oxide) based electrolytes: neutron scattering, dielectric spectroscopy, and molecular dynamics simulations. , 2013, Physical review letters.

[70]  Max Born,et al.  Zur Gittertheorie der Ionenkristalle , 1932 .

[71]  Wei Cai,et al.  Atomistic mechanisms of orientation and temperature dependence in gold-catalyzed silicon growth , 2017 .

[72]  Alán Aspuru-Guzik,et al.  Convolutional Networks on Graphs for Learning Molecular Fingerprints , 2015, NIPS.

[73]  John Newman,et al.  Negative transference numbers in poly(ethylene oxide)-based electrolytes , 2017 .

[74]  Vijay S. Pande,et al.  Low Data Drug Discovery with One-Shot Learning , 2016, ACS central science.

[75]  Tian Xie,et al.  Hierarchical Visualization of Materials Space with Graph Convolutional Neural Networks , 2018, The Journal of chemical physics.

[76]  Peter Hamm,et al.  Markov state model of the two-state behaviour of water. , 2016, The Journal of chemical physics.