Simulate Time-integrated Coarse-grained Molecular Dynamics with Geometric Machine Learning

Molecular dynamics (MD) simulation is the workhorse of various scientific domains but is limited by high computational cost. Learning-based force fields have made major progress in accelerating ab-initio MD simulation but are still not fast enough for many real-world applications that require long-time MD simulation. In this paper, we adopt a different machine learning approach where we coarse-grain a physical system using graph clustering, and model the system evolution with a very large time-integration step using graph neural networks. A novel score-based GNN refinement module resolves the long-standing challenge of long-time simulation instability. Despite only trained with short MD trajectory data, our learned simulator can generalize to unseen novel systems and simulate for much longer than the training trajectories. Properties requiring 10-100 ns level long-time dynamics can be accurately recovered at several-orders-of-magnitude higher speed than classical force fields. We demonstrate the effectiveness of our method on two realistic complex systems: (1) single-chain coarse-grained polymers in implicit solvent; (2) multi-component Li-ion polymer electrolyte systems.

[1]  Amr H. Mahmoud,et al.  Accurate Sampling of Macromolecular Conformations Using Adaptive Deep Learning and Coarse-Grained Representation , 2022, J. Chem. Inf. Model..

[2]  Benjamin Kurt Miller,et al.  Generative Coarse-Graining of Molecular Conformations , 2022, ICML.

[3]  A. Farimani,et al.  Graph Neural Networks Accelerated Molecular Dynamics , 2021, The Journal of chemical physics.

[4]  Steven J. Plimpton,et al.  LAMMPS - A flexible simulation tool for particle-based materials modeling at the atomic, meso, and continuum scales , 2021, Computer Physics Communications.

[5]  Jonathan P. Mailoa,et al.  E(3)-equivariant graph neural networks for data-efficient and accurate interatomic potentials , 2021, Nature Communications.

[6]  Florian Becker,et al.  GemNet: Universal Directional Graph Neural Networks for Molecules , 2021, NeurIPS.

[7]  Alán Aspuru-Guzik,et al.  Machine-learned potentials for next-generation matter simulations , 2021, Nature Materials.

[8]  Jonathan P. Mailoa,et al.  Accurate and scalable graph neural network force field and molecular dynamics with direct force architecture , 2021, npj Computational Materials.

[9]  F. Schmid,et al.  Introducing Memory in Coarse-Grained Molecular Simulations , 2021, The journal of physical chemistry. B.

[10]  Jian Tang,et al.  Learning Gradient Fields for Molecular Conformation Generation , 2021, ICML.

[11]  Klaus-Robert Müller,et al.  SpookyNet: Learning force fields with electronic degrees of freedom and nonlocal effects , 2021, Nature Communications.

[12]  W. E,et al.  Efficient sampling of high-dimensional free energy landscapes using adaptive reinforced dynamics , 2021, Nature Computational Science.

[13]  Bart M. H. Bruininks,et al.  Martini 3: a general purpose force field for coarse-grained molecular dynamics , 2021, Nature Methods.

[14]  Max Welling,et al.  E(n) Equivariant Graph Neural Networks , 2021, ICML.

[15]  Toni Giorgino,et al.  TorchMD: A Deep Learning Framework for Molecular Simulations , 2020, Journal of chemical theory and computation.

[16]  Michael Gastegger,et al.  Machine Learning Force Fields , 2020, Chemical reviews.

[17]  T. Pfaff,et al.  Learning Mesh-Based Simulation with Graph Networks , 2020, ICLR.

[18]  Jeffrey C. Grossman,et al.  Accelerating the screening of amorphous polymer electrolytes by learning to reduce random and systematic errors in molecular dynamics simulations , 2021, ArXiv.

[19]  E. D. Cubuk,et al.  JAX, M.D. A framework for differentiable physics , 2020, NeurIPS.

[20]  J. D. de Pablo,et al.  Targeted sequence design within the coarse-grained polymer genome , 2020, Science Advances.

[21]  Frank Noé,et al.  Coarse graining molecular dynamics with graph neural networks. , 2020, The Journal of chemical physics.

[22]  Heta A. Gandhi,et al.  Graph neural network based coarse-grained mapping prediction , 2020, Chemical Science.

[23]  F. Noé,et al.  Large-scale simulation of biomembranes incorporating realistic kinetics into coarse-grained models , 2020, Nature Communications.

[24]  E Weinan,et al.  Pushing the Limit of Molecular Dynamics with Ab Initio Accuracy to 100 Million Atoms with Machine Learning , 2020, SC20: International Conference for High Performance Computing, Networking, Storage and Analysis.

[25]  Jeremiah A. Johnson,et al.  Toward Designing Highly Conductive Polymer Electrolytes by Machine Learning Assisted Coarse-Grained Molecular Dynamics , 2020, Chemistry of Materials.

[26]  Mark E Tuckerman,et al.  Comparison of the Performance of Machine Learning Models in Representing High-Dimensional Free Energy Surfaces and Generating Observables. , 2020, The journal of physical chemistry. B.

[27]  Stephan Günnemann,et al.  Directional Message Passing for Molecular Graphs , 2020, ICLR.

[28]  Jure Leskovec,et al.  Learning to Simulate Complex Physics with Graph Networks , 2020, ICML.

[29]  Andrew L. Ferguson,et al.  Discovery of Self-Assembling π-Conjugated Peptides by Active Learning-Directed Coarse-Grained Molecular Simulation , 2020, The journal of physical chemistry. B.

[30]  Frank Noé,et al.  Machine learning for molecular simulation , 2019, Annual review of physical chemistry.

[31]  Natalia Gimelshein,et al.  PyTorch: An Imperative Style, High-Performance Deep Learning Library , 2019, NeurIPS.

[32]  Vikas Nanda,et al.  PET-RAFT and SAXS: High Throughput Tools to Study Compactness and Flexibility of Single-Chain Polymer Nanoparticles. , 2019, Macromolecules.

[33]  M. Armand,et al.  Polymer Electrolytes for Lithium-Based Batteries: Advances and Prospects , 2019, Chem.

[34]  Yi Isaac Yang,et al.  Enhanced sampling in molecular dynamics. , 2019, The Journal of chemical physics.

[35]  Yang Song,et al.  Generative Modeling by Estimating Gradients of the Data Distribution , 2019, NeurIPS.

[36]  Jan Eric Lenssen,et al.  Fast Graph Representation Learning with PyTorch Geometric , 2019, ArXiv.

[37]  Wujie Wang,et al.  Coarse-graining auto-encoders for molecular dynamics , 2018, npj Computational Materials.

[38]  Frank Noé,et al.  Machine Learning of Coarse-Grained Molecular Dynamics Force Fields , 2018, ACS central science.

[39]  Hao Wu,et al.  Boltzmann generators: Sampling equilibrium states of many-body systems with deep learning , 2018, Science.

[40]  Jiajun Wu,et al.  Propagation Networks for Model-Based Control Under Partial Observation , 2018, 2019 International Conference on Robotics and Automation (ICRA).

[41]  Jiajun Wu,et al.  Learning Particle Dynamics for Manipulating Rigid Bodies, Deformable Objects, and Fluids , 2018, ICLR.

[42]  Jonathan P. Mailoa,et al.  Effect of Salt Concentration on Ion Clustering and Transport in Polymer Solid Electrolytes: A Molecular Dynamics Study of PEO–LiTFSI , 2018, Chemistry of Materials.

[43]  K. Müller,et al.  Towards exact molecular dynamics simulations with machine-learned force fields , 2018, Nature Communications.

[44]  Linfeng Zhang,et al.  DeePCG: Constructing coarse-grained models via deep neural networks. , 2018, The Journal of chemical physics.

[45]  Li Li,et al.  Tensor Field Networks: Rotation- and Translation-Equivariant Neural Networks for 3D Point Clouds , 2018, ArXiv.

[46]  Mohammad M. Sultan,et al.  Transferable Neural Networks for Enhanced Sampling of Protein Dynamics. , 2018, Journal of chemical theory and computation.

[47]  E Weinan,et al.  Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics , 2017, Physical review letters.

[48]  F. Bella,et al.  Photocured polymer electrolytes for lithium-based batteries , 2018 .

[49]  Mark E Tuckerman,et al.  Stochastic Neural Network Approach for Learning High-Dimensional Free Energy Surfaces. , 2017, Physical review letters.

[50]  Gerhard Hummer,et al.  Kinetics from Replica Exchange Molecular Dynamics Simulations. , 2017, Journal of chemical theory and computation.

[51]  Klaus-Robert Müller,et al.  Machine learning of accurate energy-conserving molecular force fields , 2016, Science Advances.

[52]  Michael A Webb,et al.  Enhancing Cation Diffusion and Suppressing Anion Diffusion via Lewis-Acidic Polymer Electrolytes. , 2016, The journal of physical chemistry letters.

[53]  A. Kolinski,et al.  Coarse-Grained Protein Models and Their Applications. , 2016, Chemical reviews.

[54]  C. Barner‐Kowollik,et al.  Single-Chain Folding of Synthetic Polymers: A Critical Update. , 2016, Macromolecular rapid communications.

[55]  Brett M. Savoie,et al.  Systematic Computational and Experimental Investigation of Lithium-Ion Transport Mechanisms in Polyester-Based Polymer Electrolytes , 2015, ACS central science.

[56]  Rafael C. Bernardi,et al.  Enhanced sampling techniques in molecular dynamics simulations of biological systems. , 2015, Biochimica et biophysica acta.

[57]  W G Noid,et al.  Perspective: Coarse-grained models for biomolecular systems. , 2013, The Journal of chemical physics.

[58]  R. Dror,et al.  How Fast-Folding Proteins Fold , 2011, Science.

[59]  Juan J de Pablo,et al.  Coarse-Grained Simulations of Macromolecules : From DNA to Nanocomposites , 2013 .

[60]  D. Tieleman,et al.  The MARTINI force field: coarse grained model for biomolecular simulations. , 2007, The journal of physical chemistry. B.

[61]  M. Karplus,et al.  Molecular dynamics and protein function. , 2005, Proceedings of the National Academy of Sciences of the United States of America.

[62]  A. Laio,et al.  Assessing the accuracy of metadynamics. , 2005, The journal of physical chemistry. B.

[63]  Vipin Kumar,et al.  A Fast and High Quality Multilevel Scheme for Partitioning Irregular Graphs , 1998, SIAM J. Sci. Comput..

[64]  Huai Sun,et al.  Computer simulations of poly(ethylene oxide): force field, pvt diagram and cyclization behaviour , 1997 .

[65]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[66]  H. Sun,et al.  Force field for computation of conformational energies, structures, and vibrational frequencies of aromatic polyesters , 1994, J. Comput. Chem..