Learned Force Fields Are Ready For Ground State Catalyst Discovery

We present evidence that learned density functional theory (“DFT”) force fields are ready for ground state catalyst discovery. Our key finding is that relaxation using forces from a learned potential yields structures with similar or lower energy to those relaxed using the RPBE functional in over 50% of evaluated systems, despite the fact that the predicted forces differ significantly from the ground truth. This has the surprising implication that learned potentials may be ready for replacing DFT in challenging catalytic systems such as those found in the Open Catalyst 2020 dataset. Furthermore, we show that a force field trained on a locally harmonic energy surface with the same minima as a target DFT energy is also able to find lower or similar energy structures in over 50% of cases. This “Easy Potential” converges in fewer steps than a standard model trained on true energies and forces, which further accelerates calculations. Its success illustrates a key point: learned potentials can locate energy minima even when the model has high force errors. The main requirement for structure optimisation is simply that the learned potential has the correct minima. Since learned potentials are fast and scale linearly with system size, our results open the possibility of quickly finding ground states for large systems.

[1]  James Martens,et al.  Pre-training via Denoising for Molecular Property Prediction , 2022, ArXiv.

[2]  P. Battaglia,et al.  Simple GNN Regularisation for 3D Molecular Property Prediction&Beyond , 2021, 2106.07971.

[3]  Zachary W. Ulissi,et al.  How Do Graph Networks Generalize to Large and Diverse Molecular Systems? , 2022, ArXiv.

[4]  Norman A. Rink,et al.  Automap: Towards Ergonomic Automated Parallelism for ML Models , 2021, ArXiv.

[5]  Florian Becker,et al.  GemNet: Universal Directional Graph Neural Networks for Molecules , 2021, NeurIPS.

[6]  Jian Tang,et al.  Learning Gradient Fields for Molecular Conformation Generation , 2021, ICML.

[7]  J. Leskovec,et al.  ForceNet: A Graph Neural Network for Large-Scale Quantum Calculations , 2021, ArXiv.

[8]  Michael Gastegger,et al.  Equivariant message passing for the prediction of tensorial properties and molecular spectra , 2021, ICML.

[9]  Michael Gastegger,et al.  Machine Learning Force Fields , 2020, Chemical reviews.

[10]  Shitong Luo,et al.  Predicting Molecular Conformation via Dynamic Graph Score Matching , 2021, NeurIPS.

[11]  Johannes T. Margraf,et al.  Fast and Uncertainty-Aware Directional Message Passing for Non-Equilibrium Molecules , 2020, ArXiv.

[12]  C. Lawrence Zitnick,et al.  The Open Catalyst 2020 (OC20) Dataset and Community Challenges , 2020, Proceedings of the International Conference on Electrocatalysis for Energy Applications and Sustainable Chemicals.

[13]  Alice E. A. Allen,et al.  The ONETEP linear-scaling density functional theory program. , 2020, The Journal of chemical physics.

[14]  Stephan Günnemann,et al.  Directional Message Passing for Molecular Graphs , 2020, ICLR.

[15]  Jure Leskovec,et al.  Learning to Simulate Complex Physics with Graph Networks , 2020, ICML.

[16]  W. Hager,et al.  and s , 2019, Shallow Water Hydraulics.

[17]  R. Sarpong,et al.  Bio-inspired synthesis of xishacorenes A, B, and C, and a new congener from fuscol† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c9sc02572c , 2019, Chemical science.

[18]  Nicola Marzari,et al.  Precision and efficiency in solid-state pseudopotential calculations , 2018, npj Computational Materials.

[19]  Jascha Sohl-Dickstein,et al.  Dynamical Isometry and a Mean Field Theory of CNNs: How to Train 10, 000-Layer Vanilla Convolutional Neural Networks , 2018, ICML.

[20]  Razvan Pascanu,et al.  Relational inductive biases, deep learning, and graph networks , 2018, ArXiv.

[21]  F. Neese,et al.  Communication: An improved linear scaling perturbative triples correction for the domain based local pair-natural orbital based singles and doubles coupled cluster method [DLPNO-CCSD(T)]. , 2018, The Journal of chemical physics.

[22]  Frank Hutter,et al.  Fixing Weight Decay Regularization in Adam , 2017, ArXiv.

[23]  Mario Motta,et al.  Ab initio computations of molecular systems by the auxiliary‐field quantum Monte Carlo method , 2017, 1711.02242.

[24]  Klaus-Robert Müller,et al.  SchNet: A continuous-filter convolutional neural network for modeling quantum interactions , 2017, NIPS.

[25]  Samuel S. Schoenholz,et al.  Neural Message Passing for Quantum Chemistry , 2017, ICML.

[26]  Razvan Pascanu,et al.  Interaction Networks for Learning about Objects, Relations and Physics , 2016, NIPS.

[27]  Quoc V. Le,et al.  Adding Gradient Noise Improves Learning for Very Deep Networks , 2015, ArXiv.

[28]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[29]  P. Cochat,et al.  Et al , 2008, Archives de pediatrie : organe officiel de la Societe francaise de pediatrie.

[30]  W. Marsden I and J , 2012 .

[31]  Stefano de Gironcoli,et al.  QUANTUM ESPRESSO: a modular and open-source software project for quantum simulations of materials , 2009, Journal of physics. Condensed matter : an Institute of Physics journal.

[32]  R. Bartlett,et al.  Coupled-cluster theory in quantum chemistry , 2007 .

[33]  Neil Genzlinger A. and Q , 2006 .

[34]  Gustavo E Scuseria,et al.  Efficient hybrid density functional calculations in solids: assessment of the Heyd-Scuseria-Ernzerhof screened Coulomb hybrid functional. , 2004, The Journal of chemical physics.

[35]  Kevin Barraclough,et al.  I and i , 2001, BMJ : British Medical Journal.

[36]  R. Needs,et al.  Quantum Monte Carlo simulations of solids , 2001 .

[37]  Burke,et al.  Generalized Gradient Approximation Made Simple. , 1996, Physical review letters.

[38]  Kresse,et al.  Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set. , 1996, Physical review. B, Condensed matter.

[39]  Berend Smit,et al.  Understanding molecular simulation: from algorithms to applications , 1996 .

[40]  G. Kresse,et al.  Efficiency of ab-initio total energy calculations for metals and semiconductors using a plane-wave basis set , 1996 .

[41]  Hafner,et al.  Ab initio molecular dynamics for liquid metals. , 1995, Physical review. B, Condensed matter.

[42]  Jorge Nocedal,et al.  On the limited memory BFGS method for large scale optimization , 1989, Math. Program..

[43]  A. Zunger,et al.  A new method for diagonalising large matrices , 1985 .

[44]  W. Kohn,et al.  Self-Consistent Equations Including Exchange and Correlation Effects , 1965 .

[45]  P. Hohenberg,et al.  Inhomogeneous Electron Gas , 1964 .

[46]  Janet E. Jones On the determination of molecular fields. —II. From the equation of state of a gas , 1924 .