Applying Machine Learning Algorithms to Predict Potential Energies and Atomic Forces during C-H Activation

Molecular dynamics (MD) simulations are useful in understanding the interaction between solid materials and molecules. However, performing MD simulations is possible only when interatomic potentials are available and constructing such interatomic potentials usually requires additional computational work. Recently, generating interatomic potentials was shown to be much easier when machine learning (ML) algorithms were used. In addition, ML algorithms require new descriptors for improved performance. Here, we present an ML approach with several categories of atomic descriptors to predict the parameters necessary for MD simulations, such as the potential energies and the atomic forces. We propose several atomic descriptors based on structural information and find that better descriptors can be generated from eXtreme gradient boosting (XGBoost). Moreover, we observe fewer descriptors that perform better in predicting the potential energies and the forces during methane activation processes on a catalytic Pt(111) surface. These results were consistently observed in two different ML algorithms: fully-connected neural network (FNN) and XGBoost. Taking into account the advantages of FNN and XGBoost, we propose an efficient ML model for estimating potential energies. Our findings will be helpful in developing new ML potentials for long-time MD simulations.

[1]  Jörg Behler,et al.  Neural network molecular dynamics simulations of solid-liquid interfaces: water at low-index copper surfaces. , 2016, Physical chemistry chemical physics : PCCP.

[2]  Klaus-Robert Müller,et al.  Machine learning of accurate energy-conserving molecular force fields , 2016, Science Advances.

[3]  Roman M. Balabin,et al.  Support vector machine regression (LS-SVM)--an alternative to artificial neural networks (ANNs) for the analysis of quantum chemistry data? , 2011, Physical chemistry chemical physics : PCCP.

[4]  Jörg Behler,et al.  Automatic selection of atomic fingerprints and reference configurations for machine-learning potentials. , 2018, The Journal of chemical physics.

[5]  Peter Sollich,et al.  Accurate interatomic force fields via machine learning with covariant kernels , 2016, 1611.03877.

[6]  J. Behler Neural network potential-energy surfaces in chemistry: a tool for large-scale simulations. , 2011, Physical chemistry chemical physics : PCCP.

[7]  Rampi Ramprasad,et al.  Learning scheme to predict atomic forces and accelerate materials simulations , 2015, 1505.02701.

[8]  J. Behler Perspective: Machine learning potentials for atomistic simulations. , 2016, The Journal of chemical physics.

[9]  Kresse,et al.  Efficient iterative schemes for ab initio total-energy calculations using a plane-wave basis set. , 1996, Physical review. B, Condensed matter.

[10]  Ali Sadeghi,et al.  A fingerprint based metric for measuring similarities of crystalline structures. , 2015, The Journal of chemical physics.

[11]  George C. Schatz,et al.  A local interpolation scheme using no derivatives in quantum-chemical calculations , 1999 .

[12]  D. Truhlar,et al.  A dual‐level Shepard interpolation method for generating potential energy surfaces for dynamics calculations , 1995 .

[13]  J. Behler First Principles Neural Network Potentials for Reactive Simulations of Large Molecular and Condensed Systems. , 2017, Angewandte Chemie.

[14]  W. L. Jorgensen,et al.  Development and Testing of the OPLS All-Atom Force Field on Conformational Energetics and Properties of Organic Liquids , 1996 .

[15]  Christian Trott,et al.  Spectral neighbor analysis method for automated generation of quantum-accurate interatomic potentials , 2014, J. Comput. Phys..

[16]  M Gastegger,et al.  wACSF-Weighted atom-centered symmetry functions as descriptors in machine learning potentials. , 2017, The Journal of chemical physics.

[17]  Geoffrey J. Gordon,et al.  Constant size descriptors for accurate machine learning models of molecular properties. , 2018, The Journal of chemical physics.

[18]  P. Popelier,et al.  Potential energy surfaces fitted by artificial neural networks. , 2010, The journal of physical chemistry. A.

[19]  Alexandre Tkatchenko,et al.  Non-covalent interactions across organic and biological subsets of chemical space: Physics-based potentials parametrized from machine learning. , 2017, The Journal of chemical physics.

[20]  A. Gross,et al.  Representing high-dimensional potential-energy surfaces for reactions at surfaces by neural networks , 2004 .

[21]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[22]  W. Kim,et al.  Feasibility of Activation Energy Prediction of Gas-Phase Reactions by Machine Learning. , 2018, Chemistry.

[23]  Burak Himmetoglu,et al.  Tree based machine learning framework for predicting ground state energies of molecules. , 2016, The Journal of chemical physics.

[24]  G. Ertl Reactions at surfaces: from atoms to complexity (Nobel Lecture). , 2008, Angewandte Chemie.

[25]  Gaël Varoquaux,et al.  Scikit-learn: Machine Learning in Python , 2011, J. Mach. Learn. Res..

[26]  J. Behler,et al.  Orbital-Dependent Electronic Friction Significantly Affects the Description of Reactive Scattering of N2 from Ru(0001) , 2019, The journal of physical chemistry letters.

[27]  Klaus-Robert Müller,et al.  Many-Body Descriptors for Predicting Molecular Properties with Machine Learning: Analysis of Pairwise and Three-Body Interactions in Molecules. , 2018, Journal of chemical theory and computation.

[28]  Y. M. Rhee,et al.  Condensed phase molecular dynamics using interpolated potential energy surfaces with application to the resolvation process of coumarin 153. , 2011, The Journal of chemical physics.

[29]  Joseph E. Subotnik,et al.  Born-Oppenheimer Dynamics, Electronic Friction, and the Inclusion of Electron-Electron Interactions. , 2017, Physical review letters.

[30]  Rampi Ramprasad,et al.  A universal strategy for the creation of machine learning-based atomistic force fields , 2017, npj Computational Materials.

[31]  Nicola Gaston,et al.  Building machine learning force fields for nanoclusters. , 2018, The Journal of chemical physics.

[32]  Rampi Ramprasad,et al.  Machine Learning Force Fields: Construction, Validation, and Outlook , 2016, 1610.02098.

[33]  K. Müller,et al.  Machine Learning Predictions of Molecular Properties: Accurate Many-Body Potentials and Nonlocality in Chemical Space , 2015, The journal of physical chemistry letters.

[34]  G. Kresse,et al.  From ultrasoft pseudopotentials to the projector augmented-wave method , 1999 .

[35]  J. Tersoff,et al.  Modeling solid-state chemistry: Interatomic potentials for multicomponent systems. , 1989, Physical review. B, Condensed matter.

[36]  K. Müller,et al.  Fast and accurate modeling of molecular atomization energies with machine learning. , 2011, Physical review letters.

[37]  Alexander D. MacKerell Empirical force fields for biological macromolecules: Overview and issues , 2004, J. Comput. Chem..

[38]  Alireza Khorshidi,et al.  Addressing uncertainty in atomistic machine learning. , 2017, Physical chemistry chemical physics : PCCP.

[39]  Paul L. A. Popelier,et al.  A polarizable high-rank quantum topological electrostatic potential developed using neural networks: Molecular dynamics simulations on the hydrogen fluoride dimer , 2007 .

[40]  Alexander D. MacKerell,et al.  All-atom empirical potential for molecular modeling and dynamics studies of proteins. , 1998, The journal of physical chemistry. B.

[41]  Nongnuch Artrith,et al.  High-dimensional neural-network potentials for multicomponent systems: Applications to zinc oxide , 2011 .

[42]  A. L. Utz,et al.  Surface Reaction Barriometry: Methane Dissociation on Flat and Stepped Transition-Metal Surfaces , 2017, The journal of physical chemistry letters.

[43]  J. Behler Atom-centered symmetry functions for constructing high-dimensional neural network potentials. , 2011, The Journal of chemical physics.

[44]  Aidan P Thompson,et al.  Extending the accuracy of the SNAP interatomic potential form. , 2017, The Journal of chemical physics.

[45]  R. Kondor,et al.  On representing chemical environments , 2012, 1209.3140.

[46]  Jörg Behler,et al.  Constructing high‐dimensional neural network potentials: A tutorial review , 2015 .

[47]  R. Kondor,et al.  Gaussian approximation potentials: the accuracy of quantum mechanics, without the electrons. , 2009, Physical review letters.

[48]  M. A. Collins,et al.  Molecular potential energy surfaces by interpolation , 1994 .

[49]  Dimitrios C Papageorgopoulos,et al.  Vibrational Mode-Specific Reaction of Methane on a Nickel Surface , 2003, Science.

[50]  Joseph E. Subotnik,et al.  Perspective: How to understand electronic friction. , 2018, The Journal of chemical physics.

[51]  Hua Guo,et al.  Permutation invariant polynomial neural network approach to fitting potential energy surfaces. IV. Coupled diabatic potential energy matrices. , 2018, The Journal of chemical physics.

[52]  Gábor Csányi,et al.  Gaussian approximation potentials: A brief tutorial introduction , 2015, 1502.01366.

[53]  J Behler,et al.  Representing potential energy surfaces by high-dimensional neural network potentials , 2014, Journal of physics. Condensed matter : an Institute of Physics journal.