Molecular force fields with gradient-domain machine learning: Construction and application to dynamics of small molecules with coupled cluster forces.

We present the construction of molecular force fields for small molecules (less than 25 atoms) using the recently developed symmetrized gradient-domain machine learning (sGDML) approach [Chmiela et al., Nat. Commun. 9, 3887 (2018) and Chmiela et al., Sci. Adv. 3, e1603015 (2017)]. This approach is able to accurately reconstruct complex high-dimensional potential-energy surfaces from just a few 100s of molecular conformations extracted from ab initio molecular dynamics trajectories. The data efficiency of the sGDML approach implies that atomic forces for these conformations can be computed with high-level wavefunction-based approaches, such as the "gold standard" coupled-cluster theory with single, double and perturbative triple excitations [CCSD(T)]. We demonstrate that the flexible nature of the sGDML model recovers local and non-local electronic interactions (e.g., H-bonding, proton transfer, lone pairs, changes in hybridization states, steric repulsion, and n → π* interactions) without imposing any restriction on the nature of interatomic potentials. The analysis of sGDML molecular dynamics trajectories yields new qualitative insights into dynamics and spectroscopy of small molecules close to spectroscopic accuracy.

[1]  G. Solomon,et al.  Interatomic inelastic current , 2017 .

[2]  R. Sarpong,et al.  Bio-inspired synthesis of xishacorenes A, B, and C, and a new congener from fuscol† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c9sc02572c , 2019, Chemical science.

[3]  K. Müller,et al.  Machine Learning Predictions of Molecular Properties: Accurate Many-Body Potentials and Nonlocality in Chemical Space , 2015, The journal of physical chemistry letters.

[4]  Aldo Glielmo,et al.  Efficient nonparametric n -body force fields from machine learning , 2018, 1801.04823.

[5]  E. Kryachko,et al.  On the intramolecular origin of the blue shift of A-H stretching frequencies: triatomic hydrides HAX. , 2009, The journal of physical chemistry. A.

[6]  T. Oroguchi,et al.  Influences of lone-pair electrons on directionality of hydrogen bonds formed by hydrophilic amino acid side chains in molecular dynamics simulation , 2017, Scientific Reports.

[7]  Britta Redlich,et al.  Structures of Neutral Au7, Au19, and Au20 Clusters in the Gas Phase , 2008, Science.

[8]  Peter Sollich,et al.  Accurate interatomic force fields via machine learning with covariant kernels , 2016, 1611.03877.

[9]  Klaus-Robert Müller,et al.  Many-Body Descriptors for Predicting Molecular Properties with Machine Learning: Analysis of Pairwise and Three-Body Interactions in Molecules. , 2018, Journal of chemical theory and computation.

[10]  A. Tkatchenko,et al.  Accurate molecular van der Waals interactions from ground-state electron density and free-atom reference data. , 2009, Physical review letters.

[11]  I. Majerz,et al.  Peculiarities of quasi-aromatic hydrogen bonding , 2012 .

[12]  Klaus-Robert Müller,et al.  Assessment and Validation of Machine Learning Methods for Predicting Molecular Atomization Energies. , 2013, Journal of chemical theory and computation.

[13]  Atsuto Seko,et al.  Exploring a potential energy surface by machine learning for characterizing atomic transport , 2017, 1710.03468.

[14]  J. Behler,et al.  Construction of high-dimensional neural network potentials using environment-dependent atom pairs. , 2012, The Journal of chemical physics.

[15]  Zhenwei Li,et al.  Molecular dynamics with on-the-fly machine learning of quantum-mechanical forces. , 2015, Physical review letters.

[16]  Gábor Csányi,et al.  Gaussian approximation potentials: A brief tutorial introduction , 2015, 1502.01366.

[17]  Yaliang Li,et al.  SCI , 2021, Proceedings of the 30th ACM International Conference on Information & Knowledge Management.

[18]  J. Tersoff,et al.  New empirical approach for the structure and energy of covalent systems. , 1988, Physical review. B, Condensed matter.

[19]  J. Behler,et al.  Representing molecule-surface interactions with symmetry-adapted neural networks. , 2007, The Journal of chemical physics.

[20]  Michele Parrinello,et al.  Generalized neural-network representation of high-dimensional potential-energy surfaces. , 2007, Physical review letters.

[21]  Lai‐Sheng Wang,et al.  Probing the structures of neutral boron clusters using infrared/vacuum ultraviolet two color ionization: B11, B16, and B17. , 2012, The Journal of chemical physics.

[22]  J. Pablo.,et al.  Dinámica del volteo de bloques en taludes rocosos , 2020 .

[23]  Alexandre Tkatchenko,et al.  Quantum-chemical insights from deep tensor neural networks , 2016, Nature Communications.

[24]  Li Li,et al.  Bypassing the Kohn-Sham equations with machine learning , 2016, Nature Communications.

[25]  Kipton Barros,et al.  Learning molecular energies using localized graph kernels. , 2016, The Journal of chemical physics.

[26]  Aneesur Rahman,et al.  Correlations in the Motion of Atoms in Liquid Argon , 1964 .

[27]  Djork-Arné Clevert,et al.  Learning continuous and data-driven molecular descriptors by translating equivalent chemical representations , 2018, Chemical science.

[28]  野村栄一,et al.  2 , 1900, The Hatak Witches.

[29]  Klaus-Robert Müller,et al.  Machine learning of accurate energy-conserving molecular force fields , 2016, Science Advances.

[30]  M. Schmitt,et al.  Franck Condon spectra of the 2-tolunitrile dimer and the binary 2-tolunitrile water cluster in the gas phase , 2017 .

[31]  K. Müller,et al.  Towards exact molecular dynamics simulations with machine-learned force fields , 2018, Nature Communications.

[32]  E Weinan,et al.  Deep Potential Molecular Dynamics: a scalable model with the accuracy of quantum mechanics , 2017, Physical review letters.

[33]  Alexandre Tkatchenko,et al.  Non-covalent interactions across organic and biological subsets of chemical space: Physics-based potentials parametrized from machine learning. , 2017, The Journal of chemical physics.

[34]  Rampi Ramprasad,et al.  A universal strategy for the creation of machine learning-based atomistic force fields , 2017, npj Computational Materials.

[35]  W. L. Jorgensen,et al.  Comparison of simple potential functions for simulating liquid water , 1983 .

[36]  J. Behler Perspective: Machine learning potentials for atomistic simulations. , 2016, The Journal of chemical physics.

[37]  Trevor Hastie,et al.  The Elements of Statistical Learning , 2001 .

[38]  Anders S. Christensen,et al.  Alchemical and structural distribution based representation for universal quantum machine learning. , 2017, The Journal of chemical physics.

[39]  Peter A. Kollman,et al.  AMBER: Assisted model building with energy refinement. A general program for modeling molecules and their interactions , 1981 .

[40]  R. Raines,et al.  The n→π* Interaction , 2017, Accounts of chemical research.

[41]  M. Rupp,et al.  Machine learning of molecular electronic properties in chemical compound space , 2013, 1305.7074.

[42]  Stéphane Mallat,et al.  Solid Harmonic Wavelet Scattering for Predictions of Molecule Properties , 2018, The Journal of chemical physics.

[43]  J. López,et al.  Rotational Characterization of an n → π* Interaction in a Pyridine-Formaldehyde Adduct. , 2018, The journal of physical chemistry letters.

[44]  J. Behler Atom-centered symmetry functions for constructing high-dimensional neural network potentials. , 2011, The Journal of chemical physics.

[45]  John E Herr,et al.  The many-body expansion combined with neural networks. , 2016, The Journal of chemical physics.

[46]  Hao Wu,et al.  VAMPnets for deep learning of molecular kinetics , 2017, Nature Communications.

[47]  R. Sankararamakrishnan,et al.  Unconventional N-H…N Hydrogen Bonds Involving Proline Backbone Nitrogen in Protein Structures. , 2016, Biophysical journal.

[48]  Michael W. Mahoney,et al.  A five-site model for liquid water and the reproduction of the density anomaly by rigid, nonpolarizable potential functions , 2000 .

[49]  Andrea Grisafi,et al.  Symmetry-Adapted Machine Learning for Tensorial Properties of Atomistic Systems. , 2017, Physical review letters.

[50]  Vladimir Naumovich Vapni The Nature of Statistical Learning Theory , 1995 .

[51]  Burke,et al.  Generalized Gradient Approximation Made Simple. , 1996, Physical review letters.

[52]  S. Scheiner Special Issue: Intramolecular Hydrogen Bonding 2017 , 2017, Molecules.

[53]  Noam Bernstein,et al.  Machine learning unifies the modeling of materials and molecules , 2017, Science Advances.

[54]  K-R Müller,et al.  SchNetPack: A Deep Learning Toolbox For Atomistic Systems. , 2018, Journal of chemical theory and computation.

[55]  David W Toth,et al.  The TensorMol-0.1 model chemistry: a neural network augmented with long-range physics , 2017, Chemical science.

[56]  Antonio-José Almeida,et al.  NAT , 2019, Springer Reference Medizin.

[57]  Hao Wu,et al.  Boltzmann generators: Sampling equilibrium states of many-body systems with deep learning , 2018, Science.

[58]  R. Kondor,et al.  On representing chemical environments , 2012, 1209.3140.

[59]  Alexander V. Shapeev,et al.  Active learning of linearly parametrized interatomic potentials , 2016, 1611.09346.

[60]  Rampi Ramprasad,et al.  Learning scheme to predict atomic forces and accelerate materials simulations , 2015, 1505.02701.

[61]  J. Behler Neural network potential-energy surfaces in chemistry: a tool for large-scale simulations. , 2011, Physical chemistry chemical physics : PCCP.

[62]  J. Yi,et al.  Electronic spectra of 2- and 3-tolunitrile in the gas phase. I. A study of methyl group internal rotation via rovibronically resolved spectroscopy. , 2016, The Journal of chemical physics.

[63]  Gerbrand Ceder,et al.  Efficient and accurate machine-learning interpolation of atomic energies in compositions with many species , 2017, 1706.06293.

[64]  Sason Shaik,et al.  A Unified Theory for the Blue- and Red-Shifting Phenomena in Hydrogen and Halogen Bonds. , 2017, Journal of chemical theory and computation.

[65]  R. Kondor,et al.  Gaussian approximation potentials: the accuracy of quantum mechanics, without the electrons. , 2009, Physical review letters.

[66]  Derui Liu,et al.  ACC , 2020, Catalysis from A to Z.

[67]  Isaac Tamblyn,et al.  Convolutional neural networks for atomistic systems , 2017, Computational Materials Science.

[68]  George E. Dahl,et al.  Prediction Errors of Molecular Machine Learning Models Lower than Hybrid DFT Error. , 2017, Journal of chemical theory and computation.

[69]  Justin S. Smith,et al.  Hierarchical modeling of molecular energies using a deep neural network. , 2017, The Journal of chemical physics.

[70]  R. Raines,et al.  An n→π* interaction in aspirin: implications for structure and reactivity. , 2011, The Journal of organic chemistry.

[71]  Matthias Rupp,et al.  Big Data Meets Quantum Chemistry Approximations: The Δ-Machine Learning Approach. , 2015, Journal of chemical theory and computation.

[72]  P. Hobza N-H· · ·F improper blue-shifting H-bond† , 2002 .

[73]  M. Rupp,et al.  Machine Learning for Quantum Mechanical Properties of Atoms in Molecules , 2015, 1505.00350.

[74]  K. L. Reid,et al.  Probing the origins of vibrational mode specificity in intramolecular dynamics through picosecond time-resolved photoelectron imaging studies. , 2017, Physical chemistry chemical physics : PCCP.

[75]  Michael Gastegger,et al.  Machine learning molecular dynamics for the simulation of infrared spectra† †Electronic supplementary information (ESI) available. See DOI: 10.1039/c7sc02267k , 2017, Chemical science.

[76]  M. Karplus,et al.  CHARMM: A program for macromolecular energy, minimization, and dynamics calculations , 1983 .

[77]  George E. Karniadakis,et al.  An Atomistic Fingerprint Algorithm for Learning Ab Initio Molecular Force Fields , 2018, The Journal of chemical physics.

[78]  Chem. , 2020, Catalysis from A to Z.

[79]  Gábor Csányi,et al.  Comparing molecules and solids across structural and alchemical space. , 2015, Physical chemistry chemical physics : PCCP.

[80]  Roman M. Balabin The identification of the two missing conformers of gas-phase alanine: a jet-cooled Raman spectroscopy study. , 2010, Physical chemistry chemical physics : PCCP.

[81]  B. Kuhn,et al.  Intramolecular hydrogen bonding in medicinal chemistry. , 2010, Journal of medicinal chemistry.

[82]  P. Alam ‘O’ , 2021, Composites Engineering: An A–Z Guide.

[83]  Bertrand Guillot,et al.  A reappraisal of what we have learnt during three decades of computer simulations on water , 2002 .

[84]  K. Müller,et al.  Fast and accurate modeling of molecular atomization energies with machine learning. , 2011, Physical review letters.

[85]  Walter Thiel,et al.  Structure-based sampling and self-correcting machine learning for accurate calculations of potential energy surfaces and vibrational levels. , 2017, The Journal of chemical physics.

[86]  Matthew L. Leininger,et al.  Psi4: an open‐source ab initio electronic structure program , 2012 .

[87]  Eric R. Ziegel,et al.  The Elements of Statistical Learning , 2003, Technometrics.

[88]  Risi Kondor,et al.  Predicting molecular properties with covariant compositional networks. , 2018, The Journal of chemical physics.

[89]  K-R Müller,et al.  SchNet - A deep learning architecture for molecules and materials. , 2017, The Journal of chemical physics.

[90]  J S Smith,et al.  ANI-1: an extensible neural network potential with DFT accuracy at force field computational cost , 2016, Chemical science.

[91]  P. Alam ‘A’ , 2021, Composites Engineering: An A–Z Guide.

[92]  S. Mahapatra,et al.  On the Jahn–Teller effect in the X∼2E electronic ground state of CH3F+ , 2017 .

[93]  Chris Oostenbrink,et al.  An improved nucleic acid parameter set for the GROMOS force field , 2005, J. Comput. Chem..

[94]  Arieh Warshel,et al.  Modeling electrostatic effects in proteins. , 2006, Biochimica et biophysica acta.

[95]  F. Stillinger,et al.  Molecular Dynamics Study of Liquid Water , 1971 .

[96]  Xiao Wang,et al.  Psi4 1.1: An Open-Source Electronic Structure Program Emphasizing Automation, Advanced Libraries, and Interoperability. , 2017, Journal of chemical theory and computation.

[97]  Matthias Scheffler,et al.  Ab initio molecular simulations with numeric atom-centered orbitals , 2009, Comput. Phys. Commun..

[98]  P. Alam ‘S’ , 2021, Composites Engineering: An A–Z Guide.

[99]  Daniel G A Smith,et al.  Psi4NumPy: An Interactive Quantum Chemistry Programming Environment for Reference Implementations and Rapid Development. , 2018, Journal of chemical theory and computation.

[100]  L. Verlet Computer "Experiments" on Classical Fluids. I. Thermodynamical Properties of Lennard-Jones Molecules , 1967 .

[101]  M. Baskes,et al.  Embedded-atom method: Derivation and application to impurities, surfaces, and other defects in metals , 1984 .

[102]  O. Anatole von Lilienfeld,et al.  The "DNA" of chemistry: Scalable quantum machine learning with "amons" , 2017, 1707.04146.